PwC Logo

PwC

US Tech - AI Evaluation Engineer (QA) Senior Associate

Posted An Hour Ago
Be an Early Applicant
Remote or Hybrid
2 Locations
151K-187K Annually
Mid level
Remote or Hybrid
2 Locations
151K-187K Annually
Mid level
The role involves developing, testing, and validating Generative AI agents and maintaining automated testing standards. Responsibilities include mentoring junior associates, analyzing complex issues, and applying governance controls in AI-driven solutions.
The summary above was generated by AI
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.
Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.
Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn't clear, you ask questions, and you use these moments as opportunities to grow.
Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:
Respond effectively to the diverse perspectives, needs, and feelings of others.
Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems.
Use critical thinking to break down complex concepts.
Understand the broader objectives of your project or role and how your work fits into the overall strategy.
Develop a deeper understanding of the business context and how it is changing.
Use reflection to develop self awareness, enhance strengths and address development areas.
Interpret data to inform insights and recommendations.
Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.
The Opportunity
As part of the People Tech & AI team you will develop, test, and validate Generative AI agents and data pipelines, promoting reliability, scalability, and alignment with PwC standards. As a Senior Associate you will analyze complex problems, mentor others, and maintain elevated standards while collaborating with multidisciplinary teams to support AI-enabled client solutions. This position provides an exciting opportunity to enhance your skills in automated testing and governance controls while contributing to innovative AI-driven solutions.
Responsibilities
- Apply automated testing and governance controls effectively
- Analyze complex issues and provide actionable insights
- Mentor and guide junior associates in their tasks
- Uphold rigorous standards of quality and technical excellence
What You Must Have
- Bachelor's Degree in Computer Science, Data Processing/Analytics/Science
- At least 2 years of experience in data engineering, AI/ML engineering, or quality engineering
- In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college
What Sets You Apart
- Demonstrating three years of specialized training in technology preferred
- Experience with test automation and CI/CD pipelines
- Familiarity with LLMs and prompt engineering concepts
- Understanding enterprise data patterns and quality frameworks
- Building and maintaining automated test suites for AI agents
- Validating integrations with Power Automate platform
- Executing LLM evaluation frameworks using defined metrics
- Working with data scientists and ML engineers
- Upholding professional standards and documentation expectations
The salary range for this position is: $55,000 - $151,470. For residents of Washington state the salary range for this position is: $55,000 - $187,000. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. All hired individuals are eligible for an annual discretionary bonus. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more. To view our benefits at a glance, please visit the following link: https://pwc.to/benefits-at-a-glance
As PwC is an equal opportunity employer, all qualified applicants will receive consideration for employment at PwC without regard to race; color; religion; national origin; sex (including pregnancy, sexual orientation, and gender identity); age; disability; genetic information (including family medical history); veteran, marital, or citizenship status; or, any other status protected by law.
PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy: https://pwc.to/H-1B-Lottery-Policy.
Learn more about how we work: https://pwc.to/how-we-work
For only those qualified applicants that are impacted by the Los Angeles County Fair Chance Ordinance for Employers, the Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, San Diego County Fair Chance Ordinance, and the California Fair Chance Act, where applicable, arrest or conviction records will be considered for Employment in accordance with these laws. At PwC, we recognize that conviction records may have a direct, adverse, and negative relationship to responsibilities such as accessing sensitive company or customer information, handling proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace for all.
Applications will be accepted until the position is filled or the posting is removed, unless otherwise set forth on the following webpage. Please visit this link for information about anticipated application deadlines: https://pwc.to/us-application-deadlines
#LI-Remote
#LI-Hybrid
#BI-Hybrid

PwC Denver, Colorado, USA Office

1900 Sixteenth Street, Denver, CO, United States, 80202

Similar Jobs at PwC

An Hour Ago
Remote or Hybrid
2 Locations
212K-244K Annually
Senior level
212K-244K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As an AI Engineering Manager at PwC, you will lead the design and operation of AI-powered platforms, mentor engineers, and ensure project delivery excellence while focusing on security and scalability.
Top Skills: AIAzureAzure Bot Framework SdkAzure Cognitive ServicesCloud EngineeringConversational AiData VisualizationDevOpsMachine Learning
An Hour Ago
Remote or Hybrid
2 Locations
212K-244K Annually
Senior level
212K-244K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The AI Evaluation Engineer - Manager leads AI solution teams, develops predictive models, supervises performance, and fosters a collaborative team environment while ensuring ethical AI practices and managing client relationships.
Top Skills: AIGoogle AgentspaceMicrosoft Copilot StudioMicrosoft Power PlatformMl
An Hour Ago
Remote or Hybrid
2 Locations
151K-187K Annually
Mid level
151K-187K Annually
Mid level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Senior Associate, you'll design and develop AI solutions, mentor junior staff, and analyze complex problems to support transformation initiatives for clients.
Top Skills: Azure Bot FrameworkAzure ServicesCognitive ServicesLuisOrchestrator

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account