Designs and maintains automated API, UI, security, performance, integration, and end-to-end tests for AI-powered systems. Integrates testing into CI/CD pipelines, validates data across distributed services and pipelines, assesses AI-generated outputs, and performs security and load testing. Collaborates with Engineering, QA, Product, and Operations to identify root causes, improve testing standards, and support release validation.
At TREND Health Partners, a tech-enabled payment integrity company, our mission is to facilitate collaboration between payers and providers for mutual benefit and waste reduction, ultimately improving access to healthcare. We achieve this by aligning the common goals of payers and providers and fostering collaboration through a shared technology platform and seamless workflows.
Joining TREND Health Partners means becoming a part of a dynamic growing organization that promotes a collaborative and innovative work environment. Our comprehensive compensation package includes competitive salaries, highly valued health insurance, a 401(k) plan with employer match, paid parental leave, and more.
The AI Test Engineer III's primary responsibility is validating the quality, reliability, and safety of AI powered systems across TREND's platform.
The AI Test Engineer III's primary responsibility is validating the quality, reliability, and safety of AI powered systems across TREND's platform.
Role and Responsibilities
Test Automation & Engineering
• Design, build, and maintain automated test suites across API, UI, security, and performance/load testing
• Develop end-to-end and integration tests using Playwright (or equivalent modern frameworks)
• Author API tests for REST/GraphQL services, validating contracts, error handling, and edge cases
• Build and maintain UI automation that is stable, maintainable, and resistant to flakiness
• Integrate all test suites into CI/CD pipelines for continuous, automated validation
AI-Assisted Testing
AI-Assisted Testing
• Use AI-based coding and testing tools (Claude Code, Copilot, and similar) to generate, refactor, and scale tests
• Establish patterns and best practices for using AI assistants effectively and safely in the testing workflow
• Continuously evaluate emerging AI testing tools and bring the useful ones into the team's toolchain
Security & Performance Testing
Security & Performance Testing
• Perform security-focused testing (authn/authz, input validation, common OWASP risks) as part of the release process
• Design and run load and performance tests to validate scalability, latency, and resilience under stress
• Identify bottlenecks and failure points and partner with Engineering on remediation
Data & Integration Validation
Data & Integration Validation
• Validate data integrity across APIs, pipelines, and integrations using strong SQL and data-validation techniques
• Test interactions between services, APIs, and downstream systems in distributed environments
• Detect anomalies, regressions, and gaps across end-to-end workflows
Quality Process & Collaboration
Quality Process & Collaboration
• Work cross-functionally with Engineering, QA, Product, and Operations
• Participate in sprint planning, backlog refinement, and release validation
• Contribute to testing standards, best practices, and documentation
• Support root cause analysis for defects and production issues
Qualifications
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
• Experience in QA automation, test engineering, or a related software engineering role
• Hands-on experience with a modern test automation framework (Playwright strongly preferred; Cypress, Selenium, or similar acceptable)
• Experience testing APIs, distributed systems, and data pipelines
• Strong understanding of software testing principles and test automation design
• Strong SQL and data-validation skills
• Experience integrating tests into CI/CD pipelines
• Experience working in an Agile development environment
• Experience with cloud-based systems, preferably AWS
• Ability to analyze system behavior and identify root causes
Preferred Skills
• Experience testing AI/ML models or data-driven systems
• Experience validating AI-generated outputs or prompt-based systems
• Familiarity with LLMs, agent workflows, or AI-assisted coding tools
• Healthcare or regulated data environment experience (HIPAA, compliance)
• Experience working with CI/CD and DevOps pipelines.
• Experience validating AI-generated outputs or prompt-based systems
• Familiarity with LLMs, agent workflows, or AI-assisted coding tools
• Healthcare or regulated data environment experience (HIPAA, compliance)
• Experience working with CI/CD and DevOps pipelines.
• Experience using AI-assisted coding/testing tools (Claude Code, Copilot, or similar) in a real testing workflow
• Experience with security testing and/or performance/load testing tools (e.g., k6, JMeter, OWASP ZAP)
• Experience with CI/CD and DevOps pipelines
• Healthcare or regulated-data environment experience, including HIPAA and compliance
• Healthcare or regulated-data environment experience, including HIPAA and compliance
• Familiarity with AI/ML concepts (useful context, not the core focus of the role)
Mental And Physical Demands
• This position will be exposed mainly to an indoor office environment and will be expected to work in or
around computers and printers.
• The nature of the work is sedentary, and the employee will be sitting most of the time.
• Essential physical functions of the job include typing and the repetitive motion to utilize computer
software and hardware continuously throughout the day.
• Essential mental functions of this position include concentrating on analytical tasks, reading
information, and verbal/written communication to others continuously throughout the day.
around computers and printers.
• The nature of the work is sedentary, and the employee will be sitting most of the time.
• Essential physical functions of the job include typing and the repetitive motion to utilize computer
software and hardware continuously throughout the day.
• Essential mental functions of this position include concentrating on analytical tasks, reading
information, and verbal/written communication to others continuously throughout the day.
Related Duties As Assigned
• This job description documents the general nature and level of work but is not intended to be a
comprehensive list of activities, duties, or responsibilities required for this position.
comprehensive list of activities, duties, or responsibilities required for this position.
Consequently, employee’s may be asked to perform other duties as required.
• Employees may also be asked to complete certain compliance requirements set forth by our Business
Partners in the performance of their jobs including but not limited to requests for background and drug
screenings and disclosures of personal health information or personally identifiable information.
Exemptions as provided under the ADA and TITLE VII of the Civil Rights Act will be observed and
followed.
• Reasonable accommodations may be made to enable individuals with disabilities to perform the
functions outlined above.
• Employees may also be asked to complete certain compliance requirements set forth by our Business
Partners in the performance of their jobs including but not limited to requests for background and drug
screenings and disclosures of personal health information or personally identifiable information.
Exemptions as provided under the ADA and TITLE VII of the Civil Rights Act will be observed and
followed.
• Reasonable accommodations may be made to enable individuals with disabilities to perform the
functions outlined above.
Similar Jobs
Marketing Tech • Social Media • Software • Analytics • Business Intelligence
Own Sprout Social’s partner and platform integration ecosystem, developing scalable integration strategies, roadmaps, lifecycle processes, packaging, pricing, permissions, and licensing models. Partner with Engineering, Partnerships, GTM, and customers to prioritize investments, launch integrations, and balance immediate commercial needs with long-term platform scalability. The role requires technical fluency in integration architecture, strong commercial judgment, and ownership of measurable product outcomes.
Top Skills:
APIsLicense ManagementManaged PackagesOauthPermission ModelsPlatform Events
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Leads Toast’s analytics engineering function, owning enterprise data architecture, modeling strategy, analytics-layer development, and AI-ready semantic-layer vision. Builds and manages a team of analytics engineers, establishes roadmaps, partners with data engineering and business leaders, and drives scalable, governed data solutions across domains. Requires expertise in data modeling, dbt, SQL, stakeholder alignment, and people leadership.
Top Skills:
AirflowDbtHexPythonSigmaSnowflakeSQL
Cloud • Software
Own NetBox’s build and release pipeline from image creation through Cloud and Enterprise deployment. Improve Django and PostgreSQL performance, establish observability and SLOs, strengthen software supply chain security, and support SOC 2 compliance. Participate in on-call rotations, incident response, and postmortems. Drive cross-team migrations and release processes while contributing fixes to NetBox Core when reliability issues originate in the application.
Top Skills:
ArgocdAws Ec2Aws IamAws RdsAws VpcClaude CodeCosignDjangoFluxcdGithub ActionsGrafanaHelmKubernetesPostgresPrometheusPythonSigstoreSlsaTerraform
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
