HSI Logo

HSI

Sr. QA AI Automation

Posted An Hour Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Build and maintain enterprise-grade Playwright automation frameworks, integrate automated testing into Azure DevOps CI/CD pipelines, and expand regression coverage across SaaS applications and APIs. Drive AI-assisted test generation using tools such as Claude, establish QA standards and metrics, prioritize automation opportunities, collaborate with engineering, product, and DevOps teams, and mentor junior QA staff.
The summary above was generated by AI

HSI is a leading provider of cloud-based environmental, health, and safety (EHS) compliance and workforce development solutions for businesses. Our platforms deliver safety training and learning solutions that empower organizations to build safer, smarter workplaces.

We are seeking a Senior QA Automation Engineer (AI-Driven Testing) to help drive a major transformation in our quality assurance function.

This role is focused on shifting from manual and vendor-driven testing to an automation-first, AI-assisted QA approach. You will play a key role in building scalable test automation frameworks, leveraging modern tools like Playwright and AI (Claude) to dramatically increase test coverage and reduce production defects.

This is a hands-on role with high visibility and growth potential as the QA organization scales.
Key responsibilities include:

  • Contribute and drive the adoption of an AI-driven QA approach across products and platforms
  • Design, build, and maintain enterprise-grade test automation using Playwright
  • Contribute to establishing an automation-first QA approach, including standards, governance, and reporting
  • Leverage AI tools (e.g., Claude) to generate and scale test cases
  • Support the development of standards for AI-assisted test generation, test data strategy, regression design, and observability
  • Help reduce reliance on manual and outsourced QA efforts
  • Execute and expand regression testing across multiple applications
  • Integrate automated testing into Azure DevOps CI/CD pipelines
  • Partner closely with engineering, product, and DevOps teams
  • Identify and prioritize high-value test scenarios for automation
  • Contribute to QA standards, best practices, and automation strategy
  • Help define and track quality and automation metrics (coverage, regression cycle time, defect escape rate, throughput)
  • Support knowledge sharing, documentation, and reuse of automation frameworks
  • Mentor and support jr. QA team members
  • Communicate progress, risks, and KPI trends to leadership

Requirements
  • 5+ years of QA / Software Quality Engineering experience
  • Strong hands-on experience building test automation frameworks (Playwright required)
  • Experience developing and scaling automated test suites for enterprise SaaS or cloud-based applications
  • Experience integrating automated tests into CI/CD pipelines (Azure DevOps preferred)
  • Experience extending AI usage into advanced QA workflows (e.g., large-scale test generation, optimization, intelligent test selection)
  • Hands-on experience using AI tools (e.g., Claude) in development or QA workflows
  • Experience testing web-based applications and APIs
  • Strong understanding of:
    • Regression testing strategies
    • Test design and coverage
    • Automation best practices
  • Ability to work cross-functionally with engineering, product, and DevOps teams

Preferred Qualifications

  • Scaled automation across multiple applications or product lines
  • Worked with agent-based or model-assisted testing approaches
  • Mentored or supported junior QA engineers
  • Helped transition from manual or outsourced QA to automation-first teams
  • Tested complex, highly integrated SaaS platforms (multi-service or multi-tenant)
  • Built or expanded API automation frameworks (REST and/or GraphQL)
  • Worked in Agile/Scrum environments (Scrum certification a plus)

Benefits
  • Fully Remote Work: Work where you're most productive—we trust you.
  • PTO: Recharge when you need to—we support work-life balance.
  • Career Growth: Unlimited access to our Learning & Development library, including our own HSI LMS content.
  • Well-Being First: Full medical, dental, vision, and mental health coverage.
  • Secure Your Future: Generous $1:$1 401(k) company match—your future is important to us.

Similar Jobs

6 Days Ago
In-Office or Remote
Senior level
Senior level
Big Data • Cloud • Digital Media • Machine Learning • Mobile • Software • Industrial
Design, build, and maintain automated test suites, evaluation scenarios, metrics, and datasets for AI-powered features. Automate QA workflows with Python and CI/CD, test APIs and ML model outputs, define quality strategy and acceptance criteria, create CI/CD quality gates, mentor teams, participate in code reviews, and document findings.
Top Skills: Ai-Powered Testing ToolsAirflowAPIsAWSAzureCadCi/CdCometGithub ActionsGoogle Cloud PlatformGreat ExpectationsJenkinsMetaflowMlflowPythonPyTorchTensorFlowWeights & Biases
6 Days Ago
In-Office or Remote
84K-123K Annually
Senior level
84K-123K Annually
Senior level
Big Data • Cloud • Digital Media • Machine Learning • Mobile • Software • Industrial
Design, build, and maintain automated test suites, evaluation scenarios, and CI/CD quality gates for AI-powered applications. Test APIs, validate ML model outputs, create measurable evaluation rubrics, mentor teams, and contribute to shared QA frameworks and codebases.
Top Skills: Ai-Powered Testing ToolsAirflowAWSAzureCadCometGithub ActionsGoogle Cloud PlatformGreat ExpectationsJenkinsMetaflowMlflowPythonPyTorchTensorFlowWeights & Biases
9 Days Ago
In-Office or Remote
United States
38K-133K Annually
Expert/Leader
38K-133K Annually
Expert/Leader
Agency • Information Technology
Lead QA Automation for agentic AI products by designing eval pipelines, golden datasets, and automated tests for tool-use, hallucination detection, latency/token monitoring, and regression across models and prompts. Integrate performance testing into CI/CD and collaborate with AI engineers to convert requirements into measurable automated evaluations.
Top Skills: Ci/CdClaude 3.5CypressDeepevalGpt-4JSONLangsmithPlaywrightPromptfooPytestPythonRagRagasSeleniumSQL

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account