Head of Engineering, QA

About Us
👏 Team from OpenAI, DeepMind, NASA, GoogleX, Tesla, and 2 physicians: 6 exits, 2 IPOs.
🔥 Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.
📈 400+ healthcare orgs signed in 16 months.
⚡️ $25M raised from YC, Amity Ventures, Sequoia scouts, and more.
🌎 $1T+ market opportunity. We’re going after all of it.

About the Role
We are seeking a Head of Engineering, QA to build Sully.ai’s QA function from the ground up—owning strategy, automation, and execution. This is a 0→1 role: you’ll set the framework for functional, performance, and compliance testing, scale automation across our stack, and ensure our AI medical employees are safe, reliable, and high-performing. You will also recruit and mentor a team, embedding QA into CI/CD pipelines to enable fast, clinical-grade releases.

Key Responsibilities

• Own QA strategy, defining frameworks for automation, functional, performance, and compliance testing

• Build and scale Playwright-based test automation for UI and API coverage

• Ensure reliability by expanding automation coverage, monitoring dashboards, and resolving test failures quickly

• Guarantee accuracy, security, and compliance (HIPAA/SOC-2), partnering with Engineering and Clinical teams

• Recruit, mentor, and lead a high-performing QA team

• Embed QA into CI/CD pipelines using GitHub Actions and related tooling

Hard Requirements

• Founder / 0→1 experience — first in function, building QA processes and teams from scratch

• 6–8+ years in QA with strong expertise in Playwright

• 3–4+ years of people leadership experience

• Proven ability to automate functional UI and API test cases

• Hands-on with QA tools (Playwright, Cypress, PyTest, Postman)

• Experience scaling test automation and maintaining reliability

• Highly motivated, driven, and ownership-oriented

Nice-to-Have

• Experience testing AI/LLM workflows

• Familiarity with dashboarding and observability tooling

• GitHub Actions CI/CD integration experience

• Prior startup or healthcare QA background

First-Month Focus

• Define Sully.ai’s QA strategy and initial automation framework

• Implement core Playwright test cases across key workflows

• Partner with Engineering and Clinical teams to validate compliance needs

Success OKRs (90 Days)

• Establish automated test coverage across UI and API workflows

• Integrate QA pipelines into GitHub Actions for reliable CI/CD

• Deliver measurable improvements in test reliability and release confidence

Culture Fit

• Persistent, driven problem solver

• Willing to push back on leadership to defend quality/timelines

• Thrives in high-ambiguity, fast-paced startup environments

Why Join Sully.ai?
🔥 Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
📈 Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
🌎 Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
💰 Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
🏆 Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.