Leads the design, development, evaluation, and production operation of healthcare AI products, including agentic workflows, RAG systems, model optimization, guardrails, and human-review controls. Partners with product, clinical, engineering, data, platform, and security teams to build safe, reliable, observable, and compliant AI systems. Provides technical leadership through architecture, code reviews, incident response, mentoring, and delivery of HITRUST-aligned solutions for regulated healthcare environments.
WHO WE ARE
NeueHealth is a value-driven healthcare company grounded in the belief that all health consumers are entitled to high-quality, coordinated care. By uniquely aligning the interests of health consumers, providers, and payors, we help to make healthcare accessible and affordable to all populations across the ACA Marketplace, Medicare, and Medicaid.
NeueHealth delivers clinical care to health consumers through our owned clinics – Centrum Health and Premier Medical – as well as unique partnerships with affiliated providers across the country. We also enable providers to succeed in performance-based arrangements through a suite of technology and services scaled centrally and deployed locally. Through our value-driven, consumer-centric approach, we are committed to transforming healthcare and creating a better care experience for all.
JOB SUMMARY
The Senior AI Engineer leads the design, delivery, and production operation of complex healthcare AI products spanning traditional software enhanced by AI to AI-native, agentic workflows. This hands-on role owns prompts, agent behavior, retrieval, model optimization, evaluations, and human-review controls that make high-stakes workflows safe, reliable, observable, and governable.
Working independently and in close partnership with Product, business, clinical, operational, Data Engineering, Platform, and Security teams, the Senior AI Engineer translates real-world workflows into configuration-driven decision logic and scalable systems for operating AI at enterprise scale. They curate domain datasets, drive evaluation-based iteration, optimize models and retrieval, and help advance what is possible with AI in a highly regulated healthcare environment.
This is a work-from-home position; candidates located in TX, MN, or FL are preferred, subject to business need.
DUTIES & RESPONSIBILITIES
- Lead the end-to-end delivery of complex AI products including agentic workflows, RAG systems, and services.
- Collaborate with Product, Engineering, Data, and clinical and operational teams.
- Translate stakeholder needs into validated, access-aware AI workflows with clear system behavior, acceptance criteria, risk controls, and delivery trade-offs.
- Design AI workflow and RAG product lines, including ingestion, retrieval quality, attribution, confidence handling, agent tools, and human-review paths.
- Implement workflows with reliable AI control layers and optimize healthcare AI models across prompting, retrieval, reranking, fine-tuning, and model-selection approaches.
- Own healthcare AI evaluation and release frameworks, including adversarial testing, regression thresholds, release gates, and production telemetry.
- Provide senior technical leadership through design and code reviews, incident response, mentoring, and reusable engineering improvements.
- Deliver healthcare AI services using approved cloud capabilities and HITRUST-aligned controls for PHI/PII, security, privacy, auditability, responsible AI, and compliance.
EDUCATION, TRAINING, AND PROFESSIONAL EXPERIENCE
- Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Data Science, Linguistics, or a related field; equivalent practical experience may be considered.
- Typically, 5+ years of relevant engineering experience, including ownership of complex production components or technical leadership of feature delivery.
- Hands-on experience delivering and operating production or near-production AI/ML/LLM-enabled applications.
- Strong software engineering expertise in service and data-contract design, testing, CI/CD, observability, debugging, reliability, and operational support.
- Strong proficiency in Python, Java, Scala, C#, TypeScript or a comparable modern language.
- Deep working knowledge of structured outputs, RAG, tool use, evaluations, guardrails, monitoring, and human-in-the-loop design.
- Experience with cloud services and data-intensive systems; ability to collaborate across structured-data products and unstructured-data pipelines.
- Demonstrated self-directed exploration of emerging AI capabilities through independently built prototypes, tools, experiments, or applications.
- Experience translating AI experimentation into production solutions for enterprise or regulated environments, with attention to safety, reliability, security, governance, and measurable outcomes.
PREFERRED EXPERIENCE
- Healthcare experience involving PHI/PII, clinical or operational workflows, payer/provider operations, auditability, safety review, compliance controls, or value-based care.
- Experience with cloud AI and data platforms such as Azure, AWS, GCP, Databricks, Agent Bricks, Genie, Azure AI Foundry/Azure OpenAI, Azure ML, AKS/Kubernetes, OpenTelemetry, or AI observability and evaluation tooling.
- Model benchmarking, selection, adaptation, fine-tuning, reranking, or other domain-model optimization techniques.
- Experience leading technical initiatives across teams or mentoring several engineers.
As an Equal Opportunity Employer, we welcome and employ a diverse employee group committed to meeting the needs of NeueHealth, our consumers, and the communities we serve. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.
Similar Jobs
Artificial Intelligence • Cloud • Information Technology • Security • Social Impact • Software
Lead the evaluation, training, fine-tuning, deployment, and continuous improvement of AI and machine learning models. Build prompt engineering, model evaluation, benchmarking, and performance-tracking tools; optimize Elasticsearch-backed AI data systems; assess commercial and open-source LLMs; and collaborate with product, engineering, and security teams to deliver safe, scalable AI features.
Top Skills:
A/B TestingAmazon BedrockAmazon SagemakerAnthropicData PipelinesElasticsearchHugging FaceLarge Language ModelsMachine LearningMeta LlmsMistralOpenaiPrompt EngineeringPythonPyTorchScikit-LearnSupervised LearningTensorFlow
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Design, deploy, optimize, and scale production AI and agentic workloads on DigitalOcean’s cloud. Build inference benchmarks, automation tooling, deployment frameworks, operational playbooks, and reference architectures. Validate AI platform capabilities, optimize distributed inference and GPU performance, support customer migrations, and collaborate with product, research, infrastructure, GPU, model, and ecosystem partners. Enable technical teams and strategic customers while influencing platform roadmaps and accelerating production adoption.
Top Skills:
CrewaiCudaGoKubernetesLanggraphLlamaindexLlm-DMcpNcclNvidia DynamoNvlinkOpenai Agents SdkPythonRay ServeRcclRoceRocmSglangTensorrtTritonVllmXgmi
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Deploys, optimizes, and scales production AI and agentic workloads for strategic customers on DigitalOcean’s AI-Native Cloud. Builds inference, runtime, orchestration, benchmarking, automation, and deployment frameworks; tunes GPU and distributed-system performance; validates new platform capabilities; and develops reusable reference architectures and operational playbooks. The role also partners with customers, vendors, model providers, and internal engineering teams to accelerate production adoption and platform maturity.
Top Skills:
Benchmarking SystemsContinuous BatchingCrewaiCudaDistributed SystemsGoGpu PlatformsInference EnginesInfrastructure As CodeKubernetesKv-Cache OptimizationLanggraphLlamaindexLlm-DMcpNcclNvidia DynamoNvlinkOpenai Agents SdkOrchestration FrameworksPythonQuantizationRay ServeRcclRoceRocmRuntime SystemsSglangSpeculative DecodingTensorrtTritonVllmXgmi
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
