Design realistic, specialty-specific clinical case scenarios and gold-standard attending-level responses, evaluate and grade AI-generated outputs using structured rubrics, provide detailed written feedback to improve model clinical reasoning, and participate in onboarding, calibration, and review sessions in a fully remote, asynchronous contractor role (~20 hours/week).
This role is for one of our clients
Compensation: $130-$300 per hour
We are partnering with a leading AI research lab to develop high-quality healthcare reasoning data for training next-generation AI models. As a Clinical AI Specialist, you will contribute your medical expertise to design realistic clinical scenarios, evaluate AI-generated outputs, and help improve how advanced models reason about patient care in real-world settings.
Requirements
What You’ll Do
- Design clinically accurate and realistic case scenarios based on your specialty, including diagnostic reasoning, treatment planning, risk stratification, and guideline-based care
- Develop “gold standard” responses at an attending-physician level to guide AI model learning
- Evaluate and grade AI-generated outputs using structured rubrics and evidence-based medical standards
- Provide detailed written feedback to enhance model accuracy, safety, and clinical reasoning
- Participate in onboarding sessions, office hours, and specialty-specific calibration discussions
Who You Are
- Attending Physicians: Board-certified with a current, active, and unrestricted medical license
- Resident Physicians: Final year of residency (recent graduates must be board-eligible)
- Fellows: Board-certified/board-eligible in primary specialty with an active, unrestricted license
- Strong understanding of evidence-based medicine and clinical guidelines within your specialty
- Excellent analytical and written communication skills
Engagement Details
- Fully remote, asynchronous work environment
- Standard commitment of ~20 hours per week (with potential to increase based on performance and demand)
- Flexible schedule—work at your convenience
- Ongoing engagement with monthly performance reviews
- Start date: Rolling, following onboarding completion
Compensation
- Rates vary by specialty and experience level
- Final compensation details will be shared during the offer stage
- Payments are processed weekly via supported global payment platforms
Additional Information
- Engagement is on an independent contractor basis
- Work must not involve sharing confidential or proprietary information from any affiliated organization
- Projects may be extended, modified, or concluded based on business needs and individual performance
- At this time, visa sponsorship is not available for certain work authorization categories
Onboarding Process
Upon acceptance, you will receive onboarding materials along with an invitation to attend orientation and office hours sessions before beginning your first assignment.
Similar Jobs
Information Technology • Consulting
Own clinical quality for member-facing AI products by partnering with product, engineering, and clinical teams. Design clinical AI evaluations, define quality thresholds and rubrics, assess accuracy, omissions, hallucinations, medication-safety risks, and translate clinical reasoning into prompts and decision logic. Monitor evolving evidence and standards of care, validate product launches, and communicate findings to technical and clinical audiences.
Top Skills:
Clinical AiContext EngineeringLlmsMachine LearningPrompt Engineering
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Design and coordinate electrical systems for commercial, industrial, laboratory, and technical facilities from concept through construction. Lead Revit/BIM-based design, coordinate external engineering firms and vendors, review documentation, support budgeting and commissioning, and maintain design intent. Provide expertise in power distribution, lighting, low-voltage systems, equipment integration, safety compliance, facility troubleshooting, and energy-efficient building systems.
Top Skills:
AutocadBimBluebeamBuilding Automation Systems (Bas)Electrical EquipmentFire Alarm SystemsHvac ControlsLighting SystemsLow-Voltage SystemsMs ProjectNecNfpaOshaPower Distribution SystemsRevit
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design, build, test, launch, and operate full-stack services automating responses to legal, regulatory, and civil requests. Develop backend systems, internal web tools, and integrations across microservice and event-driven architectures. Collaborate with Counsel, Compliance, and Operations while handling sensitive customer data. Participate in on-call, incident response, code reviews, modernization efforts, and responsible use of AI-powered development tools.
Top Skills:
Ai AgentsAuroraAWSBuildkiteClaudeDatadogDynamoDBGooseGradleGrpcHTTPJavaJSONKafkaKotlinLlmsMcpMicroservicesMySQLProtocol BuffersReactRedisRuby On RailsSidekiqTypescript
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
