UpDoc Logo

UpDoc

Senior Software Engineer, AI

Posted One Month Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead development of a patient-facing conversational AI agent for chronic disease management. Build scalable, low-latency voice and multimodal systems, engineer prompts, define evaluation metrics, develop fine-tuning data pipelines, deploy AI models and APIs, assess emerging LLM technologies, and collaborate with clinical experts to validate medical accuracy. Develop backend services using FastAPI and Pydantic while supporting secure, reliable medical AI infrastructure.
The summary above was generated by AI

About UpDoc

At UpDoc, we are building the first clinically validated, physician-supervised AI agent that manages chronic diseases. We are an early-stage startup founded by Stanford physicians.

We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.

Who You Are

You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.

What You'll Do

  • Lead the development of our patient-facing conversational agent

  • Implement a scalable, low-latency system for voice/multimodal conversations

  • Implement rigorous prompt engineering processes and develop useful metrics for system evaluation

  • Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation

  • Work with other backend engineers to deploy AI models and chat/voice APIs

  • Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks

  • Collaborate with clinical experts to validate performance and medical accuracy

  • Work on developing backend services using FastAPI and Pydantic

What You’ll Need

  • 5+ years of professional software development experience, including 2+ years of experience with backend web development

  • Experienced and comfortable working with type-hinted, modern Python

  • 2+ years of experience building end-to-end LLM applications, personally or professionally

    • Experience integrating/optimizing LLMs in production environments

    • Knowledge of evaluation frameworks

    • Knowledge and experience with MLOps/LLMOps best practices

    • Experience building AI infrastructure from 0 -> 1

  • Experience with cloud platforms (especially Azure) and containerization technologies

Highly Desired

  • Professional experience building end-to-end LLM-powered applications

  • Experience with model fine-tuning/alignment

  • Experience in an early stage startup environment

  • Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2

Similar Jobs

4 Days Ago
In-Office or Remote
100K-140K Annually
Senior level
100K-140K Annually
Senior level
Fintech
Build and deploy governed AI agents, automations, and multi-agent systems for business teams. Responsibilities include identifying AI opportunities, translating needs into requirements, prototyping, integrating enterprise systems, instrumenting telemetry, measuring ROI, monitoring risks and costs, and applying governance controls. The role also develops reusable patterns, documents solutions, enables business users, and communicates lessons learned to the AI Center of Excellence.
Top Skills: Ai AgentsAssistant And Agent FrameworksConversational AiDocument IntelligenceIso/Iec 42001Low-Code Workflow AutomationMcp ServersNatural Language AnalyticsNist Ai RmfRetrieval
4 Days Ago
In-Office or Remote
225K-235K Annually
Senior level
225K-235K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, build, and ship scalable backend features for Confluence Cloud AI automation and search. Develop RESTful microservices using object-oriented programming languages and work with relational and NoSQL databases in a distributed environment. Collaborate with engineering, architecture, product, and design teams; participate in Agile ceremonies; review code; and ensure reliability, security, performance, testing, documentation, monitoring, and error reporting.
Top Skills: Backend ServicesDistributed SystemsMonitoring And Error ReportingNosql DatabasesObject-Oriented Programming LanguagesRdbmsRestful Microservices
7 Days Ago
Easy Apply
Remote
United States
Easy Apply
173K-255K Annually
Senior level
173K-255K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate Affirm’s AI platform, including LLM and MCP gateways, agent runtimes, evaluation services, and governance controls. Design highly available backend systems, manage identity, quotas, routing, caching, reliability, observability, and security for AI workloads. Own projects from design through launch and on-call, establish engineering standards, collaborate across teams, mentor engineers, and help scale AI systems into production.
Top Skills: AWSAws BedrockChatgptClaudeKotlinKubernetesLitellmMcpMySQLPython

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account