OpenRouter Logo

OpenRouter

Engineering Manager, Provider Ecosystem

Posted One Month Ago
Remote
Hiring Remotely in US
275K-325K Annually
Mid level
Remote
Hiring Remotely in US
275K-325K Annually
Mid level
Lead and grow the Provider Ecosystem engineering team while remaining hands-on in code reviews, incidents, and development. Own provider adapters, endpoint lifecycle, routing, integrations, multimodal expansion, benchmarks, and inference quality. Partner directly with model labs and inference providers to launch offerings rapidly, use telemetry and evaluations to guide traffic decisions, and collaborate with GTM, business development, and legal on partner onboarding.
The summary above was generated by AI
About OpenRouter

OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers—without lock-in, capacity constraints, or unnecessary cost. We power the most advanced AI teams in the world by giving them the flexibility to move fast, scale confidently, and stay future-proof as models evolve.

As enterprise adoption of AI accelerates, OpenRouter sits at the center of how organizations operationalize LLMs across research, product, and production workloads.

About the Role

The Provider Ecosystem team owns the supply side of OpenRouter: every model, endpoint, and provider the router can send a request to. That means hundreds of providers, thousands of endpoints, and millions of requests a day, in a model landscape that changes every week.

You’ll be at the front of the industry. Labs and inference providers want to reach OpenRouter’s users, so this team gets early access to novel inference offerings, often through exclusive and stealth launches, and gets them live on day zero.

This is a hands-on leadership role reporting to the VPE. You’ll grow the team, stay deep in the code, and be OpenRouter’s technical face to the labs and providers we partner with.

What You'll Do
  • Lead the team: hire and grow strong engineers, set the roadmap, stay hands-on in code reviews and incidents, and advocate for the team with leadership.

  • Core Provider: own provider adapters, the endpoint lifecycle, and routing. Be the technical counterpart for top providers, run day-zero and stealth launches, and work with GTM, BD, and legal to get providers from signed NDA to live in weeks, not months.

  • Multi-Modal: lead the expansion beyond text into image, video, audio, and embeddings, plus realtime and batch inference.

  • Benchmarks: own evals and inference quality, and turn that data into routing decisions and direct feedback that makes providers better.

     
What We're Looking For
  • 4+ years of engineering management experience, including at least one environment where you built or scaled a team during a period of rapid growth.

  • Strong technical foundation in distributed systems, API design, and LLM inference. You understand how inference is served (streaming, tool calling, prompt caching, quantization, throughput and latency trade-offs), how provider APIs differ from each other, and what it takes to route millions of requests across hundreds of heterogeneous endpoints.

  • Hands-on and comfortable staying that way. You write code, use AI-assisted development tools, and lead by example in a team where everyone ships.

  • Comfortable being externally facing. You can sit across from a model lab’s engineering team, negotiate an integration, and represent OpenRouter’s technical requirements without a PM in the room.

  • Data-driven about quality. You want benchmarks, evals, and production telemetry deciding which provider gets traffic, not vibes.

  • Proven ability to recruit and retain strong engineers. Ideally, you’ve built teams people want to join and you bring a network of talent with you.

  • High agency and clear communication. You don’t wait for direction, you identify what matters, make a plan, and drive it forward. You speak up when you disagree and back it with substance.

  • Pragmatic about what a lean engineering org actually needs versus what a 500-person org would do. You optimize for speed and clarity, not process.

     
Nice to Haves
  • Experience at an inference provider, model lab, or GPU cloud, or building products on top of many LLM APIs at once.

  • Experience with our stack: TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, or Vercel.

  • Background in evals, benchmarking, or routing and load-balancing systems.

  • Experience shipping multimodal APIs (image, video, speech, embeddings) or realtime and batch inference.

  • Experience running vendor security and compliance reviews (NDA, DPA, SOC 2) as part of a partner onboarding process.

  • Existing user of OpenRouter, or active side projects in AI infrastructure or developer tooling.

  • The ideal candidate is based in New York City, but we're open to strong remote candidates elsewhere in the US.

     

If you don't think you meet all of the criteria below but still are interested in the job, please apply. Nobody checks every box, and we're looking for someone who is excited to join the team.

Similar Jobs

35 Minutes Ago
Remote or Hybrid
United States
115K-145K Annually
Senior level
115K-145K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Build and operate production agentic AI workflows for global Marketing across campaigns, content, events, and lead management. Integrate Salesforce, Marketo, Asana, and other systems through APIs and MCP; establish AI development standards, testing, monitoring, governance, and guardrails. Prioritize use cases, review workflow launches, and measure adoption, time savings, cycle-time reduction, quality, and cost. This hands-on role requires close collaboration with Marketing, IT, Security, Legal, Privacy, and workflow owners.
Top Skills: APIsAsanaClaudeLarge Language Models (Llms)MarketoModel Context Protocol (Mcp)N8NPower AutomatePower BIPythonRetrieval-Augmented Generation (Rag)SalesforceSnowflakeSQLTypescriptWorkato
36 Minutes Ago
Remote or Hybrid
150K-175K Annually
Senior level
150K-175K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Supports sales through technical demonstrations, proof-of-concept creation, cloud architecture discussions, solution evaluations, RFPs, and customer presentations. Builds relationships with customers, partners, executives, and internal teams while promoting Dynatrace observability solutions. Provides technical guidance throughout the sales cycle, supports events and partner channels, troubleshoots issues, and communicates customer feedback to Product Management.
Top Skills: .NetAdvanced ObservabilityAnsibleApplication Performance ManagementAWSAzureCi/CdContainersCSSDevOpsDynatraceGCPGoHTMLJavaJavaScriptKubernetesLinuxNode.jsOpenshiftPHPPuppetServerless FunctionsSite Reliability EngineeringTerraformWindows
40 Minutes Ago
Easy Apply
Remote
Florida, USA
Easy Apply
100K-150K Annually
Entry level
100K-150K Annually
Entry level
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
Sell Scotch’s POS and operating system—including hardware, software, payments, and e-commerce—to liquor store owners in Florida. Manage inbound and outbound sales activity, educate small business owners on the platform’s value, meet sales targets, and collaborate with onboarding and support teams to ensure successful merchant transitions.
Top Skills: E-CommerceInventory ManagementPayment ProcessingPosReportingSales Enablement Tools

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account