Reddit Logo

Reddit

Staff Software Engineer, AI Serving Infrastructure

Sorry, this job was removed at 08:15 p.m. (MST) on Wednesday, Jun 04, 2025
Remote or Hybrid
Hiring Remotely in United States
230K-322K Annually
Remote or Hybrid
Hiring Remotely in United States
230K-322K Annually

Similar Jobs

An Hour Ago
Remote
California, USA
159K-259K Annually
Senior level
159K-259K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Professional Services • Software • Sports • Analytics
Lead a software engineering team to design, develop, and deliver high-quality web and mobile applications, while promoting best practices and guiding technical strategies.
Top Skills: Api GatewayAWSC#FlutterJavaLambdaPythonReactSqs
3 Hours Ago
In-Office or Remote
Long Beach, CA, USA
119K-140K Annually
Senior level
119K-140K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Professional Services • Software • Sports • Analytics
The Lifecycle CRM Manager will enhance customer engagement by developing and implementing a marketing roadmap, utilizing Salesforce Marketing Cloud for automated campaigns, and collaborating across teams for strategy and execution.
Top Skills: Salesforce Marketing CloudTalon.One
3 Hours Ago
Remote or Hybrid
2 Locations
112K-140K Annually
Mid level
112K-140K Annually
Mid level
Fintech • Software • Financial Services
The Product Manager II will oversee the development of tax products, collaborating with teams, managing roadmaps, and ensuring timely delivery through Agile methodologies.
Top Skills: Agile MethodologiesAi ToolsApi StandardsConfluenceJIRA
Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 101M+ daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit redditinc.com.

Location:
This role is completely remote-friendly. If you happen to live close to one of our physical office locations, our doors are open for you to come into the office as often as you'd like. 

Team:
The AI Serving Infrastructure team develops and maintains Reddit's high-performance model serving infrastructure, generating millions of model predictions per second with low latency, with a focus on GPU optimization. We collaborate closely with machine learning engineers to support a diverse range of models and partner with training and feature teams to deliver a seamless train-to-serve experience for efficient and reliable model deployment

As a Staff ML Infrastructure Engineer, AI Serving, you will be responsible for designing, building, and maintaining the infrastructure and platform that powers our search capabilities. You will collaborate with Backend Architects and Product ML teams to shape the roadmap for ML infrastructure and platforms, while providing ongoing support to scale the platform and meet evolving needs for state-of-the-art models.
How You'll Have Impact
You will build systems and tools that enable machine learning engineers (MLEs) and data scientists (DSs) and continuously improve the ML software development lifecycle, enabling the continuous iteration and improvement of systems that use ML techniques, including Deep Learning, Natural Language Processing, Recommendation Systems, Representation Learning, and Computer Vision.

  • Lead the building, testing, and maintenance of ML infrastructure at Reddit
  • Propose, design, and implement high-performance ML Infra solutions that significantly advance the deployment of models that serve millions of redditors a seamless experience for MLEs
  • Design and implement solutions that significantly advance the ML Infrastructure
  • Collaborate closely with XFN partner teams/internal customers.
  • Work with management on team goal setting, planning, and de-risk project execution
  • Mentor other team members in adopting a rigorous DevOps approach to maintain and/or improve ML infra components and services health and quality

Who You Might Be:

  • 8+ years of work experience in a production software development environment
  • Experience working on large-scale ML Systems
  • Experience building production-quality code incorporating testing, evaluation, and monitoring using object-oriented programming, including experience in golang, Python and Scala.
  • Experience with Kubernetes
  • Knowledge of maintaining or developing applications using large-scale data stack, e.g, BigQuery, GraphQL, Kafka, Flink, Cassandra, Redis, Search Databases 
  • Comfortable with distributed systems, big data (Petabyte scale) and data-intensive systems
  • Strong organizational & communication skills

Benefits:

  • Comprehensive Healthcare Benefits
  • 401k Matching
  • Workspace benefits for your home office
  • Personal & Professional development funds
  • Family Planning Support
  • Flexible Vacation (please use them!) & Reddit Global Wellness Days
  • 4+ months paid Parental Leave
  • Paid Volunteer time off

#LI-DB1 #LI-Remote

Pay Transparency:

This job posting may span more than one career level.

In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.

To provide greater transparency to candidates, we share base pay ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.

The base pay range for this position is:
$230,000$322,000 USD

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve.  Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account