The Data Reliability Engineer will enhance the resilience and scalability of data infrastructure, focusing on automation and reliability. Responsibilities include managing data pipelines, operating Kubernetes clusters, and defining observability standards.
Where You Come In
As our models scale to "omni" capabilities, our data infrastructure must be unbreakable. We are looking for a Data Reliability Engineer who brings a Site Reliability Engineering (SRE) mindset to the world of massive-scale data. You will be responsible for the resilience, automation, and scalability of the petabyte-scale pipelines that feed our research. This is not just about keeping the lights on; it’s about treating infrastructure as code and building self-healing data systems that allow our researchers to train on massive datasets without interruption. Whether you are a junior engineer with a passion for automation or a seasoned SRE veteran, you will play a critical role in hardening the backbone of Luma’s intelligence.
What You'll Do
- Automate Everything: Apply Infrastructure-as-Code (IaC) principles using Terraform to provision, manage, and scale our data infrastructure.
- Harden Data Pipelines: Build reliability and fault tolerance into our core data ingestion and processing workflows, ensuring high availability for research jobs.
- Scale Kubernetes & Ray: Operate and optimize large-scale Kubernetes clusters and Ray deployments to handle bursty, high-throughput workloads.
- Define Reliability: Establish Service Level Objectives (SLOs) and observability standards (Prometheus/Grafana) for our data platforms.
- Debug & Heal: serve as the first line of defense for complex infrastructure failures, diagnosing root causes in distributed storage and compute systems.
Who You Are
- Deep SRE/DevOps proficiency: You live and breathe Linux, networking, and automation.
- Infrastructure-as-Code Native: You have extensive experience with Terraform, Ansible, or similar tools to manage complex cloud environments (AWS/GCP).
- Kubernetes Expert: You have managed Kubernetes in production and understand its internals, not just how to deploy containers.
- Python Proficiency: You can write high-quality Python code for automation, tooling, and infrastructure management.
- Data-Minded: You understand the specific challenges of stateful data systems and high-throughput storage (S3/Object Store).
What Sets You Apart (Bonus Points)
- Experience managing GPU clusters or AI/ML workloads.
- Background in both Software Engineering and Operations (DevOps).
- Experience with high-performance networking (InfiniBand/RDMA).
The base pay range for this role is $170,000 – $360,000 per year.
About LumaLuma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Top Skills
Grafana
Kubernetes
Prometheus
Python
Ray
Terraform
Similar Jobs
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Seeking a Staff Software Engineer to lead Cash services, architect distributed systems, and manage technical strategies for Coinbase's Consumer Cash team.
Top Skills:
ClickhouseGoKafkaMongoDBRedis
Artificial Intelligence • Hardware • Healthtech • Software
Lead development of a two-way audio communication platform, optimizing performance and collaboration across embedded systems, while ensuring quality and compliance.
Top Skills:
AlsaArm-Based ArchitectureCoverityEmbedded LinuxGstreamerJtagNat TraversalValgrindVoipWebrtc
Cloud • Information Technology • Security • Software • Cybersecurity
As a Sales Development Representative, you'll drive sales growth by qualifying leads, scheduling appointments, and maintaining CRM records within a hybrid work environment.
Top Skills:
CRMSalesforce
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
