Design, orchestrate, and optimize large-scale LLM pre-training across 1,000+ GPUs. Implement 3D parallelism, manage GPU clusters (SLURM/Kubernetes), optimize InfiniBand/RDMA networking and memory, and automate checkpointing and failure recovery for long training runs.
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.
Responsibilities:
- Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
- Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
- Automate checkpointing and failure recovery during month-long training runs.
Required Skills:
- Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
- Experience managing SLURM or Kubernetes-based GPU clusters.
- Strong systems engineering background (C++, CUDA, Python).
Similar Jobs
46 Minutes Ago
Easy Apply
Easy Apply
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Lead Canada account management and customer success teams to drive retention, renewals, and enterprise expansion. Build scalable programs, coach and recruit talent, align executives, partner cross-functionally (Sales Ops, Product, Support), track pipeline and forecasting, serve as escalation sponsor, and optimize processes to maximize net revenue retention and customer value realization.
Top Skills:
Revenue Forecasting MetricsSales Analytics DashboardsSalesforce
Productivity • Software • App development • Automation
The Account Executive will manage software sales, qualify leads, close deals, and collaborate with technical teams to propose solutions.
Top Skills:
Outreach DoolySales NavigatorSalesforce CRMZoominfo
Cloud • Security • Software • Cybersecurity • Automation
Lead company-wide revenue forecasting, planning, and financial modeling for corporate FP&A. Drive automation and AI-enabled process improvements, produce analysis and commentary for finance leadership, support CFO and board deliverables, and partner with accounting and compensation teams to maintain operating and long-term financial models.
Top Skills:
Ai ToolsAutomationClaudeGemini
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
