Design, orchestrate, and optimize large-scale LLM pre-training across 1,000+ GPUs. Implement 3D parallelism, manage GPU clusters (SLURM/Kubernetes), optimize InfiniBand/RDMA networking and memory, and automate checkpointing and failure recovery for long training runs.
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.
Responsibilities:
- Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
- Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
- Automate checkpointing and failure recovery during month-long training runs.
Required Skills:
- Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
- Experience managing SLURM or Kubernetes-based GPU clusters.
- Strong systems engineering background (C++, CUDA, Python).
Similar Jobs
.png)
Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Halter is building a talent pool for people considering returning to New Zealand, Australia, or joining the USA team. Opportunities may span software, digital product, firmware, data, systems, machine learning, hardware, production, trades, supply chain, sales, field support, customer success, research, marketing, strategy, operations, and people teams. Applicants should submit a CV or LinkedIn profile, current and preferred location, anticipated relocation timing, and relevant visa or partner employment information.
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design and maintain ETL pipelines and Databricks Gold-layer tables; develop semantic layers, data dictionaries, and documentation for AI-driven BI; build dashboards and analyses to surface marketing and sales KPIs; perform ad-hoc deep dives; translate stakeholder requirements into scalable, analytics-ready data models; enable self-serve reporting and agentic AI workflows.
Top Skills:
DatabricksDbtPythonSQLTableau
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Director II, Inside Sales will coach a team of sales managers, manage hiring and onboarding, support professional development, and drive a high-performance culture focusing on customer success and team collaboration.
Top Skills:
SFDC
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
