Moonlite AI Logo

Moonlite AI

Senior Software Engineer, Platform Infrastructure

Posted 6 Hours Ago
In-Office or Remote
2 Locations
165K-225K Annually
Senior level
In-Office or Remote
2 Locations
165K-225K Annually
Senior level
This role involves designing and implementing infrastructure systems for AI workloads, focusing on orchestration, automation, APIs, and compliance in a cloud-native environment. Collaboration across teams is essential for project success.
The summary above was generated by AI

Moonlite delivers high-performance AI infrastructure for organizations running intensive computational research, large-scale model training, and demanding data processing workloads.We provide infrastructure deployed in our facilities or co-located in yours, delivering flexible on-demand or reserved compute that feels like an extension of your existing data center. Our team of AI infrastructure specialists combines bare-metal performance with cloud-native operational simplicity, enabling research teams and enterprises to deploy demanding AI workloads with enterprise-grade reliability and compliance.

Your Role:

You will be foundational to building the comprehensive infrastructure platform that bridges our physical infrastructure –  bare-metal servers, GPU clusters, high-performance storage, and networking fabric – with the systems our customers depend on for large-scale computation, inference, simulations, and training. Working closely with product, your platform team members, and infrastructure specialists, you’ll design and implement the orchestration layer, APIs, and automation framework that make thousands of servers, petabytes of storage, and high-speed networks feel like a unified, programmable platform.    

Job Responsibilities
  • Infrastructure Abstraction Layer: Design and build systems that bridge physical infrastructure (bare-metal servers, storage clusters, network fabric) with customer-facing services, enabling programmatic management of compute, networking, and storage at scale.
  • Research Cluster Provisioning: Design and implement systems for provisioning and managing research computing environments including Kubernetes and SLURM clusters, enabling automated deployment, resource scheduling, and workload orchestration for distributed AI training and HPC workloads.
  • Platform Orchestration: Implement comprehensive orchestration systems that coordinate across compute, storage and networking to deliver unified experience for complex research workloads.
  • Network Automation & Placement: Design and build network provisioning automation including intelligent VM placement decisions for optimal network topology, automated VLAN and subnet configuration, and software-designed networking orchestration for high-performance interconnects.
  • Enterprise APIs & SDKs: Develop robust APIs and SDKs that enable researchers and engineering teams to programmatically provision and manage infrastructure resources across all platform domains.
  • Observability & Telemetry: Implement comprehensive observability, telemetry, and logging systems that provide visibility into infrastructure health, performance, and utilization across the infrastructure footprint.
  • Performance Engineering: Build and optimize platform services that deliver consistent high-throughput low-latency networking for demand research applications and data-intensive workloads.
  • Cross-Team Collaboration: Work closely with engineering, infrastructure, and product to define requirements, drive infrastructure-product-rollouts, and improve resource lifecycle management.
  • Compliance & Security: Implement platform-wide compliance and security features supporting SOC 2, ISO 27001, and enterprise regulatory requirements including comprehensive audit logging, access controls, and data residency management.
Requirements
  • Experience: 5+ years in software engineering with a proven track record of infrastructure platforms, distributed systems, or cloud platforms for production environments. 
  • Kubernetes & Container Orchestration: Strong familiarity with Kubernetes architecture, container orchestration concepts, and experience deploying workloads in Kubernetes environments. Understanding of pods, deployments, services, and basic Kubernetes operations.
  • Infrastructure Systems: Strong understanding of infrastructure fundamentals including compute orchestration, storage systems, networking technologies, and how they integrate together to deliver complete platform experiences.
  • Programming Skills: Expert-level Python programming. Experience with systems programming languages (C/C++, Rust, Go) for performance-critical components is a strong plus.
  • Linux Production Experience: Strong experience with linux in production environments, including systems administration, performance tuning, and troubleshooting.
  • Bare-Metal & Virtualization: Deep knowledge of bare-metal infrastructure, provisioning systems, out-of-band management, and virtualization technologies (KVM, Kubernetes, etc).
  • API & Platform Design: Proven experience designing and building APIs, SDKs, and automation frameworks that enable programmatic infrastructure management.
  • Cloud Platform Knowledge: Strong familiarity with cloud environments (AWS, GCP, Azure) and understanding of how to translate cloud-native patterns to bare-metal infrastructure.
  • Infrastructure Automation: Experience with Infrastructure-as-code tools (Terraform, Ansible) and building automated deployment pipelines.
  • Problem Solving & Autonomy: Self-starter who can navigate ambiguity, balance pragmatic shipping with good long-term architecture, and independently drive complex technical initiatives.
  • Communication Skills: Strong written and verbal communication skills, including ability to write clear technical communication and collaborate across teams.
  • Commitment to Growth: Growth mindset with continuous focus on learning and professional development.
Preferred Qualifications
  • Background provisioning or managing research computing environments (Kubernetes, SLURM, or HPC clusters)
  • Experience building internal platforms, infrastructure-as-a-service, or developer tooling
  • Background with GPU computing platforms and AI/ML infrastructure requirements
  • Knowledge of high-performance networking technologies (InfiniBand, RDMA, SR-IOV)
  • Experience with observability and monitoring platforms (Prometheus, Grafana, ELK stack)
  • Familiarity with both cloud-native and bare-metal infrastructure deployment models
  • Understanding of enterprise compliance requirements and security best practices
  • Extra points for experience with financial services technology infrastructure and understanding of trading system requirements
Key Technologies
  • Python, Kubernetes, Docker, Terraform, Ansible, Linux, Networking (BGP, VXLAN), Storage Systems, FastAPI, PostgreSQL, Redis, NVIDIA GPU Technologies, InfiniBand
Why Moonlite
  • Build Next-Generation Infrastructure: Your work will create the platform foundation that enables financial institutions to harness AI capabilities previously impossible with traditional infrastructure.
  • Hands-On Ownership: As an early engineer, you’ll have end-to-end ownership of projects and the autonomy to influence our product and technology direction.
  • Shape Industry Standards: Contribute to defining how enterprise AI infrastructure should work for the most demanding regulated environments.
  • Collaborate with Experts: Work alongside seasoned engineers and industry professionals passionate about high-performance computing, innovation, and problem-solving.
  • Start-Up Agility with Industry Impact: Enjoy the dynamic, fast-paced environment of a startup while making an immediate impact in an evolving and critical technology space.

We offer a competitive total compensation package combining a competitive base salary, startup equity, and industry-leading benefits. The total compensation range for this role is $165,000 – $225,000, which includes both base salary and equity. Actual compensation will be determined based on experience, skills, and market alignment. We provide generous benefits, including a 6% 401(k) match, fully covered health insurance premiums, and other comprehensive offerings to support your well-being and success as we grow together.

#li-remote

Top Skills

Ansible
Docker
Fastapi
Infiniband
Kubernetes
Linux
Networking
Nvidia Gpu Technologies
Postgres
Python
Redis
Storage Systems
Terraform

Similar Jobs

24 Days Ago
Remote
USA
149K-200K Annually
Senior level
149K-200K Annually
Senior level
Software
As a Senior Platform Infrastructure Engineer, you'll lead EKS management, standardize deployments, mentor teams, and design secure, scalable infrastructure solutions.
Top Skills: AWSDatadogDockerEksGoGrafanaIamKubernetesPrometheusPulumiPythonTerraformVpc
12 Days Ago
Remote or Hybrid
3 Locations
Senior level
Senior level
Big Data • Information Technology • Software • Database • Analytics • Infrastructure as a Service (IaaS) • Big Data Analytics
Architect and develop scalable platform services focusing on security and operational efficiency. Lead technical reviews and mentor engineers while delivering end-to-end service lifecycle.
Top Skills: AWSAzureContainer OrchestrationGCPGoJavaKubernetesPythonRustService Mesh
15 Days Ago
Remote
USA
149K-200K Annually
Senior level
149K-200K Annually
Senior level
Software
Responsible for designing and maintaining tooling for local development and platform, managing EKS clusters, and enhancing CI/CD pipelines.
Top Skills: AWSCircleCICloudflareDockerEksGithub ActionsGitlab CiGoIacKubernetesPulumiPythonRubyTerraform

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account