Great Sky Logo

Great Sky

AI Frameworks Engineer

Posted 4 Days Ago
Remote or Hybrid
Hiring Remotely in Boulder, CO, USA
160K-220K Annually
Entry level
Remote or Hybrid
Hiring Remotely in Boulder, CO, USA
160K-220K Annually
Entry level
Build and maintain core AI framework infrastructure, including Python APIs, graph execution, training workflows, validation systems, numerical parity tests, and reusable framework components. Develop JAX and PyTorch tooling, improve research-to-production workflows, and collaborate with researchers and hardware engineers. The role also involves API design, testing, documentation, developer ergonomics, and shaping software architecture connecting model design, simulation, training, validation, and hardware execution.
The summary above was generated by AI
About Us

Great Sky is a technology startup based with a mission to rebuild AI from first principles. We are pursuing neuroscience-inspired hardware and algorithms that overcome the greatest challenges in scaling AI systems.

The Role

We are looking for an AI Frameworks Engineer to help build the core software layer that connects our research ideas to working, testable, scalable AI systems. This is a software engineering role focused on the internal AI framework: the abstractions, APIs, graph execution paths, training strategies, validation systems, and test infrastructure that make our research stack usable and reliable.

 
Key Responsibilities
  • Design, implement, and maintain core AI framework abstractions for defining, training, validating, and executing novel graph-structured models.

  • Build clean Python APIs for training workflows, including loss objects, model runtime bundles, optimizer/training strategy interfaces, and more.

  • Develop and maintain JAX and PyTorch infrastructure for model execution, customizable training protocols, numerical parity tests, and reusable forward-pass utilities.

  • Help design validation systems that catch incompatible model/loss/solver/topology combinations early, with clear diagnostics for researchers and production users.

  • Organize research code into stable, well-tested framework components without slowing down exploration.

  • Create clean seams between research-mode workflows and production harness workflows, so the same infrastructure can support ad hoc experiments, custom training loops, and ticketed/cloud training runs.

  • Write high-quality tests for numerical behavior, protocol conformance, registry behavior, graph execution and training loops.

  • Collaborate closely with researchers and hardware/software engineers to translate evolving research requirements into robust software architecture.

  • Improve developer ergonomics: documentation, examples, error messages, package organization, type boundaries, and API consistency.

  • Over time, help shape the broader AI software architecture that connects model design, simulation, training, validation, and hardware execution.

Qualifications

Required:

  • Bachelor's or Master's degree in Computer Science or a related field, or equivalent professional experience.

  • Strong Python software engineering skills, with experience building libraries, frameworks, or infrastructure used by other engineers or researchers.

  • Hands-on experience with at least one modern ML framework, especially JAX or PyTorch.

  • Proficiency with training-loop internals: forward passes, losses, gradients, optimizers, metrics, parameter/state handling, and numerical testing.

  • Experience designing clean APIs and abstractions in complex codebases.

  • Ability to reason about graph-structured computation, model execution, dependency boundaries, and runtime state.

  • Strong testing instincts: unit tests, integration tests, regression tests, numerical parity tests, and clear failure modes.

  • Ability to work in a research-heavy environment where requirements evolve and the right abstraction often emerges through iteration.

  • Excellent written and verbal communication skills, especially when translating between research ideas and maintainable engineering designs.

Preferred:

  • Prior experience working in an AI technology environment.

  • Experience with typed Python, protocol-oriented design, dataclasses, Pydantic, package refactors, or public/internal SDK design.

  • Familiarity with multi node and multi gpu training for JAX or PyTorch

  • Experience with custom kernel writing in Triton/Cuda/Pallas

  • Experience designing plugin or registry systems for losses, optimizers, training strategies, model components, or execution backends.

  • Experience with compiler-adjacent or graph-adjacent systems: computational graphs, schedulers, IRs, topology validation, graph transformations, or hardware-aware execution.

  • Experience working near hardware teams, accelerator teams, simulation teams, or low-level performance work.

  • Familiarity with containers, cloud execution, job orchestration, experiment tracking, or production training harnesses.

Growth Opportunities

This role has a path toward broad technical ownership within Great Sky’s AI software stack.

As the team grows, you may help define framework architecture, set engineering standards, mentor other engineers, and lead major infrastructure projects spanning research workflows, simulation, training, validation, and hardware integration.

For the right person, this is a chance to build foundational infrastructure for a new kind of AI platform, rather than incrementally improving an existing transformer/GPU stack.

Benefits and Perks
  • Meaningful equity ownership in an early-stage deep tech company

  • Employer-matched 401(k)

  • Health, dental, vision, and life insurance

  • Flexible PTO

  • Support for ongoing learning, conference attendance, and skill development

Our culture is onsite by default (we're founded by scientists who are used to working in the lab), with flexibility for hybrid arrangements. For the right person and role, we're open to filling roles remotely

Similar Jobs

3 Days Ago
Remote
USA
83K-133K Annually
Mid level
83K-133K Annually
Mid level
Healthtech • Insurance
Develop and deploy AI-enabled applications, web interfaces, and workflow integrations using low-code platforms and modern programming frameworks. Build Python and SQL automation, integrate generative AI and NLP capabilities, collaborate with data and business teams, and support testing, troubleshooting, Agile delivery, deployment, and incident management. Ensure solutions meet usability, accessibility, compliance, and performance standards.
Top Skills: AngularCi/CdCopilot StudioDatabricks AppsDjangoFastapiFlaskGenerative AiJavaScriptMicrosoft Power AppsNatural Language ProcessingNode.jsPythonReactSQLStreamlitTypescriptUipath
2 Days Ago
In-Office or Remote
United States
143K-331K Annually
Senior level
143K-331K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Build and operate production-quality AI framework, runtime, benchmarking, performance, automation, observability, and developer-tooling systems. Optimize large language model training and inference across GPUs and Microsoft hardware, diagnose cross-stack reliability and performance issues, and improve model onboarding, hardware utilization, Azure efficiency, and deployment speed. Senior engineers own major components and projects; Principal engineers define technical direction, architecture, and multi-release strategy while leading cross-team initiatives and mentoring technical leaders.
Top Skills: Amd GpusAzureC++CudaNvidia GpusOnnx RuntimePythonPyTorchRocmTensorFlowTriton
4 Days Ago
Remote
United States
143K-304K Annually
Senior level
143K-304K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Leads architecture and hands-on development for AI frameworks, performance systems, benchmarking, and developer tools. Investigates issues across models, compilers, runtimes, services, and accelerator hardware; improves model onboarding, runtime performance, reliability, hardware utilization, and Azure efficiency. Establishes scalable measurement and observability capabilities, influences cross-team technical strategy, delivers production solutions, and mentors engineers while advancing engineering quality and maintainability.
Top Skills: Ai FrameworksAmd GpusC++CompilersDistributed InferenceAzureNvidia GpusPythonRuntimesSglangVllm

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account