The role involves refining and personalizing Luma's multimodal AI models, improving their controllability and adaptability for creative workflows, while collaborating with cross-functional teams.
About Luma AI
Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable, and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
About the Role
This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma’s foundation models and drive real-world value.
You’ll sit at the intersection of research, product, and partnerships, helping close the gap between state-of-the-art and production-ready. Your mission is to make our video foundation models more expressive, controllable, and personalized – solving the “last mile” challenges demanded by top-tier creative workflows.
What You'll Do
You will work as a fullstack applied researcher across modeling, data, systems, and evaluation to adapt and deploy models to production.
- Controllability and Features: You will leverage a toolkit spanning SFT, RL, personalization, distillation, control adapters, and more, to develop and maintain model variants purpose-built for user environments and creative partners.
- Personalization: Architect the data engine for rapid adaptation. You will leverage proprietary, vertical-specific datasets to create specialized finetunes and improve future training recipes, ensuring our models rely on data that reflects real-world use cases.
- End-User Quality: You will define and drive end-user quality – setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific enterprise verticals.
- Cross-functional Collaboration: Partner closely with Product, Research, and Design to translate creative intent and user feedback into model behavior, intuitive controls, and production-ready capabilities for users and partners.
Who You Are
- Product-Obsessed Researcher/Engineer: You treat end users and partners as collaborators and enjoy solving specific “last mile” problems—not just optimizing public metrics.
- ML Expert: Strong ML fundamentals with deep experience in visual generative models (diffusion/transformers or related architectures). Ideal candidates also have a deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
- Hands-On Builder: Strong Python and deep learning engineering skills (ideally PyTorch), comfortable moving between research prototypes and production systems.
- Contributions to state-of-the-art models in image/video generation.
- Experience collaborating with creative partners (VFX, animation, film, design tools).
- Track record building workflows/tools that materially improve iteration speed and evaluation rigor.
- Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).
Luma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Similar Jobs
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead the design for a critical product area, collaborating with teams to craft effective user experiences while leveraging AI tools for prototyping and testing. Influence product strategy and uphold design standards while mentoring junior designers.
Top Skills:
Ai-Assisted Prototyping ToolsCode-Generation ToolsFigma
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The role involves selling IoT solutions to mid-sized customers, managing deal negotiations, and building customer relationships to drive revenue.
Top Skills:
SFDC
Marketing Tech • Real Estate • Software • PropTech • SEO
As a Staff Frontend Engineer, lead the frontend platform architecture, migrate legacy systems to modern design, mentor engineers, and drive the use of AI in development.
Top Skills:
Apollo ClientBiomeGraphQLJestPlaywrightPnpmRadix UiReactReact Testing LibrarySingle-SpaStorybookSwcTailwind CssTurborepoTypescriptViteWebpack
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
