Chaos Labs Logo

Chaos Labs

Senior AI Data Scientist

Posted One Month Ago
Remote or Hybrid
Hiring Remotely in United States
179K-217K Annually
Senior level
Remote or Hybrid
Hiring Remotely in United States
179K-217K Annually
Senior level
Lead design and deployment of ML systems for enterprise search, retrieval, recommendations, and AI agents. Build scalable data/ML pipelines, evaluation frameworks, and KPIs. Apply statistics, causal inference, experimentation, and analysis to guide product strategy. Prototype and productionize LLM-based features, mentor junior staff, and collaborate cross-functionally.
The summary above was generated by AI
Description

Chaos Labs is building a new AI platform for the enterprise, focused on how organizations operate and create value in an AI-native world. We’re bringing years of experience building applied AI and mission-critical infrastructure to a new category of enterprise software. Previously, Chaos Labs built the leading risk management platform for on-chain finance, processing more than $5 trillion in financial volume and managing tens of billions of dollars in assets. We’ve raised $65 million from Haun Ventures, Lightspeed, Galaxy, General Catalyst, Bessemer, F-Prime, PayPal, and others. We’re currently operating in stealth and building with a small team around a technically ambitious problem we believe will become increasingly important as AI reshapes how companies work.

How We Work

Chaos is built around high-agency, high-talent individual contributors. We keep teams small, give people meaningful ownership, and expect them to operate with autonomy, strong judgment, and a high bar for their craft. We hire people who can take an ambiguous, important problem and drive it forward — not just execute against a predefined roadmap. Titles matter less than impact, and the people closest to a problem are trusted to make decisions and own outcomes.We move fast, stay close to the work, and care deeply about building things exceptionally well. Ownership over instruction. Impact over hierarchy.

The Role

We’re hiring a Senior Data Scientist, Applied AI to own the development and evaluation of machine learning systems that power our enterprise AI platform. This is a high-impact role with significant ownership from day one. You’ll work closely with the Chief Science Officer, and Engineering to build and deploy production ML and LLM-powered capabilities while using rigorous experimentation, evaluation, and product analytics to continuously improve their quality, user impact, and business outcomes., taking problems from ambiguity through execution and measurable impact.

What You'll Do

  • Design and build machine learning systems that power enterprise search, retrieval, recommendations, and AI agents.
  • Develop evaluation frameworks and metrics to measure the quality, performance, and business impact of LLM-powered applications.
  • Build scalable data and ML pipelines that process and analyze large-scale AI interaction data.
  • Apply statistical modeling, experimentation, and causal inference to guide product development and strategic decision-making.
  • Collaborate closely with Product, Engineering, and Design to translate research and insights into production features.
  • Analyze product usage and customer behavior to identify opportunities for improving AI adoption, productivity, and user experience.
  • Prototype, evaluate, and deploy new AI capabilities using foundation models, embeddings, and retrieval-augmented generation (RAG) techniques.
  • Define key performance indicators and build analytical frameworks that inform product strategy and company-wide decisions.
  • Contribute to the technical direction of our AI platform by identifying new opportunities to leverage machine learning and generative AI.
  • Identify opportunities, form strong points of view, and turn them into action.
Requirements
  • 5+ years of experience in Data Science, Applied Machine Learning, or a quantitative research role.
  • A degree in Computer Science, Statistics, Mathematics, Machine Learning, Economics, Physics, or another highly quantitative field.
  • A track record of developing and deploying machine learning models in production and turning ambiguous problems into measurable solutions.
  • Strong proficiency in Python and SQL, with experience building scalable data and ML pipelines.
  • Deep understanding of statistics, experimentation, causal inference, and predictive modeling.
  • Experience working with large-scale datasets and modern data infrastructure.
  • Familiarity with LLMs, embeddings, retrieval systems, RAG, or AI agents.
  • Strong analytical and technical judgment, with the ability to translate ambiguous product and business questions into rigorous analytical or machine learning approaches.
  • Excellent communication skills and the ability to work cross-functionally with Engineering, Product, Design, and Leadership.
  • Comfort operating in ambiguity and taking ownership without waiting for direction.
  • Exceptional standards for your own work and the ability to move quickly without sacrificing quality.

Preferred Qualifications

  • Experience building or evaluating LLM-powered products or AI applications.
  • Background in search, recommendation systems, information retrieval, or knowledge graphs.
  • Experience designing A/B tests, offline evaluations, and ML benchmarking frameworks.
  • Familiarity with vector databases, embedding models, and agent orchestration frameworks.
  • Contributions to open-source ML projects or publications in machine learning, NLP, or related fields.
  • Experience in B2B SaaS, developer tools, or enterprise AI products.
  • Based in NYC and able to work from our Brooklyn office, or remote within the U.S. with the ability to travel up to 30% of the year for in-person team collaboration.

Benefits

  • Paid Time Off – 21 vacation days + 7 sick days + 8 observed U.S. company holidays
  • Health Coverage – 100% employer-paid options (medical, dental & vision) for you and your dependents
  • FSA / HSA Options – depending on selected health insurance plan
  • Wellness Programs – OneMedical, Teladoc, Talkspace, and EAP
  • 401(k) - with a 100% company match on the first 6% contributed
  • Career Growth – opportunities in a rapidly expanding, global technology company with personalized professional development
  • Pre-tax Commuter Benefits
  • Compensation & Equity – competitive package aligned with growth and merit
  • Salary and Seniority level commensurate with experience (range: $ 179K - 217K)

Similar Jobs

5 Days Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
200K-350K Annually
Senior level
200K-350K Annually
Senior level
Fintech • Software • Financial Services
Own the reliability and quality of an AI copilot for a trading platform. Build evaluation frameworks, benchmarks, quality gates, monitoring, incident response, and model improvement workflows. Partner with engineering and product to create safe, auditable tool interactions and improve assistant behavior. Develop domain expertise in trading, risk, margin, execution, and portfolio reasoning while operating across model, backend, and frontend systems.
Top Skills: Evaluation PipelinesLlm ApisModel ServingObservability And Telemetry ToolingPostgresReactReact NativeRustTraining PipelinesTypescript
One Month Ago
Remote
USA
130K-150K Annually
Senior level
130K-150K Annually
Senior level
Information Technology • Consulting
Build production AI retrieval and knowledge systems for rare disease research at NIH. Model biomedical ontologies in PostgreSQL, develop semantic search, retrieval-augmented services, ranking, evaluation, and observability, and deliver user interfaces with Next.js, React, and TypeScript. Deploy and operate services in on-premises and HPC Kubernetes environments, including GPU inference. Collaborate with NIH staff, clinicians, and researchers, and contribute to scientific publications.
Top Skills: Ci/CdDockerFastapiFull-Text SearchGa4GhGitHelmHpoKubernetesLitellmLlm ApisMedcptMeshMondoNext.JsObo FoundryOllamaPgvectorPostgresPydanticPytestPythonReactStatefulsetsTypescriptUmlsVllm
One Month Ago
Remote
USA
130K-150K Annually
Senior level
130K-150K Annually
Senior level
Information Technology • Consulting
Build and operate agentic AI systems for rare disease research, including multi-turn workflows, structured and validated outputs, tool calling, prompt testing, evaluation suites, asynchronous execution, streaming, observability, and failure handling. Collaborate with NIH staff, clinicians, geneticists, researchers, and patient communities to translate needs into reliable data models and system behavior. Own components through deployment, establish AI engineering standards, and contribute to scientific manuscripts, abstracts, and conference posters.
Top Skills: Anthropic Agent SdkArize PhoenixAsynchronous PythonBraintrustCi/CdConcurrent PythonDockerFastapiGitHpoKubernetesLangfuseLanggraphLangsmithLitellmLlm ApisMcpMeshMondoObo FoundryOllamaOpenai Agent SdkPostgresPydanticPydantic AiPytestPythonStreamingStructured GenerationTool CallingUmlsVector SearchVllm

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account