AssemblyAI Logo

AssemblyAI

Senior Researcher, Deep Learning

Reposted 18 Days Ago
Be an Early Applicant
Remote
215K-275K
Mid level
Remote
215K-275K
Mid level
The Senior Researcher will develop and optimize deep learning models for Speech AI, oversee model training, and collaborate on engineering projects.
The summary above was generated by AI
About AssemblyAI

At AssemblyAI, we’re building at the forefront of Speech AI, creating powerful models for speech-to-text and speech understanding available through a straightforward API. With more than 200,000 developers building on our API and over 5,000 paying customers, AssemblyAI is helping unlock and support the next generation of powerful, meaningful products built with AI. 

Progress in AI is moving at an unprecedented pace– and our team is made up of experts in AI research that are focused on making sure that our customers are able to stay on the cutting edge, with production-ready AI models that are constantly updating and improving as our team continues to improve accuracy, latency, and what’s possible with Speech AI. Our models consistently rank highest in industry benchmarks for accuracy, outperforming models from Google and Amazon, and up to 30% fewer hallucinations than OpenAI’s Whisper. Our models power more than 2 billion end-user experiences each day, helping companies better understand customer feedback, run more productive meetings with automated meeting notes, and helping improve childhood literacy via ed tech tools. 

We’ve raised funding by leading investors including Accel, Insight Partners, Y Combinator’s AI Fund, Patrick and John Collision, Nat Friedman, and Daniel Gross. We’re a remote team looking to build one of the next great AI companies, and are looking for driven, talented people to help us get there!

About the role:

We are seeking a Senior Researcher to join our Research team. AssemblyAI's core strengths include developing best-in-class AI models in Speech and Natural Language Processing (NLP), writing optimized inference code, and serving models at scale with low latency and high availability. This role demands expertise in both applied research and engineering in Deep Learning. Key responsibilities include: Writing efficient, high-performance training code for large-scale models with billions of parameters on TPU clusters, optimizing code for both training and inference, rigorously evaluating models to ensure quality and performance, and collaborating closely with engineers to support data creation, data filtering, and model deployment. The ideal candidate will possess a fine-grained understanding of deep learning research and engineering, spanning both software and hardware. As a startup, we require the candidate to be flexible and willing to work across various stages of the Speech AI model lifecycle, from data processing to model training and analysis. The candidate should also proactively expand the scope of work with the goal of getting the models into production to delight customers. They will play a pivotal role in advancing major research initiatives designed for large-scale deployment to solve real-world use cases.

What You’ll Do:

  • Train large-scale Speech AI models, including ASR and speech-focused multi-modal LLMs with billions of parameters.
  • Write and optimize training code for maximum efficiency and memory utilization.
  • Stay up-to-date on the latest AI research and share insights across the company.
  • Collaborate with the technology leadership team to prioritize the research and engineering agenda, define project scopes, and lead their execution.

What You’ll Need:

  • 2+ years of professional experience in deep learning research & development focusing on speech recognition or natural language processing.
  • Demonstrated experience in all aspects of deep learning model development, including data acquisition and processing, implementation, model training, experimental analysis, and writing inference and evaluation code as an individual contributor. 
  • Hands-on experience with JAX/TPUs and distributed training. 
  • Excellent knowledge of GPU and TPU hardware. 
  • Strong Python programming skills. 
  • Strong written and verbal communication skills for technical matters. 

Nice to Have:

  • Experience in training/fine-tuning (multimodal) Large Language Models. 
  • Experience in LLM inference using frameworks like vLLM or JetStream. 

You may be a great fit if you are:

  • Highly self-motivated and keen to have real-world impact. 
  • Detail-oriented, analytical, and creative problem solver. 
  • Meticulous in all aspects (code, data, modeling, ...). 
  • Able to work effectively in a team-oriented, collaborative environment. 

Pay Transparency:

AssemblyAI strives to recruit and retain exceptional talent from diverse backgrounds while ensuring pay equity for our team. Our salary ranges are based on paying competitively for our size, stage and industry, and are one part of many compensation, benefits and other reward opportunities we provide.

There are many factors that go into salary determinations, including relevant experience, skill level and qualifications assessed during the interview process, and maintaining internal equity with peers on the team. The range shared below is a general expectation for the function as posted, but we are also open to considering candidates who may be more experienced than outlined in the job description. In this case, we will communicate any updates in the expected salary range.

Lastly, the provided range is the expected salary for candidates in the U.S. Outside of those regions, there may be a change in the range, which again, will be communicated to candidates.

Salary range: $215K - $275K

Working at AssemblyAI

We are a small but mighty group of startup veterans and experienced AI researchers with over 20 years of expertise in Machine Learning, Speech Recognition, and NLP. As a fully remote team, we’re looking for people to join our team who are ambitious, curious, and lead with integrity. We’re still in the early days of AI and of AssemblyAI’s journey, and are looking for teammates who won’t just fit in, but will help us define and build our company culture. 

We’re committed to creating a space where our employees can bring their full selves to work and have equal opportunity to succeed. No matter your race, gender identity or expression, sexual orientation, religion, origin, ability, age, veteran status, if joining this mission speaks to you, we encourage you to apply!

Keep Exploring AssemblyAI:

Check us out on YouTube!

Learn more about AI models for speech recognition

Core Transcription | Audio Intelligence | LeMUR | Try the Playground

Our $50M Series C fundraise

Top Skills

Deep Learning
Gpu
Jax
Nlp
Python
Tpu

Similar Jobs

6 Hours Ago
Remote
Hybrid
United States
45-50
Mid level
45-50
Mid level
Healthtech • Insurance
The QA Automation Engineer will analyze project requirements, execute various testing types, manage defects, and improve test processes.
Top Skills: Azure DevopsJenkinsPerl
6 Hours Ago
Remote
Hybrid
San Diego, CA, USA
147K-258K Annually
Senior level
147K-258K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Manage product development, ensure team productivity, solve problems, and integrate AI into workflows while mentoring engineering staff.
Top Skills: AIC++JavaJavaScriptRubyShell
7 Hours Ago
Remote
Hybrid
West Palm Beach, FL, USA
Mid level
Mid level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
This role involves consulting and configuring ServiceNow Finance & Supply Chain solutions. Responsibilities include customer workshops, process improvements, technical documentation, and solution delivery, requiring strong technical expertise and experience with various finance and supply chain systems.
Top Skills: BootstrapCoupaCSSHTMLIvaluaJavaScriptJSONLdapMiddlewareOracle Procurement CloudRestSap AribaSap EccSap S/4HanaServicenowSsoWeb ServicesXML

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account