Cohere AI Logo

Cohere AI

Software Engineer, Data Infrastructure

Reposted One Month Ago
In-Office or Remote
Hiring Remotely in United States
160K-325K Annually
Mid level
In-Office or Remote
Hiring Remotely in United States
160K-325K Annually
Mid level
As a Software Engineer in Data Infrastructure, you will build and maintain high-performance data storage systems for AI training, collaborate with experts, and optimize data processing.
The summary above was generated by AI

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Why this role?

We're building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want sharp, curious people to help us do it. In this role, you'll build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs.
As a Software Engineer, Data Infrastructure, you will:

  • Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it.

  • Collaborate daily with researchers and engineers who are some of the best in the world at what they do.

You may be a good fit if you have:

  • 4+ years of experience working on data storage infrastructure

  • Strong command of Python

  • Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)

  • The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX

  • Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink

  • [Nice-to-have] Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt

  • Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds

  • Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists

Full-Time Employees at Cohere enjoy these Perks:
  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits:

    Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

    Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:
  • Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.


We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.

Similar Jobs

2 Hours Ago
In-Office or Remote
United States
285K-340K Annually
Entry level
285K-340K Annually
Entry level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Generative AI
Design, build, and operate a distributed storage and data movement platform supporting petabyte-scale model training and evaluation. Run stateful systems across Kubernetes clusters, define throughput, latency, and durability requirements with research and infrastructure teams, and solve networking, I/O, consistency, and cross-region data transfer challenges. The role involves supporting cloud object storage, POSIX filesystems, model checkpoints, and large-scale GPU workloads.
Top Skills: Amazon S3Csi DriversGoKubernetesLustrePersistent VolumesPosix FilesystemsPythonStatefulsetsVastWeka
17 Days Ago
Remote or Hybrid
United States
110K-300K Annually
Mid level
110K-300K Annually
Mid level
Financial Services
Build and maintain scalable financial data infrastructure, including ingestion, validation, normalization, and integrations. Develop systems that calculate portfolio performance metrics efficiently across high-volume datasets, improve reliability and observability, and support distributed processing. Create internal tools, dashboards, reusable schemas, asset data feeds, and self-service analytics capabilities. Collaborate cross-functionally to expand market-data coverage, support B2B integrations, and strengthen operational resilience.
Top Skills: Business Intelligence DashboardsData InfrastructureData Ingestion PipelinesData ValidationDistributed Systems
3 Months Ago
Remote
United States
175K-230K Annually
Senior level
175K-230K Annually
Senior level
Healthtech
As a Staff Software Engineer, you'll architect and build foundational platform services, focusing on data infrastructure, healthcare interoperability, and secure APIs while mentoring other engineers.
Top Skills: AWSAzureDatabricksGCPHl7 Fhir ApisJavaKubernetesOauth2OidcPythonSparkTerraform

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account