Lead the design, build, and optimization of a modern data platform, managing large-scale data pipelines and collaborating with various teams.
Description
We are looking for a Senior Data Infrastructure Engineer to lead the design, build, and optimization of a modern data platform. The role involves hands-on work with cloud-based data technologies, building data lakes from scratch, and managing large-scale data pipelines while ensuring high performance, cost efficiency, and reliability. You will collaborate closely with data engineers, data science, analytics, and product teams to support business needs.
Key Responsibilities:
- Design and build scalable data lakes / platforms using technologies such as Snowflake, Databricks, BigQuery, or Redshift
- Develop and optimize large-scale data pipelines for batch and streaming use cases
- Ensure high performance, scalability, and cost efficiency across data systems
- Work with complex data workflows, AI models, transformations, and orchestration
- Apply best practices in data modeling, monitoring, security, and governance
- 3-5 years in data engineering or data infrastructure roles
- Proven experience building modern data platforms or data lakes from scratch
- Strong Python programming skills and experience with Spark / PySpark
- Knowledge of distributed systems and cloud-based architectures
- Experience with ETL/ELT processes and handling data at scale
Nice to Have:
- Experience with cloud providers (AWS, GCP, Azure)
- Familiarity with orchestration tools (Airflow, Dagster)
- Knowledge of data governance, security, and access control
- Experience supporting analytics, BI, or machine learning workloads
What We Offer:
- Ownership of end-to-end modern data platforms
- Opportunity to tackle high-impact, large-scale data challenges
- Collaborative, professional engineering environment
- Competitive compensation and benefits
Similar Jobs
Computer Vision • Healthtech • Information Technology • Logistics • Machine Learning • Software • Manufacturing
The Senior Data Infrastructure Engineer will design and build scalable data systems, manage data pipelines, and enhance infrastructure quality while driving team collaboration and efficiency.
Top Skills:
AirflowBigQueryDagsterDbtFivetranGCPLookerPostgresPulumiPythonSQLTerraform
_1.png)
Real Estate • Travel • PropTech
Architect and implement Airbnb's big data compute platform, manage its reliability and performance, produce maintainable code, and contribute to open-source efforts.
Top Skills:
AirflowAws EmrHadoopIcebergJavaKubernetesScalaSparkSQLTrino
Digital Media • Edtech
Develop and maintain core backend systems and data infrastructure; collaborate with teams on scalable solutions and ensure data quality and reliability.
Top Skills:
FlinkHadoopHbaseHdfsHivesqlJavaPythonScalaSpark SqlSQL
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
