Design, build, and optimize scalable cloud data pipelines and infrastructure. Maintain and refactor SQL and ETL processes, automate data workflows, ensure data quality/security, and troubleshoot complex issues. Provide technical leadership and mentor junior engineers while collaborating with stakeholders to translate requirements.
Summary:
The Senior Data Engineer designs, builds, and optimizes scalable data pipelines and cloud-based data infrastructure. This role is critical to managing and organizing structured and unstructured data across the organization to enable outcomes analysis, insights, compliance, reporting, business intelligence, and data science. The Senior Engineer ensures data quality, security, and performance across platforms while providing technical leadership and mentorship to junior engineers.
Essential Duties & Responsibilities:
- Design and build efficient, scalable data pipelines using cloud services
- Maintain and refactor complex SQL and ETL processes in enterprise data platforms
- Develop automation scripts, APIs, and infrastructure components
- Collaborate with architects, analysts, and stakeholders to translate requirements
- Ensure strong data quality, integrity, and security controls across platforms
- Troubleshoot complex data issues and lead root cause analysis
Skills & Competencies:
- Advanced SQL and strong data modeling expertise
- Proficiency in Python or JVM languages for data engineering and automation
- Deep knowledge of cloud-based data patterns, distributed systems, and modern data architectures
- Strong analytical reasoning and problem-solving abilities
- Ability to lead delivery efforts and mentor junior team members
- Clear communication skills with the ability to explain technical concepts to non-technical audiences
- Ability to work independently and collaborate effectively in cross-functional environments
Minimum Qualifications:
- Bachelor’s degree in Information Systems, Computer Science, Data Management, or related field preferred
- 5–8 years of experience in data engineering or a similar role
- Strong SQL skills and deep knowledge of relational databases and data warehousing
- Proficiency in Python or JVM languages (e.g., Java, Scala, Kotlin) for data manipulation and automation
- Hands-on experience with cloud data platforms (e.g., AWS, Azure, or GCP)
- Solid understanding of ETL/ELT processes, data modeling, and data architecture
- Track record of owning and leading technical projects
- Experience with Agile methodologies and version control
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and maintain scalable ETL/ELT data pipelines and architectures across warehouses, lakes, and streaming environments. Ensure data governance, quality, and security. Lead delivery of analytics data products, optimize production systems, collaborate with stakeholders, and mentor junior data engineers.
Top Skills:
Amazon RedshiftApache AirflowSparkAzureCi/CdDatabricksEtl/EltGitJavaKafkaLinuxPythonScalaSnowflakeSQL
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills:
Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs
AdTech • Marketing Tech • Mobile • Social Media
Design, build, and optimize ETL pipelines and data platform architecture using Airflow, BigQuery, Python, and Spark. Lead technical decisions, mentor engineers, collaborate with product and stakeholders, and improve data-quality and testing frameworks to support data-driven products.
Top Skills:
Apache AirflowBigQueryCi/CdDockerGitHadoopJavaKubernetesLuigiPythonSparkSQL
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
