The Senior Data Engineer designs scalable data pipelines, collaborates with teams to address business needs, and ensures data infrastructure reliability.
Join a pioneering financial services company that is redefining homeownership through innovative, data-driven solutions. As a Senior Data Engineer, you will be instrumental in designing and building scalable data pipelines, transforming complex datasets, and ensuring the reliability of the data infrastructure. Working closely with data scientists and analysts, you will provide critical insights that shape strategic decisions. If you are passionate about data engineering and thrive in a fast-paced, collaborative environment, this role offers you the opportunity to contribute to cutting-edge projects and help shape the future of data architecture
Requirements
- 5+ years of Python development experience.
- Experience with AWS, including services like DynamoDB, S3, EMR, Glue, Athena, and Redshift.
- Knowledge of distributed computing engines, such as Apache Spark.
- Proficiency in both relational and non-relational databases, along with data modeling expertise.
- Experience setting up code pipelines using CloudFormation or Terraform.
- Familiarity with ETL pipeline development in OLAP and Data Warehouse environments.
- Hands-on experience with orchestration tools like Airflow.
- Understanding of serverless architectures and scalable application design principles.
- Proficiency with version control systems, particularly Git.
- Experience with Node.js, DevOps, and CI/CD practices is a plus.
- Background in cloud technologies (AWS or Azure) and fintech or banking is desirable.
Responsibilities
- Design and implement scalable data pipelines in a horizontally scaled environment.
- Collaborate with cross-functional teams to understand business needs and define transactional scenarios across multiple microservices.
- Write high-quality, maintainable code that meets established standards and best practices.
- Build strong relationships with clients by understanding their business model and delivering solutions that align with their goals.
- Influence and communicate effectively at all levels, including management and engineering teams.
- Utilize distributed computing systems to transform and manage large datasets efficiently.
- Work with cloud-based technologies such as AWS to support the company’s data infrastructure.
- Contribute to continuous integration/continuous delivery (CI/CD) pipelines and DevOps practices.
- Collaborate with data scientists to ensure the availability and accessibility of critical insights for decision-making.
Top Skills
Airflow
Spark
Athena
AWS
Ci/Cd
CloudFormation
DevOps
DynamoDB
Emr
ETL
Git
Glue
Node.js
Olap
Python
Redshift
S3
Terraform
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll design data models, build scalable data pipelines, and improve data quality, collaborating across teams.
Top Skills:
AirflowSparkAthenaAws Data ServicesEmrFlinkHiveJavaKafkaPythonRedshiftSparkSQL
Fintech
The Senior Data Engineer will lead the development of scalable data platforms, design ETL workflows, mentor junior engineers, and ensure data quality and governance.
Top Skills:
GCPNode.jsPythonSQLTerraformTypescript
Information Technology • Software • Consulting
The Sr. Data Engineer will transform on-premise Python applications to cloud-native implementations in a regulated financial environment, collaborating with stakeholders and building data pipelines.
Top Skills:
AWSEmrLambdaOraclePostgresPysparkPythonRdsRedshiftSQL
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute