Build and maintain Databricks lakehouse infrastructure and reliable ELT pipelines. Develop medallion data models, implement data quality, observability, security, governance, and CI/CD practices, optimize workflow performance and costs, and support AI/ML use cases. Collaborate with engineering, analytics, and business stakeholders in an Agile-Scrum environment while documenting designs and contributing to technical best practices.
Bridgeway is seeking a Data Engineer to build and maintain our data lakehouse infrastructure. This role involves working closely with analysts, engineers, and other stakeholders to contribute to our data architecture, ensuring secure and efficient data pipelines, and enabling advanced analytics. The ideal candidate will have a solid foundation in data engineering, data warehousing, and ELT processes, along with a passion for optimizing data systems.
This is a remote position with preference given to East Coast candidate.
Key Responsibilities:
- Develop and maintain components of a scalable lakehouse architecture, including a medallion (bronze/silver/gold) data model optimized for analytics and AI/ML consumption.
- Build, implement, and operate ELT pipelines, including workflow orchestration, scheduling, and monitoring, to ensure reliable and scalable execution.
- Apply established data quality, testing, and observability practices, and proactively monitor and resolve data and automation issues to ensure platform reliability and trust.
- Implement data security and compliance controls, including role-based access controls for security, encryption, masking, and governance best practices to ensure compliant handling of sensitive information.
- Contribute to optimizing the performance of data workflows and storage for cost efficiency and speed.
- Partner with engineers, analysts, and stakeholders to meet data needs; balance cost, performance, simplicity, and time-to-value and document solutions in line with team standards.
- Participate in code reviews and share knowledge with peers, contributing to team best practices and cross-functional collaboration.
- Support AI/ML use cases through well-structured data models, feature availability, and platform integrations using tools such as AI Search, Foundation Model APIs and Unity Gateway.
- Develop and maintain data pipelines using version control and CI/CD best practices in a collaborative engineering environment.
- Collaborate within an Agile-Scrum framework and contribute to technical design documentation to ensure efficient and successful delivery.
- Build working knowledge of organizational data domains, processes, and best practices.
Requirements:
- 3+ years of hands-on data engineering experience required.
- 2+ years of experience building and operating data pipelines in Databricks, including exposure to data modeling, governance, and CI/CD deployment patterns.
- 2+ years of experience with analytical SQL (ANSI SQL/T-SQL/Spark SQL) and Python for data engineering, including pipeline construction, transformation logic, and automation required.
- Strong communication skills with the ability to collaborate effectively across engineering, analytics, and business stakeholders required.
- Streaming and ingestion tools, such as Lakeflow Connect, AUTO CDC, Fivetran, or Azure Data Factory preferred.
- Terraform; Azure DevOps; GitHub Copilot or Claude Code knowledge is a plus.
- Experience using generative AI tools such as Claude and Copilot to improve productivity and deliver high-quality outcomes
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
Bridgeway is an Equal Opportunity Employer.
Similar Jobs
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Build and maintain sales compensation systems, data pipelines, integrations, data models, and commission calculation logic. Translate compensation plans into tested technical configurations, ensure reconciliation and historical traceability, and implement access controls, audit trails, monitoring, and release practices. Partner with Sales Compensation Operations, Finance, Payroll, and technical teams to deliver accurate, explainable commission results.
Top Skills:
APIsCaptivateiqCloud Data WarehousesLookerExcelPigmentSalesforceSpiffSQLXactly
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and maintain the technical foundation for sales compensation, including commission systems, integrations, data pipelines, calculation logic, data models, testing, access controls, audit trails, reconciliation, and release practices. Partner with Sales Compensation Operations, Finance, Payroll, and technical teams to implement approved compensation plans and ensure accurate, explainable, reproducible commission results.
Top Skills:
Access ControlsAPIsAudit TrailsAutomated TestingData ModelingData PipelinesExcelLookerPigmentSalesforceSQLVersion Control
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Build and maintain scalable production data pipelines and cloud data infrastructure. Ensure data quality, observability, lineage, governance, and cost-efficient performance. Develop data platform tooling, semantic and metrics layers, and enterprise data models supporting analytics, reporting, AI applications, and operational decisions. Collaborate with Analytics, Engineering, Product, operations, and business stakeholders while contributing to architecture, code reviews, testing, and technical standards.
Top Skills:
AirflowAWSAzureBigQueryClaudeDbtDelta LakeDockerGCPGithub CopilotJavaPythonRedshiftScalaSnowflakeSnowflake Cortex AiSQLTerraform
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute


