Designs, develops, tests, deploys, and monitors scalable data pipelines using Azure Data Factory, Databricks, Python, SQL, and dbt. Integrates source systems with data warehouses and other platforms, automates data processes, improves infrastructure scalability, and supports data migrations during mergers and acquisitions. Ensures data security, privacy, retention, and effective enterprise data management.
As a Data Engineer at West Shore Home, you will design, develop, test, deploy, and monitor data pipelines between multiple sources, systems, and platforms. This position is responsible for creating solutions that directly support informed decision making and innovation by providing clean, protected, and effective data management practices.
Key Role Accountabilities:
- Design, develop, test, deploy and monitor data pipelines using Azure Data Factory and Databricks required for ELT/ETL from a wide variety of data sources.
- Design, develop, test, deploy and monitor scalable code with Python and SQL in Databricks, dbt, and other platforms.
- Integrate source systems with information management solutions and target systems for automated migration processes (e.g., Source-of-record systems with data warehouses or other systems).
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
- Lead data migration efforts for mergers and acquisitions. Assist Data Architect in leading the migration of data from legacy systems to newly developed solutions.
Minimum Requirements:
- Bachelor’s degree preferred.
- Minimum of 2+ years of experience with enterprise data management, integration, and transformation tools including Azure Data Factory, Databricks, dbt, Azure Storage, Fivetran, and Sigma.
- Must be authorized to work in the United States without requiring current or future employer-sponsored work authorization. The company does not and will not sponsor employment visas.
- Experience with integration and API tools.
- Follow and lead best practices on all data security, retention, and privacy policies.
- Proven subject matter expert for how systems handle data and develop ELT/ETL solutions based on best practices, their experience, and knowledge of the Company’s goals.
Please note: Applicants must be authorized to work in the United States at the time of their application on a full-time basis. The Company will not sponsor applicants for work visas.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates CrowdStrike’s data platform infrastructure and services. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and access controls, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires cloud, container orchestration, SQL, data modeling, compliance, and AI technology expertise, along with eligibility for CJIS clearance.
Top Skills:
AIApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
Information Technology • Internet of Things • Mobile • On-Demand • Software
Supports the Mobile Device Data and Operations team by collecting, cleansing, enriching, and distributing product data to catalogs and vendor partners. Develops workflow designs and toolsets using KNIME or Alteryx, Oracle and Snowflake databases, and AWS. Participates in an 11-week full-time internship with professional development, networking, mentorship, and cross-functional activities.
Top Skills:
AlteryxAWSExcelKnimeOraclePower AppsPythonRegexSharepointSnowflakeSQL
.png)
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Define and govern enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, and AI use cases. Establish standards for data quality, lineage, access, cataloging, governance, observability, and SLAs. Architect AI-enabled workflows, resolve complex architecture issues, influence roadmaps, and mentor engineers through hands-on technical leadership. The role requires 15+ years of software, data engineering, or architecture experience and expertise in large-scale data platforms and modeling.
Top Skills:
AIBatch ProcessingBigQueryData CatalogsData WarehousesDbtFeature StoresGCPLakehousesOlapOltpStreaming ArchitecturesVector Stores
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
