Design and deliver Databricks lakehouse solutions: build ETL/ELT pipelines with PySpark and SQL, implement governance and Unity Catalog, integrate data platforms with applications via APIs/events, apply cloud architecture best practices, automate CI/CD for Databricks workloads, and consult with clients on requirements and solution design.
Title: Data Engineer
Location: USA
Exp: 5+
7 + years of IT experience
Databricks (data engineering, SQL, notebooks, app/backend integration patterns)Enterprise data warehouses and lakehouse platforms (Nice to have Fabric, Snowflake, Synapse, BigQuery – experience)
Deep knowledge of data modeling, data warehousing, and lakehouse patterns
Hands‑on experience with at least one modern data platform:
Experience integrating data platforms with applications using APIs, services, or event‑driven patterns
Solid understanding of cloud architecture concepts (security, networking, scalability, cost management)
Strong communication skills with the ability to engage both technical and business stakeholders
Experience working in client‑facing or consulting environments
- Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, or related field
- 4+ years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting. Or, equivalent experience
- Deep hands on experience with Databricks Lakehouse Platform and Apache Spark
Strong proficiency in PySpark, SQL, Delta Lake, Databricks SQL - Experience implementing Unity Catalog, data governance, and enterprise security controls
- Cloud experience with Azure Databricks, AWS Databricks, or GCP Databricks
- Familiarity with CI/CD, DevOps, and automation for Databricks workloads
- 8–12+ years in data engineering or architecture, with 4–5+ years delivering Databricks solutions
- Proven experience in client facing consulting roles, including requirements discovery, solution design, and executive communication
Datavail’s Data Management Services:
Datavail’s Data Management and Analytics practice is made up of experts who provide a variety of data services including initial consulting and development, designing and building complete data systems, as well as ongoing support and management of database, data warehouse, data lake, data integration, and virtualization and reporting environments. Datavail’s team is comprised of not just excellent BI & analytics consultants, but great people as well. Datavail’s data intelligence consultants are experienced, knowledgeable and certified in the best in breed BI and analytics software applications and technologies. We ascertain your business objectives, goals and requirements, assess your environment, and recommend the tools which best fit your unique situation. Our proven methodology can help your project succeed, regardless of stage. With the combination of a proven delivery model and top-notch experience ensures that Datavail will remain the Data Management experts on demand you desire. Datavail’s flexible and client focused services always add value to your organization.
Datavail Broomfield, Colorado, USA Office
11800 Ridge Parkway, Suite 125, Broomfield, CO, United States, 80021
Similar Jobs
.png)
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.
Top Skills:
Ansi SqlBigQueryBigquery SqlConfluenceGCPJIRAPythonSQL
Aerospace • Cloud • Digital Media • Information Technology • Mobile • News + Entertainment • Generative AI
Build scalable Databricks/Spark data pipelines, implement automated GitLab CI/CD workflows, apply SOLID engineering and testing to ensure pipeline reliability, integrate AI/ML and NLP tools, mentor peers, and operationalize models in AWS production environments.
Top Skills:
AWSCi/CdDatabricksDelta LakeDockerGitlabKubernetesMachine Learning LibrariesNlp FrameworksPythonSparkSQL
Information Technology • Internet of Things • Mobile • On-Demand • Software
Lead architecture, engineering, and lifecycle management of enterprise Hadoop clusters and supporting data platform services. Ensure scalability, reliability, security, and operational excellence; optimize infrastructure, drive provisioning and patching standards, troubleshoot distributed system issues, guide cloud/hybrid migration strategies, mentor engineers, and produce operational runbooks, data views, and automated processing.
Top Skills:
DjangoDockerFastapiFlaskHadoopHbaseHdfsHiveImpalaKafkaKubernetesMySQLOoziePostgresPythonShell ScriptingSparkSplunkTcp/IpTypescriptVisioYarnZookeeper
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
