URUS Group Logo

URUS Group

Senior Data Engineer

Posted 10 Days Ago
In-Office or Remote
Hiring Remotely in United States
Senior level
In-Office or Remote
Hiring Remotely in United States
Senior level
Designs, develops, and maintains Databricks-based ETL pipelines, data lake architectures, datasets, and data quality processes supporting reporting, analytics, and AI/ML workloads. Maintains and migrates legacy SSIS and SQL Server systems, optimizes pipeline performance, and supports complex SSRS reporting. Collaborates with business users, analysts, and IT teams to define data requirements, troubleshoot issues, document solutions, and advance AI-assisted engineering practices.
The summary above was generated by AI

This role is responsible for the design, development, and maintenance of data integration and reporting solutions. Working primarily in Databricks, you will build and maintain the pipelines and datasets that feed our reporting, analytics, and AI/ML workloads. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles. A strong grasp of AI-assisted development tools as a regular part of the engineering workflow is expected.

 

Responsibilities

Data Integration

  • Design, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.

  • Troubleshoot and resolve Databricks pipeline errors and performance issues.

  • Troubleshoot and resolve SSIS package errors and performance issues.

  • Optimize data flow performance and minimize data latency.

  • Implement data quality checks and validations within ETL processes.

  • Maintain legacy SSIS packages for ETL processes.

 

Databricks Development

  • Develop and maintain Databricks pipelines and datasets using Python, Spark and SQL.

  • Drive the design and implementation of batch and streaming data lake architectures supporting both analytics and AI/ML workloads.

  • Optimize Databricks jobs for performance and cost-effectiveness.

  • Integrate Databricks with other data sources and systems.

  • Migrate legacy systems (e.g. SSIS packages, SQL Server procs) to Databricks pipelines.

 

Data Warehousing

  • Participate in the design and implementation of data warehousing.

  • Support data quality initiatives and implement data cleansing procedures.

 

Reporting and Analytics

  • Collaborate with business users to understand data requirements for department driven reporting needs.

  • Maintain existing library of complex SSRS reports, dashboards, and visualizations.

  • Troubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.

 

Collaboration and Communication

  • Comfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.

  • Collaborate effectively with business users, data analysts, and other IT teams.

  • Communicate technical information clearly and concisely, both verbally and in writing.

  • Document all development work and procedures thoroughly.

 

Continuous Growth

  • Keep abreast of the latest advancements in data integration, reporting, data engineering.

  • Actively contribute to company’s AI-assisted tooling, strategies, and best practices.

  • Continuously improve skills and knowledge through training and self-learning.

 

Requirements

  • Bachelor's Degree in Computer Science, Information Systems, or a related field.

  • 7+ years of experience in data integration and reporting.

  • Extensive experience with Databricks, including Python, Spark, and Delta Lake

  • Experience with data warehousing concepts and best practices.

  • Strong proficiency with AI-assisted development tools.

  • Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions.

  • Experience with SSIS (SQL Server Integration Services) development and maintenance.

  • Experience with SSRS (SQL Server Reporting Services) report design and development.

  • Experience with Microsoft Azure cloud platform and Microsoft Fabric desirable.

  • Strong analytical and problem-solving skills.

  • Excellent communication and interpersonal skills.

  • Ability to work independently and as part of a team.

  • Experience with Agile methodologies.

About Us

As a holding company with cooperative and private ownership, URUS is a family of businesses at the heart of the dairy and beef industry – Alta Genetics, GENEX, Genetics Australia, Leachman Cattle, Jetstream, PEAK, SCCL, Trans Ova Genetics and VAS.  Each organization has its unique identity, products, and services. These companies work globally to provide cutting-edge dairy and beef genetics, customized reproductive services to maximize conceptions, dairy management information to take producers to the frontline of progressive dairy farming, and an array of products and services to help bovines reach their full genetic potential. URUS has 9 brands in 17 retail countries and employs nearly 2,800 people globally.


Similar Jobs

Yesterday
Easy Apply
Remote
United States
Easy Apply
140K-175K Annually
Senior level
140K-175K Annually
Senior level
Fintech • Insurance • Machine Learning • Analytics • Financial Services • Automation
Build and maintain production data pipelines, Airflow DAGs, Snowflake infrastructure, and Data Vault 2.0 models. Ensure data quality, observability, security, governance, reliability, and cost efficiency through automated testing and CI/CD. Lead technical projects end-to-end, collaborate with stakeholders, and support SOX-relevant reporting while developing expertise in commercial insurance data and processes.
Top Skills: Apache AirflowBigQueryCi/CdClaude CodeCursorData Vault 2.0PythonRedshiftSnowflakeSnowflake CortexSQL
4 Days Ago
Remote or Hybrid
3 Locations
110K-205K Annually
Senior level
110K-205K Annually
Senior level
Fintech • Financial Services
Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.
Top Skills: Ai FoundryAlationApache AirflowApi ManagementAWSAzureAzure Ai SearchAzure Container AppsAzure Data FactoryAzure DatabricksAzure DevopsAzure FunctionsAzure OpenaiAzure PurviewAzure SqlAzure StorageBigQueryCi/CdCollibraCopilot StudioCosmos DbEltErwinETLEvent HubsGCPGitGit FlowGitGithub CopilotInformatica MdmInfosphereJavaMcpMicrosoft FabricPythonScalaSnowflakeSQLTrunk-Based Development
2 Days Ago
Remote or Hybrid
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Develop and automate tests for ETL pipelines, validating data records, content, metadata, and schema alignment. Integrate data tests into CI/CD workflows using GitHub Actions, and create release test suites to monitor performance and memory degradation. Analyze edge cases, investigate pipeline issues, and log defects while working with Databricks, Python, SQL, and ETL orchestration tools.
Top Skills: AirflowAzure Data FactoryCi/CdDatabricksETLGithub ActionsPythonSQL

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account