This role involves developing scalable data integration pipelines, collaborating with teams on solutions, and ensuring data quality using various modern technologies.
This is a remote position.
About our client:
Our client develops and supports software and data solutions across a variety of industries. They want you to get ahead of the market and stay there. They offer a combination of plug and play products that can be integrated with existing systems and processes and can also be customised to client needs. Their capabilities extend to big data engineering and bespoke software development, solutions are available as both cloud-based and hosted.
What you will be doing:
- Analyzes complex customer data to determine integration needs.
- Develops and tests scalable data integration/transformation pipelines using PySpark, SparkSQL, and Python.
- Contributes to the codebase through coding, reviews, validation, and complex transformation logic.
- Automates and maintains data validation and quality checks.
- Collaborates with FPA, data engineers, and developers to align solutions with financial reporting and business objectives.
- Participates in solution architecture and technical discussions, refining user stories and acceptance criteria.
- Utilizes modern data formats/platforms (Parquet, Delta Lake, S3/Blob Storage, Databricks).
- Partners with the product team to ensure accurate customer data reflection and provide feedback based on data insights.
What our client is looking for:
- A Data Analytics Engineer with 5+ years of experience.
- Must have strong Python, PySpark, Notebook, and SQL coding skills, especially with Databricks and Delta Lake.
- Proven ability to build and deploy scalable ETL pipelines to cloud production environments using CI/CD.
- Experience with Agile/Scrum, data quality concepts, and excellent communication is essential.
- Cloud environment (Azure, AWS) and Infrastructure as Code (Terraform, Pulumi) experience beneficial.
- Telecoms industry or consulting experience, plus accounting knowledge, is a plus.
Job ID:
- J106998
For a more comprehensive list of opportunities that we have on offer, do visit our website - https://www.parvana.co.uk/careers
Requirements
Data Engineer, PySpark, Python, SQL, Databricks, ETL, CI/CD, Cloud, Azure, AWS
Similar Jobs
Fintech • Payments • Software
The Data Engineer will design, develop, and maintain data pipelines, implementing ETL processes and managing data infrastructure, ensuring high-quality data delivery and system reliability.
Top Skills:
Apache AirflowBigQueryDebeziumHelmKafkaKubernetesMongoDBMySQLPostgresPythonRedshiftSinglestoreTerraform
Automotive • eCommerce • Fintech • Transportation
The Data Engineer will develop and maintain data pipelines, perform data extraction and transformation, and support data analytics across the enterprise.
Top Skills:
AirbyteApache AirflowGoogle BigqueryKubernetesPandasPysparkPythonSQL
Artificial Intelligence • HR Tech • Information Technology • Social Impact
The Data Engineer will analyze and interpret data, design scalable databases, optimize data operations, and develop LookML models while collaborating with various teams.
Top Skills:
BigQueryDbtFivetranGitLookerLookmlPythonSQL
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
