EXL Logo

EXL

Cloud Data Engineer

Reposted 25 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.
The summary above was generated by AI

We are seeking an experienced AWS Data Engineer to join our Data Engineering team. You will be responsible for architecting, implementing, and managing scalable data solutions on AWS. Candidate would be required to work from NJ office as part of this role.

Responsibilities

design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
Develop and enforce standards for data quality, security, and governance.
Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
Troubleshoot complex data issues and provide technical leadership in problem resolution.

Qualifications

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
6+years of experience in data engineering.
Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
Excellent problem-solving, communication, and organizational skills.
 

Preferred Qualifications:
AWS Solutions Architect or AWS Data Engineer certification.
Experience with real-time streaming technologies.
Knowledge of data governance, compliance, and security best practices.
Familiarity with Lakehouse architecture and modern data platforms.

Similar Jobs

2 Days Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead cloud data modernization by designing and implementing Azure/Snowflake/Databricks data platforms, building scalable ETL/ELT pipelines, ensuring data quality, security and governance, implementing CI/CD, mentoring engineers, and supporting healthcare data solutions and compliance.
Top Skills: AirflowAzureAzure Data Factory (Adf)Azure Data Lake Storage Gen2 (Adls Gen2)Change Data Capture (Cdc)CptDatabricksDatabricks GenieEtl/EltFacetsFhirGitGithub ActionsGithub CopilotHcpcsHl7Icd-10LlmsLoincPrompt EngineeringPysparkPythonRag PipelinesSnowflakeSnowflake CortexSparkSQL ServerSsisVector StoresVisioX12 Edi (837/835/834)
2 Days Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead cloud data modernization by designing and building cloud-native ETL/ELT pipelines, data warehouses, and lakehouse architectures using Azure, Snowflake, and Databricks. Ensure data quality, security, governance, CI/CD, and healthcare interoperability while mentoring engineers and collaborating with stakeholders to deliver scalable, HIPAA-compliant analytics platforms.
Top Skills: AdlsApache AirflowAzureAzure Data Factory (Adf)Azure Data Lake Storage Gen2 (Adls Gen2)Azure OpenaiCi/CdCptDatabricksDatabricks GenieDatabricks Mosaic AiDockerEltETLFhirGitGithub ActionsHcpcsHl7Icd-10KafkaKubernetesLlmsLoincPysparkPythonRag PipelinesSnowflakeSnowflake CortexSparkSQL ServerSsisTerraformVector StoresVisioX12 Edi (837/835/834)
2 Days Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead cloud data modernization efforts by designing, building, and migrating ETL/ELT pipelines, cloud data warehouses/lakehouses, and data governance. Implement Azure/Snowflake/Databricks solutions, CI/CD, performance tuning, CDC, data quality, and HIPAA-compliant healthcare data platforms while mentoring engineers and supporting full delivery lifecycle.
Top Skills: Adls Gen2Ai-Enabled Data Engineering ToolsAirflowAWSAzureAzure Data Factory (Adf)Azure DevopsAzure Sql DatabaseCi/CdDatabricksDockerEtl/EltGitGithub ActionsGCPKubernetesMicrosoft FabricPythonRagSnowflakeSpark/PysparkSQL ServerSsisSynapse AnalyticsTerraformVector StoresVisio

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account