Gigster Logo

Gigster

Data Engineer

Posted 4 Days Ago
Remote
2 Locations
Mid level
Remote
2 Locations
Mid level
The Data Engineer will design and optimize ETL/ELT pipelines, integrate data sources, and enhance data processing for NLP models. Collaboration with cross-functional teams is key.
The summary above was generated by AI

Do you want to work on cutting-edge projects with the world’s best IT engineers? Do you wish you could control which projects to work on and choose your own pay rate? Are you interested in the future of work and how the cloud will form teams? If so - the Gigster Talent Network is for you.

Our clients rely on our Network for two main areas, Software Development and Cloud Services. In some cases, they need help building great new products, in others they want our expertise in migrating, maintaining, and optimizing their cloud solutions.

At Gigster, whether working with entrepreneurs to realize ‘the next great vision’ or with Fortune 500 companies to deliver a big product launch, we build really cool enterprise software on cutting-edge technology.


The Role:

We are seeking an experienced Data Engineer with deep expertise in data transformation at scale, particularly in integrating and processing data from third-party public APIs. This role is critical to enhancing and maintaining data pipelines that feed into Natural Language Processing (NLP) models.


What you’ll do:
  • Design, build, and optimize scalable ETL/ELT data pipelines using Apache Spark, Apache Kafka, and orchestration tools such as Prefect or Airflow

  • Integrate external data sources and public APIs with internal data systems

  • Work with large-scale datasets to support NLP model training and inference

  • Analyze existing pipelines and recommend enhancements for performance, reliability, and scalability

  • Collaborate with cross-functional teams, including data scientists and ML engineers

  • Own the end-to-end engineering process—from planning and technical design to implementation

  • Regularly report progress and outcomes to client stakeholders

 What we’re looking for:
  • Proficiency in Python and experience with data transformation and data engineering best practices

  • Strong experience with Apache Spark, Apache Kafka, and Google Cloud Platform (GCP)

  • Hands-on experience with workflow orchestration tools (e.g., Prefect, Airflow)

  • Demonstrated experience working with large datasets and real-time data processing

  • Experience building and maintaining ETL/ELT pipelines for analytical or machine learning use cases

  • Self-motivated, with excellent communication and project ownership skills


Preferred Qualifications:
  • Familiarity with financial services data or regulated data environments

  • Experience with Snowflake or Google BigQuery

  • Experience with PostgreSQL and GCS (Google Cloud Storage)
  • Exposure to NLP workflows and data requirements for machine learning models


Logistics:
  • This is a part-time, short term, 4 to 6 weeks contract
  • Preferred location: Remote US
 

Top Skills

Airflow
Apache Kafka
Spark
Google Bigquery
Google Cloud Platform
Prefect
Python
Snowflake

Similar Jobs

4 Days Ago
Remote
Hybrid
USA
97K-140K Annually
Mid level
97K-140K Annually
Mid level
Automotive • Big Data • Insurance • Software • Transportation
Design and maintain data infrastructure for analytics and ML; develop ETL/ELT pipelines, cloud cost optimization, and data governance workflows.
Top Skills: AirflowAWSBigQueryDbtDynamoDBFastapiFivetranFlaskGitMongoDBPysparkPythonRedshiftSnowflakeSQL
4 Days Ago
Easy Apply
Remote
Hybrid
2 Locations
Easy Apply
90K-100K
Junior
90K-100K
Junior
AdTech • Big Data • Information Technology • Marketing Tech • Sales • Software
Support systems processing billions of data interactions by building and optimizing ETL pipelines while collaborating with experienced engineers.
Top Skills: AirflowBigQueryComposerDataflowGoogle Cloud PlatformKubernetesPub/SubPythonSQL
5 Days Ago
Easy Apply
Remote
Hybrid
USA
Easy Apply
Mid level
Mid level
Artificial Intelligence • Information Technology • Insurance • Machine Learning • Software • Analytics
The Data Engineer will develop and manage scalable data pipelines and systems, handle complex healthcare datasets, and ensure data integrity for ML/AI applications.
Top Skills: AirflowAWSAws LambdaPythonRedshiftSQLTableau

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account