i4DM Logo

i4DM

C2 SMART Integration Engineer (Data Acquisition)

Posted Yesterday
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
The Integration Engineer designs and implements data integration solutions to enable real-time insights, ensuring data quality and compliance while managing complex data architectures across domains.
The summary above was generated by AI

About the Role

Are you ready to build the data backbone that enables trusted, real‑time insight across complex mission environments? As an Integration Engineer, you will design and implement data integration solutions that securely and reliably move data across diverse domains while ensuring data consistency, quality, and governance. You’ll build streaming and batch pipelines to support operational intelligence, cross‑domain analytics, and enterprise data products - often in environments with strict security, segmentation, and governance requirements. Working closely with domain experts and platform teams, you’ll help ensure data is consistent, high‑quality, and available where decisions are made, even across distributed and constrained architectures.


Responsibilities

  • Design and implement integration patterns that enable seamless data flow across multiple business domains.
  • Navigate domain-specific security models, network segmentation, and data sovereignty requirements.
  • Implement cross-domain service architectures using APIs, event streaming, and data virtualization to decouple source and consumer domains.
  • Collaborate with domain data stewards to define service-level agreements (SLAs), data contracts, and handshake protocols between domains.
  • Build scalable data acquisition pipelines from diverse sources.
  • Implement change data capture (CDC) using Debezium, AWS DMS, or similar tools for database sources.
  • Develop resilient ingestion frameworks that handle variable data volumes, network latency, and source system unreliability.
  • Architect, deploy, and manage Apache Kafka clusters across multiple domains or environments (on-premise, cloud, hybrid).
  • Implement Kafka Streams or ksqlDB for real-time data enrichment and transformation.
  • Design canonical data models that serve as the lingua franca for cross-domain data exchange.
  • Collaborate with domain experts to align business definitions, hierarchies, and metrics across functions.
  • Implement cross-domain security controls including encryption in transit, encryption at rest, and fine-grained access controls (RBAC, ABAC).
  • Ensure compliance with regulatory requirements (GDPR, CCPA, SOX, etc.) across domain boundaries.
  • Set up alerting for pipeline failures, data latency, schema drift, and cross-domain connectivity issues.

TAG: #LI-I4DM

Required Qualifications:

  • 5+ years of experience in data engineering, data integration, or software engineering with a focus on enterprise-scale environments.
  • Proven experience designing and operating cross-domain data integration architectures in large enterprises.
  • Experience navigating network segmentation, firewall policies, and security zones in hybrid or multi-cloud environments.
  • Production experience with Apache Kafka, including Kafka cluster administration (brokers, topics, partitions, replication, consumer groups)
  • Experience with managed Kafka services: Confluent Cloud, Amazon MSK, Azure Event Hubs, or similar.
  • Experience with cross-cluster replication, disaster recovery, and multi-region Kafka architectures.
  • Proven experience acquiring data from:
  • Enterprise applications (SAP, Oracle EBS, JD Edwards, Salesforce)
  • APIs (REST, GraphQL, SOAP) with advanced handling of rate limits, pagination, and authentication
  • Databases via CDC (Debezium, Oracle GoldenGate, AWS DMS)
  • Experience with edge data acquisition and IoT platforms (AWS IoT Core, Azure IoT Hub).
  • Deep experience with enterprise data modeling across multiple domains.
  • Proficiency with data modeling tools (ERwin, ER/Studio, SAP PowerDesigner, or open-source alternatives).
  • Advanced proficiency for custom integration development, Kafka producers/consumers, and automation.
  • Experience with Kafka client libraries and stream processing applications.
  • Expert-level for data validation, reconciliation, and complex transformations.
  • Deep experience with AWS (MSK, ECS, Lambda, S3, IAM, VPC) or Azure (Event Hubs, Data Factory, Synapse, Databricks).
  • Docker, Kubernetes, Helm for deploying streaming applications.
  • Experience with cloud data warehouses (Snowflake, BigQuery, Redshift).
  • Git and CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins).
  • Terraform, AWS CloudFormation, or Azure Resource Manager.

Top Skills

Apache Kafka
Aws Cloudformation
Aws Dms
Aws Iot Core
Azure Event Hubs
Azure Resource Manager
BigQuery
Debezium
Docker
Git
Kubernetes
Redshift
Snowflake
Terraform

Similar Jobs

An Hour Ago
Remote or Hybrid
105K-130K Annually
Senior level
105K-130K Annually
Senior level
eCommerce • Fashion • Other • Retail • Sales • Wearables • Design
Leverage HR proficiency to manage employee lifecycle, provide guidance on employee relations, support talent management, lead organizational change, and ensure operational HR excellence.
Top Skills: ExcelMicrosoft PowerpointMicrosoft TeamsMicrosoft VisioMicrosoft WordWorkday
An Hour Ago
Remote or Hybrid
South Coast, CA, USA
19-38 Hourly
Junior
19-38 Hourly
Junior
eCommerce • Fashion • Other • Retail • Sales • Wearables • Design
As an Assistant Store Manager, you'll support sales goals, deliver exceptional customer service, lead team development, and ensure operational excellence.
Top Skills: MS OfficeRetail Systems
13 Hours Ago
Remote or Hybrid
209K-286K Annually
Senior level
209K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The Premium Support Engineer will serve as a technical authority for enterprise customers, ensuring optimal performance of air-gapped systems, advocating for feature requests, and managing incident responses.
Top Skills: AWSAws CloudformationDatabricksDockerEksGoHelmJavaKubernetesPrometheusPysparkPythonSnowflakeTerraform

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account