The role involves developing data pipelines using Azure Databricks and PySpark, translating banking requirements into technical designs, and ensuring data quality and governance.
Role: Azure Databricks / PySpark Developer with Business Analysis (Banking Domain)
Location: Mount Laurel, NJ
Mode of Work: Onsite
Role Summary
We are seeking a mid‑to‑senior level Data Engineer with strong hands‑on expertise in Azure Databricks, PySpark, Azure Data Factory, and Synapse Analytics, combined with solid Business Analysis skills
This is a hybrid techno‑functional role where you will develop scalable data pipelines and also translate banking business requirements into technical designs.
You will collaborate with business users, data architects, and cross‑functional technology teams to deliver high‑quality data solutions supporting regulatory reporting, risk analytics, fraud detection, customer insights, and core banking operations.
Key Responsibilities
Technical Responsibilities-Data Engineering & Development
- Design, build, and optimize ETL/ELT data pipelines using Azure Databricks (PySpark), ADF, and Synapse.
- Develop scalable data ingestion frameworks for batch and near‑real‑time data.
- Implement Delta Lake for ACID‑compliant, performant data workflows.
- Build data transformation logic using PySpark for cleansing, validation, and enrichment.
- Optimize Spark jobs for performance, reliability, cost, and parallel execution.
- Integrate data across multiple banking systems (CBS, Loans, Cards, Payments, AML, Risk, Regulatory platforms).
- Develop reusable modules, notebooks, parameterized pipelines, and CI/CD‑ready components.
- Ensure data quality, profiling, governance, lineage, and audit requirements are met.
- Work with ADO/Git for version control, branching, and deployment.
Business Analysis Responsibilities
- Interact with business stakeholders: Risk, Finance, Payments, Operations, Compliance, Treasury, etc.
- Gather, analyze, and document business/stakeholder requirements.
- Translate banking use cases into technical specifications and data transformation rules.
- Perform data mapping, source‑to‑target documentation, and business glossary creation.
- Conduct gap analysis, feasibility studies, and propose data solutions.
- Support UAT, perform data validation, and work closely with end‑users for sign‑off.
- Identify data issues, troubleshoot root causes, and propose process improvements.
- Communicate insights and updates to both technical and non‑technical teams.
Top Skills
Azure Data Factory
Azure Databricks
Pyspark
Synapse Analytics
Similar Jobs
Information Technology • Consulting
Lead big data projects employing AWS and various programming languages to enhance data engineering, security, and ETL processes. Ensure adherence to project standards and timelines while fostering team collaboration and resource management.
Top Skills:
Api GatewayAWSCloudwatchDockerEcsEmrGitlabGlueJenkinsJSONLambdaParquetPl/SqlPythonRdsRedshiftS3SASSecrets ManagerSnsSQLSqsStep FunctionsTerraformUnix Shell ScriptsUrban CodeXML
Information Technology • Consulting
This role focuses on optimizing large-scale financial modeling applications by implementing MLOps practices and maintaining end-to-end pipelines on AWS.
Top Skills:
AWSCi/CdMachine LearningMlopsSoftware Engineering
Cloud • Information Technology • Security • Software • Cybersecurity
Provide technical support for Zscaler products focusing on troubleshooting security and networking issues while ensuring client satisfaction and operational excellence.
Top Skills:
DnsHttp/SOidcSAMLTcp/IpTls/Ssl
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
