The role involves design and development of data solutions using Azure tools, integrating Generative AI, and mentoring junior engineers.
Role: Senior Azure GenAI Engineer
Location: Mount Laurel, NJ
Duration: FTE/C2C
Primary Skills: Azure, Databricks, Pyspark, ADF, GenAI
We are seeking a highly skilled Senior Azure Data Engineer with expertise in Databricks and PySpark to join our dynamic team. This role involves designing, developing, and maintaining scalable data solutions on Azure, leveraging modern data engineering tools and frameworks. Additionally, 20% of the role will focus on integrating and applying Generative AI (GenAI) technologies to enhance data processing, analytics, and automation capabilities.
Key Responsibilities
- Design, develop, and optimize data pipelines and workflows using Azure Data Factory, Azure Databricks, and PySpark.
- Build and maintain scalable, robust, and secure data architectures on Azure cloud platforms.
- Collaborate with data scientists, analysts, and business stakeholders to integrate data engineering solutions with GenAI models and applications.
- Develop and implement ETL/ELT processes to ingest, transform, and load large volumes of structured and unstructured data.
- Monitor and troubleshoot data pipeline performance, ensuring data quality, integrity, and availability.
- Utilize Azure Synapse Analytics, Azure Data Lake Storage, and related services to support big data and analytics initiatives.
- Lead efforts to incorporate GenAI technologies (e.g., large language models, AI-driven data augmentation, automated data insights) into existing data workflows.
- Stay current with emerging Azure technologies, Databricks features, PySpark enhancements, and GenAI advancements.
- Mentor junior engineers and contribute to best practices, documentation, and knowledge sharing.
Required Skills and Qualifications
- Proven experience with Azure Data Engineering tools: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics.
- Strong proficiency in PySpark and Python for building and optimizing large-scale data pipelines.
- Solid understanding of Generative AI concepts, including experience working with large language models, AI-driven data augmentation, or related GenAI applications.
- Ability to collaborate effectively with AI and data science teams to integrate GenAI models into production data workflows.
- Knowledge of data governance, security best practices, and compliance standards in cloud environments.
- Excellent problem-solving skills and ability to work in an agile, fast-paced environment.
- Strong communication skills for cross-functional collaboration.
Top Skills
Adf
Azure
Azure Data Lake Storage
Azure Synapse Analytics
Databricks
Genai
Pyspark
Similar Jobs
Beauty • Robotics • Design • Appliances • Manufacturing
The Quality Engineer will analyze customer complaints, drive continuous improvement in product and process quality, collaborate cross-functionally, and ensure compliance with quality standards pre and post-launch.
Top Skills:
MS OfficeSharepoint
Beauty • Robotics • Design • Appliances • Manufacturing
The eCommerce Key Account Manager will drive Amazon sales strategies, manage relationships with Vendor Services, analyze performance, and optimize pricing and promotions to increase market share and sales.
Top Skills:
ExcelMicrosoft Office Suite
Beauty • Robotics • Design • Appliances • Manufacturing
The role involves leading product development from concept to market, managing team members, defining product specs, and ensuring quality, user experience, and business results while collaborating cross-functionally.
Top Skills:
Consumer TestingDesignProduct DevelopmentProject Management
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
