Informa Logo

Informa

Staff Engineer – Data Platform and Lakehouse

Posted 2 Days Ago
In-Office or Remote
Hiring Remotely in New York, NY
180K-220K Annually
Senior level
In-Office or Remote
Hiring Remotely in New York, NY
180K-220K Annually
Senior level
Lead the design and implementation of a cloud-native Data Platform for AI and analytics, collaborating with cross-functional teams to enhance product offerings.
The summary above was generated by AI
Company Description

Curinos empowers financial institutions to make better, faster and more profitable decisions through industry-leading proprietary data, technologies and insights. With decades-long expertise in the financial services industry and a relentless focus on the future, Curinos technology and analytics ecosystem allows clients to anticipate customer needs and optimize their go-to market decisions in an increasingly competitive market.

Curinos operates in a hybrid/remote model, and this position is fully remote in the United States or hybrid in the Greater New York, Boston or Chicago metropolitan areas.

Job Description

We are seeking and experienced  Staff Engineer – Data Platform and Lakehouse  to lead the design and implementation of our cloud-native Data Platform  that support AI, advanced analytics, and machine learning applications in our ecosystem of B2B SaaS applications in the FinTech vertical You’ll work with a diverse team of talented engineers, AI and ML scientists, and product managers to build our next generation data and AI platforms, support migration of products from legacy infrastructure, and help product engineering teams leverage the Data platform and Lakehouse to launch new products and build new genAI applications. As a company that specializes in data-driven insights, the reliability, scalability, and effectiveness of our data & AI platforms are integral to our product offerings.  This role requires deep technical expertise, strategic thinking, and strong collaboration across engineering, data science, and product teams.

Responsibilities:

  • Design and implement scalable, secure, and maintainable data platforms on Databricks and AWS cloud infrastructure.
  • Provide architectural leadership across engineering domains, ensuring consistency, scalability, and resilience
  • Architect distributed data processing systems using Apache Spark and optimize for performance and scalability.
  • Lead development of reusable data pipelines and workflows using Databricks Workflows.
  • Translate business objectives into platform capabilities in collaboration with Product Managers and cross-functional teams.
  • Support AI/ML initiatives through robust data engineering, including feature engineering, model deployment.
  • Champion best practices in ETL/ELT, data quality, monitoring, observability, and Agile development.
  • Drive adoption of data governance standards: access control, metadata management, lineage, and compliance.
  • Establish and maintain CI/CD pipelines and DevOps automation for data infrastructure.
  • Evaluate and integrate emerging technologies to enhance development, testing, deployment, and monitoring.

Salary Range: $180,000 -$220,000 (plus bonus)

Qualifications

Desired Skills and Expertise:

  • 15+ years of experience in software development, covering the full SDLC: ideation, design, development, testing, deployment, and support.
  • Strategic mindset, capable of aligning technical decisions with business goals and driving architectural vision.
  • Excellent collaboration and communication skills across functions, including data scientists, MLOps engineers, and product managers.
  • Advanced proficiency in Python and SQL, with a strong foundation in software engineering principles.
  • Extensive experience with distributed computing frameworks, particularly Apache Spark, including performance tuning and scalability.
  • Required hands-on experience with Databricks, including Unity Catalog, Feature Store, and Delta Live Tables.
  • Proficiency in data pipeline orchestration tools using Databricks Workflows, Airflow, or AWS Glue; Databricks required.
  • Strong command of data engineering best practices and tools, including ETL/ELT design, data quality validation, monitoring, and observability. Experience with Monte Carlo preferred.
  • Proven ability to build scalable, cloud-native data architectures on Databricks, AWS, Azure, or GCP; Databricks required.
  • Experience enabling AI/ML workloads including feature engineering, model deployment, and real-time processing.
  • Strong understanding of data governance and security, including access control, data lineage, compliance, and metadata management.

 

Additional Information

Why work at Curinos?  

  • Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from 
  • Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask! 
  • Competitive annual leave, floating holidays, volunteering days and a day off for your birthday!
  • Learning and development tools to assist with your career development 
  • Work with industry leading Subject Matter Experts and specialist products 
  • Regular social events and networking opportunities 
  • Collaborative, supportive culture, including an active DE&I program 
  • Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services 

Applying: 

We know that sometimes the 'perfect candidate' doesn't exist, and that people can be put off applying for a job if they don't meet all the requirements. If you're excited about working for us and have relevant skills or experience, please go ahead and apply. You could be just what we need! 

If you need any adjustments to support your application, such as information in alternative formats, special requirements to access our buildings or adjusted interview formats please contact us at [email protected] and we’ll do everything we can to help.

Inclusivity at Curinos: 

We believe strongly in the value of diversity and creating supportive, inclusive environments where our colleagues can succeed.  As such, Curinos is proud to be an Equal Opportunity Employer. We do not discriminate on the basis of race, color, ancestry, national origin, religion, or religious creed, mental or physical disability, medical condition, genetic information, sex (including pregnancy, childbirth, and related medical conditions), sexual orientation, gender identity, gender expression, age, marital status, military or veteran status, citizenship, or other protected characteristics. 

Top Skills

Airflow
Spark
AWS
Aws Glue
Azure
Databricks
GCP
Python
SQL

Similar Jobs

24 Minutes Ago
Easy Apply
Remote
United States
Easy Apply
Senior level
Senior level
Cloud • Security • Software • Cybersecurity • Automation
The Senior Solutions Architect at GitLab supports software development by providing technical guidance, helping with sales strategy, and building customer relationships to promote GitLab's platform.
Top Skills: Ai-Powered Devsecops PlatformGitlab PlatformPocPovSoftware Development
28 Minutes Ago
Remote or Hybrid
New York, NY, USA
89K-133K Annually
Mid level
89K-133K Annually
Mid level
AdTech • Digital Media • Marketing Tech
The Commercial Operations Specialist supports business goals by managing cross-functional initiatives, coordinating projects, and improving operational processes. This role requires strong communication and organizational skills to align stakeholders and track project progress.
40 Minutes Ago
Remote or Hybrid
24 Locations
135K-215K Annually
Senior level
135K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As Engineering Manager for Charlotte AI, lead teams in developing AI-powered security innovations. Focus on team growth, project management, and collaboration with product managers and UX designers.
Top Skills: AIAWSCloud-Native ArchitecturesDockerGoKubernetesMlPython

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account