Quisitive Logo

Quisitive

Senior Data Engineer – AI Solutions

Posted 12 Days Ago
Easy Apply
Remote
Hiring Remotely in USA
Senior level
Easy Apply
Remote
Hiring Remotely in USA
Senior level
The role involves building data ingestion pipelines, optimizing ETL processes, and developing AI-driven solutions using various frameworks and databases.
The summary above was generated by AI

Passionate team members, challenging projects and a great place to work! This is what you can expect if you join the Quisitive team. Founded in 2016, Quisitive is a global Microsoft services and solutions partner. We are a team of professionals with a strong reputation for successfully delivering award-winning Microsoft solutions, including being named Microsoft's 2024 Analytics Partner of the Year. Our culture of continual learning and innovation ensures that we remain committed to Microsoft’s long-term strategy.

What do we attribute our award-winning success to? The people we hire, of course! Our team members join Quisitive for more than just a job. They come to Quisitive to contribute to something bigger than themselves – to be part of a high-performing culture, continue their infinite quest to learn, and deliver innovative and exciting solutions that impact both Quisitive's and our customers’ future success. Our leaders continuously strive to provide the tools and resources that you need to do what you do best each and every day!

We are currently hiring a Sr. Data Engineer with strong AI experience to join our team and help build the backbone of our data-driven solutions. This role is perfect for someone who loves working with large-scale data, optimizing pipelines, and exploring cutting-edge AI technologies. You’ll play a key role in designing and maintaining systems that power intelligent applications and knowledge management platforms.

This role can be located anywhere in the United States.

What will this role entail?

  • Building and maintaining backend data ingestion and embedding pipelines
  • Setting up environments, clone repositories, and running pipelines in JupyterHub
  • Working on large-scale ETL processes, including converting Iceberg tables to Parquet and exporting data to S3 buckets
  • Designing and optimizing schemas for Neo4j-based graph solutions
  • Integrating knowledge workflows and KB articles into graph structures for advanced retrieval
  • Troubleshooting data quality issues and optimizing Spark jobs for efficiency
  • Implementing retry mechanisms and debugging full-stack issues related to large file operations
  • Managing secure access using JWT and Kerberos authentication
  • Handling credentials for Oracle DB and API clients via HashiCorp Vault
  • Working with GitLab for source control and Jira for project tracking
  • Supporting migration efforts from Azure DevOps to GitLab/Jira environments

What’s required to be successful in this role?

  • Strong proficiency in Python for data processing and pipeline development
  • Hands-on experience with Spark 
  • Familiarity with Neo4j, LangChain, and LLM integration for AI-driven solutions
  • Experience with Oracle DB, PostgreSQL, and PGVector for embedding strategies
  • Comfortable working with S3 buckets, Parquet, and CSV formats
  • Exposure to embedding models like BGEM 3 and Nomic
  • Understanding of AI-powered retrieval and recommendation systems
  • Power BI for dashboard development and reporting
  • Knowledge of Kerberos authentication and secrets management with HashiCorp Vault

What else would set me apart?

  • Experience with Iceberg and large-scale data frameworks
  • Experience with IOMETE
  • JupyterHub for testing/debugging

We are looking for curious initiative takers to join our team, so if you are passionate about working with smart people that are committed to accomplishing great things, then apply today!

Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.

About Quisitive

With significant growth since 2016, Quisitive is rapidly achieving our vision of becoming the leading global Microsoft partner as we continue to expand across the United States, Canada and India. With a diversified delivery model that includes both nearshore and offshore capabilities, our team of Microsoft experts delivers cloud and artificial intelligence business solutions and services that ensure our customers achieve their digital transformation goals. In addition, Quisitive offers a portfolio of industry-focused solutions that address customer challenges in healthcare, manufacturing, state & local government and performance management.

Top Skills

Csv
Hashicorp Vault
Iceberg
Jupyterhub
Neo4J
Oracle Db
Parquet
Pgvector
Postgres
Power BI
Python
S3
Spark

Similar Jobs

39 Minutes Ago
Remote
Pennsylvania, USA
124K-191K Annually
Senior level
124K-191K Annually
Senior level
Healthtech • Logistics • Pharmaceutical
The Principal Security Product Manager will develop product strategy, manage roadmaps, collaborate with teams, and present product performance to leadership, focusing on cybersecurity domains.
Top Skills: Agile MethodologiesCybersecurityIdentity And Access ManagementInformation TechnologyRisk And Compliance
2 Hours Ago
Remote or Hybrid
2 Locations
205K-257K Annually
Senior level
205K-257K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The role involves leading technology projects, optimizing distributed systems, collaborating on cloud-based solutions, and mentoring others while leveraging various technologies to enhance services.
Top Skills: AWSCassandraDockerGoKafkaNode.jsOpensearchPostgresPython
2 Hours Ago
Remote or Hybrid
3 Locations
99K-136K Annually
Junior
99K-136K Annually
Junior
Fintech • Machine Learning • Payments • Software • Financial Services
As a Senior Business Analyst on the AI/ML team at Velocity Black, you will analyze data, support model governance, and collaborate with cross-functional teams to enhance product offerings through AI and ML tools.
Top Skills: AIMlSQL

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account