Solvd, Inc. Logo

Solvd, Inc.

Senior Data Engineer — Retrieval & RAG Platform

Posted Yesterday
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Build and operate an enterprise RAG retrieval platform using Amazon Bedrock and OpenSearch Serverless. Responsibilities include configuring vector search infrastructure, implementing hybrid retrieval and entitlement filtering, developing a versioned Lambda/API Gateway retrieval API, creating quality and operational dashboards, supporting pilot tuning, and documenting runbooks. The role requires production RAG or enterprise search experience, Python, AWS services, infrastructure as code, evaluation metrics, and optimization of relevance, latency, security, and cost.
The summary above was generated by AI

Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.

Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.

We are looking for a Senior / Staff Data Engineer to build what the Agent Assist provider calls: the Bedrock Knowledge Base configuration, the OpenSearch Serverless collection, the versioned retrieval API, and the quality dashboard. You’ll own the retrieval workstream end to end, paired with the ingestion engineer, with technical direction from the Solution Architect.

This role carries the most technical risk in the engagement — entitlement filtering is a severity-one commitment. The mission: ship a retrieval API that returns the right passages, with citations, only to callers entitled to see them, at a latency and cost the client accepts, and that the client can version and operate after week 10.

What you’ll do
  • Stand up the Bedrock Knowledge Base and OpenSearch Serverless vector collection in the client’s account from infrastructure code, with the embedding model, chunking strategy, and metadata fields the architect specified.

  • Implement hybrid retrieval — vector plus keyword — with metadata filtering by taxonomy, source, status, and review date; tune top-k, score thresholds, and reranking against the golden question suite.

  • Build the retrieval API on API Gateway and Lambda per the Integration Blueprint — versioned paths, authentication for the Agent Assist provider, per-client rate limits and usage metrics, structured error responses, and a citation payload with source URL, title, section, and last modified date.

  • Enforce entitlement at query time by filtering on permission metadata the ingestion pipeline captures — no restricted passage is ever returned to an unentitled caller.

  • Provide the Bedrock retrieve-and-generate reference endpoint used for pilot validation in weeks 7–9.

  • Build the quality dashboard — relevance, grounding, and citation scores trended per run; permission test results; freshness lag per source; API latency and error rate; OpenSearch capacity.

  • Support the contact center pilot in weeks 7–9 — capture retrieval misses, tune, and re-run the suite before each change ships.

  • Write the retrieval and API runbooks including model change, re-embedding, and index rebuild procedures with cost implications.

  • Pair with client platform owners in weeks 9–10 and hand over on the transition readiness checklist.

Required skills & experience
  • 4+ years as a software or ML engineer, with at least one RAG or enterprise search system delivered to production and measured with an evaluation suite — not just demos.

  • Hands-on with Amazon Bedrock — Knowledge Bases, Retrieve and RetrieveAndGenerate APIs, embedding models — and Amazon OpenSearch Serverless vector search including hybrid queries and metadata filters.

  • Python, with experience shipping Lambda-based APIs behind API Gateway including auth, versioning, and throttling.

  • Infrastructure-as-code with Terraform or AWS CDK and CI for deployment into a client-owned account.

  • Practical understanding of chunking, embedding model selection, reranking, and the trade-offs between relevance, latency, and cost.

  • Experience building operational dashboards in CloudWatch or an equivalent tool.


Preferred qualifications
  • AWS Certified Generative AI Developer Professional or AWS Certified Machine Learning Engineer Associate.

  • Experience with RAG evaluation frameworks and metrics — faithfulness, context precision and recall, citation accuracy.

  • Experience integrating with a contact center Agent Assist product as an API provider.

  • Familiarity with Bedrock Guardrails and permission-aware retrieval patterns over Microsoft 365 content.

When you join Solvd, you'll…

  • Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.

  • Be part of a global team with equal opportunities for collaboration across continents and cultures.

  • Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.

Ready to make an impact?

If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.

Solvd is an equal opportunity employer.

Similar Jobs

40 Minutes Ago
Remote or Hybrid
45K-85K Annually
Junior
45K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound calls and warm leads, consult customers on insurance needs, recommend appropriate Property and Casualty coverages, and convert prospects into policyholders. The role includes paid licensing and sales training, customer communication, lead conversion, and remote work using provided equipment. Employees must work a weekday and weekend schedule, maintain a professional home workspace, and meet high-speed wired internet requirements.
Top Skills: Cable InternetDslFiber InternetPcWired High-Speed Internet
55 Minutes Ago
Remote or Hybrid
Massachusetts, USA
134K-168K Annually
Senior level
134K-168K Annually
Senior level
Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Leads the architecture and evolution of DraftKings’ machine learning platform, including real-time data pipelines, lakehouse governance, distributed data systems, and scalable ML serving infrastructure. Establishes engineering standards, drives complex initiatives, oversees reliability and cloud cost optimization, and partners across engineering and data teams. The role also mentors engineers, advances automation, supports incident response, and applies AI-assisted development practices.
Top Skills: Apache IcebergAWSCloud NetworkingDatabricksDelta LakeDistributed Data SystemsIdentity ManagementInfrastructure As CodeKafkaLakehouse PlatformsMachine Learning Serving InfrastructureReal-Time Data PipelinesSnowflakeSpark Structured StreamingTerraform
2 Hours Ago
Remote or Hybrid
Wisconsin, USA
89K-154K Annually
Senior level
89K-154K Annually
Senior level
Fintech • Insurance • Financial Services
Provides financial planning consulting, coaching, training, and software support to Northwestern Mutual advisors and field leaders. Builds and presents financial plans, improves adoption of planning tools and processes, supports sales-cycle effectiveness, leads group events, and collaborates with regional leadership. The role requires strong financial services expertise, consulting ability, relationship-building skills, and approximately 20% regional travel.
Top Skills: Client Account Aggregation ToolsCRMDigital FactfinderNorthwestern Mutual Planning Software

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account