Barbaricum is a rapidly growing government contractor providing leading-edge support to federal customers, with a particular focus on Defense and National Security mission sets. We leverage more than 17 years of support to stakeholders across the federal government, with established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in 2008, our mission is to transform the way our customers approach constantly changing and complex problem sets by bringing to bear the latest in technology and the highest caliber of talent.
Headquartered in Washington, DC's historic Dupont Circle neighborhood, Barbaricum also has a corporate presence in Tampa, FL, Bedford, IN, and Dayton, OH, with team members across the United States and around the world. As a leader in our space, we partner with firms in the private sector, academic institutions, and industry associations with a goal of continually building our expertise and capabilities for the benefit of our employees and the customers we support. Through all of this, we have built a vibrant corporate culture diverse in expertise and perspectives with a focus on collaboration and innovation. Our teams are at the frontier of the Nation's most complex and rewarding challenges. Join our team.
Barbaricum is seeking a Generative AI (GenAI) Subject Matter Expert (SME) to lead technical benchmarking, model evaluation, and best practices for implementing LLMs and AI-driven solutions in the DoD. This role focuses on retrieval-augmented generation (RAG), model performance monitoring, and AI-driven document analysis using AWS Bedrock, AWS Sagemaker, and other AI frameworks.
Responsibilities:
- Lead technical research and benchmarking for GenAI and RAG implementations.
- Develop model performance evaluation metrics to optimize AI-driven workflows.
- Provide expert guidance on LLM integration for DoD applications.
- Test, validate, and refine GenAI models, ensuring efficiency and reliability.
- Recommend best practices for unstructured document and content analysis using AI.
Qualifications:
- Must be a U.S. Citizen and reside within the United States.
- AWS certifications highly preferred; AIML and SEC experience is a plus.
- Bachelor’s degree plus 7+ years of experience, or Master’s degree plus 5+ years of experience in AI, Machine Learning, or Data Science.
- Experience with LLMs, Generative AI, RAG, and AI-powered knowledge retrieval.
- Strong expertise in AWS Bedrock, cloud AI services, and AI model benchmarking.
- Proficiency in Python, SQL, and AI evaluation frameworks.
EEO Commitment
All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law.
Top Skills
Similar Jobs
.png)
What you need to know about the Colorado Tech Scene
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
