About the Role
We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines. You'll read documents that include tables and citations, judge each criterion on its own merits, and write clear, evidence-based rationales that help us improve the quality of AI research tools. This role suits someone with a sharp editorial eye, a fact-checker's instincts, and the discipline to apply guidelines consistently
Project Details:
Location: Remote (United States)
Commitment: 15-20 hours per week
Engagement type: Freelancer
Pay rate: Philippines: $28 USD
What You'll Do
• Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
• Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
• Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
• Write short, specific rationales (1-3 sentences) that point to concrete evidence
• Follow guideline updates and calibrate your decisions consistently with the QA team.
Must-Have Qualifications
• Native or near-native US English (C2), with the ability to read long documents containing tables and citations
• Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
• Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
• Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
• Ability to write concise rationales that cite evidence
• Ability to judge each criterion independently, without letting an overall impression influence the call
• Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer.
Similar Jobs
What you need to know about the Colorado Tech Scene
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute



