Design difficult open-web research problems for benchmarking frontier AI browsing agents. Responsibilities include constructing multi-step questions, validating clues across databases, archives, registries, and PDFs, documenting auditable evidence trails, recording search validation results, testing research difficulty, resolving ambiguity, and delivering reproducible research documentation.
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role overview
Our client is building advanced evaluation benchmarks for frontier AI browsing agents.
We are looking for highly skilled investigative researchers who can design research problems that remain difficult even for state-of-the-art AI systems with full web access. This is not a traditional subject-matter or content-writing role. The work is centered on open-web investigation, evidence tracing, source validation, and benchmark construction.
You will begin from a verifiable fact, work backwards to construct a difficult research question, and document a complete, auditable evidence trail showing how the answer can be independently verified.
CONTRACT: Short-term freelance/contractor assignment, 8 weeka
COMMITMENT: 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST
LOCATIONS: Remote, GLOBAL
Responsibilities- Design challenging open-web research problems for evaluating advanced AI browsing agents.
- Start from objectively verifiable facts and construct questions that make those facts difficult to discover.
- Build multi-step clue structures involving dates, people, places, organizations, works, events, records, and quantities.
- Ensure every clue is independently verifiable and subject to clear constraints.
- Research across government databases, institutional sources, archives, registries, and PDF documents.
- Produce complete evidence trails citing exact pages, tables, sections, or records.
- Record validation searches and document what obvious search approaches return.
- Test whether research questions remain difficult across multiple search attempts.
- Refine questions to eliminate ambiguity while preserving difficulty.
- Deliver structured, reproducible research documentation.
Requirements
- Background in reference librarianship, archives, or special collections.
- Experience in investigative journalism or professional fact-checking.
- Experience with OSINT, due diligence, KYC, or investigative research.
- Background in patent, prior-art, or legal-discovery research.
- Experience with genealogy or historical records research.
- Experience with competitive quizzing, puzzle design, or puzzle-hunt construction.
- Familiarity with JSON or structured data formats.
Similar Jobs
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Leads techno-commercial strategy for RAN engagements across East and North Africa. Translates radio technology into ROI, TCO, pricing, offer scope, negotiation, and value narratives. Partners with sales, pricing, contract management, presales, and technical domain teams to improve win rates, protect margins, and support profitable growth. Requires strong RAN expertise, complex telecom deal structuring, commercial modelling, stakeholder management, financial fluency, and negotiation skills.
Top Skills:
2G3G4G5GCloud ComputingCloud RanCore NetworksMassive MimoOpen RanOss/BssRanSoftware LicensingTransport Networks
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Leads techno-commercial strategy for RAN engagements across EMEA. Translates radio technology into ROI and TCO value propositions, develops pricing and commercial models, supports negotiations, optimizes offer scope, and partners with sales, pricing, contract management, presales, and domain teams. The role drives proactive customer engagement, win rates, margin protection, reusable commercial assets, and profitable growth across complex telecom and ICT deals.
Top Skills:
2G3G4G5GCloud ComputingCloud RanCore NetworksMassive MimoOpen RanOss/BssRanSoftware LicensingTransport Networks
Agency • Professional Services • Consulting
Manage end-to-end accounts payable and support general ledger month-end close activities. Responsibilities include invoice processing, vendor reconciliations, payment scheduling, tax application, journal preparation, accruals, provisions, prepayments, balance-sheet reconciliations, financial reporting schedules, audit support, and maintaining close deadlines and vendor master-data controls.
Top Skills:
Microsoft DynamicsNav
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
