Note: At the moment, this opportunity is not available to applicants from California and New York.
—
We'll cut to the chase: we're looking for the world's best experts to take on the world's smartest models.
In Humanity’s Last Exam, we introduced the most challenging reasoning benchmark for frontier AI models. So far, the highest-performing system—OpenAI’s Deep Research—has achieved only 26% accuracy. We are collaborating with leading AI labs to identify the most effective data to improve AI reasoning capabilities in expert domains, and we aim to publish a new paper presenting our findings.
To do this, we are assembling a team of elite individuals who are the utmost experts in their respective fields. Our shared goal is to create PhD+ level problems that current state-of-the-art LLMs cannot correctly solve. This team will work collaboratively to produce datasets that will be available to our partner research groups, the world’s most advanced AI laboratories.
We're looking for unicorns to help us write some of the hardest problems intelligence has ever seen — do you think you can do this?
Why Join?
- Have the opportunity to co-author a research paper analyzing how effectively this data enhances model reasoning.
- Get access to an exclusive community of world-class researchers in a variety of domains; Each task submission will be open to peer review.
- Receive up to $540 for each contributed problem and solution pair
What’s Next?
- Still unsure? Watch this quick video of what comes after you hit "Apply Now" below
- If you're up for the task, apply below!
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
Top Skills
Similar Jobs
What you need to know about the Colorado Tech Scene
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
