Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Leads Deepgram’s end-to-end Text-to-Speech research program, owning research strategy, technical direction, model development, evaluation, and production deployment. Advances neural audio modeling, prosody, expressiveness, multilingual generation, voice consistency, controllability, and inference performance. Builds and develops research teams, manages technical leaders, prioritizes experiments and compute, evaluates model quality, and partners with engineering and product leadership to ship production-grade models.
Top Skills:
Generative Audio ModelingMultilingual Speech GenerationMultimodal ModelsNeural Audio CodecsNeural Audio ModelingSpeech Language ModelsText-To-Speech (Tts)Voice Cloning
Consumer Web • Software • Travel
Own acquisition and lifecycle growth for Engine’s sports and wedding travel verticals. Develop and scale experiments across digital, events, referrals, affiliates, and community; use data and AI to optimize performance; collaborate with Product, Sales, Design, and Lifecycle teams; and influence roadmap decisions to improve customer acquisition, retention, and the wedding booking experience.
Top Skills:
AmplitudeBrazeClaudeCustomer.IoGoogle AdsKlaviyoMeta AdsOutreachSalesforceSnowflakeSQLTiktok Ads
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hunt for historical and active threats across enterprise environments by analyzing logs, system artifacts, forensic evidence, and threat intelligence. Develop actionable remediation recommendations and communicate findings through reports and presentations to technical stakeholders, executives, and legal counsel. Help mature threat-hunting capabilities through research, methodology development, search-query creation, and scripting. The role also values incident response, cloud-platform knowledge, remediation planning, and responsible use of AI technologies.
Top Skills:
Active DirectoryAWSAzureGCPKerberosLinuxPythonWindows
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
