G2i Logo

G2i

Senior Code Reviewer for LLM Data Training (R)

Posted 2 Days Ago
Be an Early Applicant
In-Office or Remote
119 Locations
Senior level
In-Office or Remote
119 Locations
Senior level
Review evaluations of AI-generated R code by annotators, ensuring compliance with quality guidelines and providing feedback for improvement.
The summary above was generated by AI

About the Company

G2i connects subject-matter experts, students, and professionals with flexible, remote AI training opportunities, including annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation.

About the Role

We’re hiring a Code Reviewer with deep R expertise to review evaluations completed by data annotators assessing AI-generated R code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Responsibilities

  • Review and audit annotator evaluations of AI-generated R code.

  • Assess if the R code follows the prompt instructions, is functionally correct, and secure.

  • Validate code snippets using proof-of-work methodology.

  • Identify inaccuracies in annotator ratings or explanations.

  • Provide constructive feedback to maintain high annotation standards.

  • Work within Project Atlas guidelines for evaluation integrity and consistency.

Required Qualifications

  • 5–7+ years of experience in R development, QA, or code review.

  • Strong knowledge of R syntax, debugging, edge cases, and testing.

  • Comfortable using code execution environments and testing tools.

  • Excellent written communication and documentation skills.

  • Experience working with structured QA or annotation workflows.

  • English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications

  • Experience in AI training, LLM evaluation, or model alignment.

  • Familiarity with annotation platforms.

  • Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.

Join a high-impact team working at the intersection of AI and software development. Your R expertise will directly influence the accuracy, safety, and clarity of AI-generated code. This role offers remote flexibility, milestone-based delivery, and competitive compensation.

Top Skills

R

Similar Jobs

An Hour Ago
Easy Apply
Remote
2 Locations
Easy Apply
218K-257K Annually
Senior level
218K-257K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As a Staff Software Engineer, you will architect and develop distributed systems, mentor team members, manage project priorities, and design foundational infrastructure for risk mitigation at Coinbase.
Top Skills: DockerGoPostgresRuby on RailsRubySinatra
An Hour Ago
Easy Apply
Remote
2 Locations
Easy Apply
218K-257K Annually
Senior level
218K-257K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As a Machine Learning Engineer in the Risk AI/ML team, you will design and deploy sophisticated AI/ML models to prevent fraud and improve risk detection processed while leading technical strategies and mentoring team members.
Top Skills: Apache AirflowGraph Neural NetworksKafkaLlmsLstmsPythonPyTorchSparkTensorFlow
An Hour Ago
Easy Apply
Remote
USA
Easy Apply
152K-179K Annually
Junior
152K-179K Annually
Junior
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As a Machine Learning Platform Engineer, you'll enhance ML inference infrastructure, optimize data pipelines, and build tools for model performance monitoring.
Top Skills: AirflowDatabricksDynamoDBGoPythonRaySnowflakeSparkTecton

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account