Evaluate and improve LLM financial reasoning by designing real-world finance tasks, creating reference solutions, scoring AI outputs with structured rubrics, refining evaluation frameworks, and collaborating with researchers to raise data quality and model performance. Must provide detailed feedback and identify gaps to enhance AI across finance use cases.
This role is for one of our clients
Compensation: $65 - $90 per hour
Join a cutting-edge AI research initiative and help shape the next generation of Large Language Models. We are seeking experienced Finance Specialists with deep domain expertise and hands-on experience evaluating AI model outputs using structured rubrics. In this role, you will apply your financial knowledge and professional judgment to improve AI systems by designing high-quality finance tasks, creating reference solutions, and assessing model performance against rigorous evaluation standards.
This is a fully remote, independent contractor opportunity requiring a commitment of at least 35 hours per week during weekdays.
RequirementsKey Responsibilities
- Partner with research and engineering teams to improve AI models' understanding of financial reasoning, analysis, and decision-making.
- Design challenging, real-world finance tasks covering a broad range of financial concepts and business scenarios.
- Develop accurate, well-reasoned reference solutions based on industry best practices and professional expertise.
- Evaluate AI-generated outputs using structured scoring rubrics, providing detailed written feedback on technical accuracy, reasoning quality, and financial judgment.
- Create and refine evaluation frameworks, quality standards, and scoring guidelines for finance-related tasks.
- Collaborate with fellow subject matter experts to ensure consistency, reliability, and high-quality training data.
- Help identify knowledge gaps and recommend improvements that enhance AI performance across finance use cases.
- 8+ years of professional experience in finance, including one or more of the following areas:
- Investment Banking
- Asset Management
- Corporate Finance
- Financial Advisory
- Experience gained at a recognized, high-performing financial institution, consulting firm, or equivalent organization.
- Mandatory: Prior hands-on experience evaluating LLM/AI model outputs using structured rubrics or scoring frameworks. Applicants should clearly describe this experience in their application.
- Demonstrated career progression through increasing levels of responsibility.
- Ability to commit at least 35 hours per week during weekdays.
- Strong analytical, problem-solving, and financial reasoning skills.
- Excellent written and verbal communication abilities with exceptional attention to detail.
- Experience developing financial models, valuation analyses, investment recommendations, or strategic financial planning.
- Familiarity with AI evaluation methodologies, human-in-the-loop review processes, or data quality programs.
- Experience designing evaluation frameworks, quality assurance processes, or structured review systems.
- Background mentoring analysts, reviewing complex financial work, or leading cross-functional initiatives.
- Interest in applying financial expertise to emerging AI technologies.
- Employment Type: Independent Contractor
- Work Arrangement: Fully Remote
- Schedule: Minimum 35 hours per week during weekdays
- Project Duration: Based on business requirements and performance, with opportunities for extension
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract & Payment Terms- You will be engaged as an independent contractor.
- This is a fully remote opportunity that can be completed on your own schedule.
- Projects may be extended, shortened, or concluded early depending on business needs and performance.
- Your work will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are made weekly via Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
Similar Jobs
Aerospace • Energy
Prepares quarterly and annual GAAP and statutory financial statements, NAIC schedules, regulatory filings, account reconciliations, and journal entries. Supports internal and external audits while maintaining financial and operational controls, improving processes, and delivering accurate reporting and analysis for insurance products.
Top Skills:
Naic Financial ReportingStatutory Accounting Practices (Sap)Us Gaap
Healthtech • Biotech • Pharmaceutical
Manages purchase order workflows, accounts payable, vendor records, payment processing, cash transactions, bank reconciliations, and close support. The role resolves invoice and payment discrepancies, maintains documentation and controls, supports audits and cash forecasting, and improves procure-to-pay processes. It partners with vendors, budget owners, and Finance & Accounting stakeholders while reporting to the Assistant Controller.
Top Skills:
AchBanking PortalsErpExcelProcure-To-Pay Platforms
Agency • Information Technology • Professional Services • Financial Services
Supports billing and finance administration for a remote legal practice. Responsibilities include preparing invoices, maintaining financial records, tracking payments and accounts receivable, reconciling billing data, identifying discrepancies, supporting reporting, and coordinating with attorneys. The role requires accuracy, organization, confidentiality, strong data-entry skills, and proficiency with spreadsheets and business productivity tools.
Top Skills:
Accounting SoftwareBilling SoftwareLegal Practice Management SoftwareSpreadsheets
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
