Work with research and engineering teams to design realistic marketing tasks, create reference solutions, and evaluate AI/LLM outputs with structured rubrics. Maintain evaluation guidelines, ensure dataset quality, and collaborate with SMEs to improve AI model performance on marketing challenges.
This role is for one of our clients
Compensation: $60-$80 per hour
Join a leading AI lab at the forefront of Generative AI and help shape the next generation of intelligent systems. We are seeking experienced Marketing Subject Matter Experts (SMEs) with deep expertise in brand strategy, growth marketing, and campaign execution to improve AI model performance through high-quality training and evaluation.
In this role, you will leverage your marketing knowledge to design realistic business scenarios, evaluate AI-generated outputs using structured rubrics, and help establish the quality standards that enable AI models to reason more effectively across marketing domains.
RequirementsKey Responsibilities
- Partner with research and engineering teams to improve AI capabilities in brand strategy, growth marketing, customer acquisition, and campaign planning.
- Design realistic, domain-specific marketing tasks that reflect real-world business challenges and develop well-reasoned reference solutions.
- Evaluate AI-generated responses using structured scoring rubrics, providing clear, objective feedback on accuracy, reasoning, and practical applicability.
- Develop, refine, and maintain evaluation guidelines and quality standards for marketing-related tasks.
- Collaborate with fellow subject matter experts to ensure consistency, fairness, and accuracy across AI training datasets.
- 8+ years of professional experience in marketing, including areas such as brand strategy, growth marketing, digital marketing, performance marketing, product marketing, or integrated marketing communications.
- Experience working at a leading consumer brand, marketing agency, or high-growth organization is strongly preferred.
- Prior hands-on experience evaluating AI or Large Language Model (LLM) outputs using structured rubrics or scoring frameworks is required. Candidates should be able to describe this experience during the application process.
- Demonstrated career progression, such as Marketing Manager → Senior Marketing Manager → Director or Vice President of Marketing.
- Ability to commit reliably to at least 35 hours per week during standard weekdays.
- Excellent verbal and written communication skills, strong analytical thinking, and the ability to provide thoughtful, evidence-based evaluations.
- Strong collaboration, problem-solving, and stakeholder management skills.
We are committed to fostering an inclusive workplace and welcome applicants from all backgrounds. Qualified candidates will be considered without regard to legally protected characteristics, and reasonable accommodations are available throughout the application and engagement process.
Contract & Engagement Details- Independent contractor engagement.
- Fully remote with flexible working hours.
- Project duration may be extended, shortened, or concluded based on project needs and individual performance.
- Weekly payments are processed through supported payment platforms.
- Applicants must be legally authorized to work in the applicable hiring location. Visa sponsorship, including H-1B and STEM OPT support, is not available for this opportunity.
Similar Jobs
Cloud • eCommerce • Logistics • Software
Owns end-to-end email marketing production in HubSpot, including campaign building, audience segmentation, workflow nurtures, A/B testing, scheduling, approvals, quality assurance, and performance analysis. The role manages the email calendar, organizes marketing assets, creates basic Canva graphics, supports inbox responses, and applies privacy and email best practices. It requires collaboration across teams and time zones, strong proofreading, project management, and the ability to turn campaign briefs into polished emails.
Top Skills:
AsanaCanvaClickupCSSHTMLHubspotTrello
Healthtech • Professional Services • Telehealth
Supports day-to-day marketing execution across campaigns, social media, email, SMS, direct mail, newsletters, website content, and inbound communications. Creates and edits marketing collateral, manages vendors and promotional merchandise, maintains email templates and digital content, tracks campaign attribution and KPIs, and coordinates project workflows and SOPs. The role requires strong copywriting, proofreading, organization, healthcare marketing experience, and comfort working across multiple digital marketing tools.
Top Skills:
Adobe Creative CloudAsanaCmsConfluenceCRMEmail Marketing PlatformsFigmaGoogle SuiteHubspotJIRAQr CodesSms MarketingSquarespaceUtm ParametersWebflowWordpress
Marketing Tech
Create and manage email, text, and social media campaigns that engage magazine readers and generate booked meetings. Responsibilities include audience segmentation, message writing, campaign setup and testing, consent and contact-record management, performance tracking, troubleshooting, and coordinating follow-up with readership engagement teams. The role is fully remote and focuses on improving response rates, meeting attendance, reader fit, and story opportunities.
Top Skills:
Email MarketingInstantlySms/Text MessagingSocial MediaSpreadsheets
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
