Evaluate AI communication for tone and empathy, identifying errors and writing samples to model ideal interactions, while maintaining scoring consistency with the team.
Overview: Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Core Responsibilities
- Score AI messages for tone, empathy, and contextual awareness
- Identify subtle errors like “overly agreeable” or “lack of personality”
- Write short creative samples to model ideal AI tone
- Evaluate humor, pop culture references, and archetype use
- Maintain high scoring consistency with the evaluation team
Requirements
Qualifications
- Native or near-native US English proficiency
- Strong reading comprehension and precision tagging skills
- Deep familiarity with American conversational norms and humor
- Background in writing, editing, moderation, or customer engagement
Bonus
- Psychology, creative writing, or linguistics degree
- AI tools or chatbot evaluation experience
Benefits
$25–$30/hr
Similar Jobs
Insurance
The Engineering Manager will lead a team of engineers, support their development, drive projects, and ensure alignment with business goals, while promoting a culture of feedback and collaboration.
Top Skills:
AirflowAiven DebeziumArcgisBigQueryBigQueryCircleCICloud FunctionsCloud RunCloudsqlComposerDatadogFivetranGcp GcsGitGoGCPJupyter NotebooksKafkaKubernetesNuxtPostgresPub/SubPythonRSQLTailwindTerraformVuejsWebpack
Insurance
Design, build, test and maintain backend systems for Openly's insurance platform, collaborating with partners to develop APIs and improve internal tooling.
Top Skills:
ArcgisBigQueryCircleCICloud FunctionsComposerDatadogGCPGitGoJupyter NotebooksKafkaPostgresPythonRSQLTerraform
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
As a Sales Engineer, you'll support the sales team with technical inquiries, assist with trials, create software solutions, manage content and support testing activities while building customer relationships.
Top Skills:
Automation And Control SystemsCloud SoftwareIot HardwareNetworkingSensors
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
