Assess AI and human-produced pre-sales and solutions engineering deliverables by developing task-specific grading criteria, evaluating outputs, and providing evidence-based written justifications. Define standards across discovery, demos, POCs, RFPs, architecture, and risk assessments. Refine frameworks with senior feedback and ensure reproducible, defensible evaluations.
This role is for one of our clients
Compensation: $100-$150 per hour
1. OverviewWe are seeking experienced Sales Engineering and Solutions Engineering professionals to contribute to a research initiative focused on evaluating how effectively advanced AI systems perform real-world technical sales and pre-sales work.
In this role, you will bring your professional expertise to define what excellent technical sales work looks like. Rather than simply producing deliverables, you will develop task-specific evaluation criteria, assess AI-generated and human work samples, and provide rigorous written reasoning behind your assessments.
Your practical experience working with customers, technical teams, and complex B2B products will help establish realistic standards for evaluating AI performance across the sales engineering lifecycle.
Requirements2. Key Responsibilities
- Develop precise, task-specific grading criteria for real-world pre-sales and solutions engineering deliverables, including:
- Technical discovery plans
- Tailored product demonstrations
- Proof-of-concept and technical evaluation plans
- Security questionnaires and RFP responses
- Integration, API, and architecture explanations
- Product-fit and technical-risk assessments
- Evaluate AI-generated and human-produced work against defined criteria and provide detailed written justifications for each assessment.
- Assess whether technical recommendations accurately address customer requirements and business objectives.
- Evaluate the quality of technical discovery, solution design, product positioning, and objection handling.
- Apply consistent, evidence-based judgment to ensure evaluation results are reproducible and defensible.
- Identify gaps, inaccuracies, unclear assumptions, and technical risks in proposed solutions.
- Incorporate structured feedback from senior reviewers and continuously refine evaluation standards.
- Translate practical sales engineering judgment into clear, structured evaluation frameworks.
- 4+ years of professional experience as a:
- Sales Engineer
- Solutions Engineer
- Solutions Consultant
- Pre-Sales Consultant
- Technical Sales Consultant
- Or in a closely related technical customer-facing role
- Deep understanding of the end-to-end pre-sales process, including:
- Technical discovery
- Requirements gathering
- Solution design
- Tailored product demonstrations
- Technical objection handling
- Proof-of-concept development
- Product-fit analysis
- Technical risk assessment
- Hands-on experience working with technically complex B2B software and technology products, such as:
- SaaS platforms
- Cloud infrastructure
- Cybersecurity solutions
- Data platforms
- Developer tools
- Enterprise applications
- Strong ability to translate customer requirements into practical technical solutions.
- Exceptional written communication skills, with the ability to clearly explain why a technical solution would or would not meet the expectations of both technical and business stakeholders.
- Highly detail-oriented and consistent, with strong analytical and evaluation skills.
- Comfortable receiving feedback and calibrating professional judgment against experienced peers.
- Prior experience with AI training, model evaluation, human-data projects, or AI-assisted workflows is a strong plus.
- Submit your resume or relevant professional background to begin the application process.
- Qualified candidates may be asked to complete a brief technical or domain-specific assessment.
- Additional information about your sales engineering experience may be requested during the evaluation process.
- You will be engaged as an independent contractor.
- This is a fully remote opportunity with flexible scheduling.
- Projects may be extended, shortened, or concluded early depending on project requirements and performance.
- The engagement will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through available payment platforms.
- H-1B and STEM OPT candidates are not currently supported.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Insurance
The Sales Engineering Expert discovers prospective customers’ technical and business requirements, designs and executes evaluations and pilots, and presents tailored solution designs. Responsibilities include building trusted customer relationships, authoring RFI/RFP documents, supporting proposals and statements of work, demonstrating Arity products, advising product teams on roadmap needs, conducting competitive research, and creating presentations and interactive demonstrations for customer engagements, conferences, and events.
Cloud • eCommerce • Information Technology • Professional Services • Software
Manage multiple customer-facing technology implementation projects from kickoff through closure. Own delivery outcomes while coordinating customers, implementation engineers, executives, and cross-functional teams. Oversee scope, schedules, budgets, risks, quality, forecasting, and resource management. Lead planning sessions and delivery meetings, communicate project status, and help improve PMO best practices. The role focuses on cloud-based, integration-oriented solutions, with EDI, MFT, data movement, or file transfer experience preferred.
Top Skills:
Cloud TechnologyData MovementEdiFile Transfer TechnologiesMftProject Portfolio Management (Ppm) Software
Fintech • Real Estate • Sales • Financial Services
Originates mortgage loans by building referral relationships, generating leads, consulting with clients, analyzing financial and property documents, recommending suitable loan products, and guiding borrowers from application through closing. Represents Rocket Mortgage in community functions, maintains a book of business, resolves client concerns, provides client service, and stays current on mortgage products, qualification standards, and process changes.
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
