The resource will support the measurement, evaluation, and continuous improvement of AI/LLM-powered products. The role will focus on evaluating product and model performance, analyzing customer behavior and usage, defining product metrics, and translating insights into actionable recommendations. The scope is expected to expand to broader developer productivity, and platform measurement initiatives.
Work Location: San Francisco, CA
Work Mode: Hybrid (2-3 days/week in office)
Salary Range: $150K/Yr - $165K/Yr Base + Annual Bonus
The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process
For more information on benefits and what we offer please visit us at US Careers and Benefits
Responsibilities- Design and execute evaluation frameworks to assess product quality, accuracy, and user intent alignment
- Define, track, and analyze KPIs and success metrics across the product lifecycle
- Perform Product Analytics to understand customer behavior, product usage, and performance
- Identify data, tracking, and instrumentation gaps and improve measurement capabilities
- Develop and support A/B testing and experimentation to evaluate product strategies
- Support data pipelines, reporting, and analytics infrastructure
- Analyze feature adoption, engagement, retention, and product performance trends
- Develop dashboards, reporting, and analytical insights to support product decision-making
- Partner with Product, Engineering, Data Science, and Business teams to translate insights into actionable product improvements
- Bachelor’s degree or higher in Engineering, Data Science, Statistics, Computer Science, or a related field
- 7+ years of relevant experience in Data Science, Product Analytics, or related disciplines
- Proficiency in SQL and Python with experience working with large-scale products or event-based datasets
- Experience with data platforms, BI/reporting, and statistical modeling
- Strong understanding of product performance measurement and evaluation
- Ability to work independently, identify information gaps, and prioritize high-impact initiatives
- Experience in working with financial institutions like banks or fintech analytics
- Strong communication and stakeholder management skills with the ability to work across functions
Similar Jobs
What you need to know about the Colorado Tech Scene
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
