Invoca Logo

Invoca

Agentic AI Analyst

Reposted 19 Days Ago
Remote
Hiring Remotely in USA
94K-134K Annually
Mid level
Remote
Hiring Remotely in USA
94K-134K Annually
Mid level
As an Agentic AI Analyst, you'll analyze agentic AI applications, evaluate customer use cases, monitor agent performance, and support cross-functional team collaboration for customer success.
The summary above was generated by AI

About Invoca:

Invoca is the leading AI-powered conversation intelligence platform. We empower marketing, sales, customer experience, and contact center teams to unlock the intent and insights within every customer interaction – driving better customer experiences, increased revenue, and improved operational efficiency. Join our dynamic, fast-growing team, where innovation and collaboration are at the core of our culture.

The Opportunity:

As an Agentic AI Analyst at Invoca, you will play a pivotal role in shaping and refining the emerging category of agentic AI applications. Within our Product organization, you'll collaborate closely with a cross-functional team – including Product Managers, Engineers, Data Scientists, and Customer Success – to identify, evaluate, and operationalize innovative agentic use cases that directly improve customer outcomes and advance Invoca’s strategic AI vision

This role requires hands-on experience working with agentic AI systems in real or near-production environments, including multi-step reasoning agents, tool-using agents, and human-in-the-loop workflows.

This is an opportunity to grow your product skillset at the intersection of customer needs, agentic AI system design, and real-world AI performance. You will contribute to building new features, evaluating agent performance in production, and distilling insights from field engagements and system data to inform product priorities.

You should bring strong problem-solving ability, curiosity around emerging AI capabilities, and confidence working across stakeholders to translate ambiguity into clarity and execution.

What You’ll Do:
  • Drive Customer Discovery & Use Case Validation: Engage directly with GTM, Sales Engineering, and Customer Success teams to uncover high-value customer problems. Evaluate agentic AI fit by mapping use cases to operational workflows and measurable outcomes.
  • Analyze Product Usage & Behavioral Signals: Investigate call transcripts, user interactions, and system behavior logs to surface automation opportunities. Identify usage patterns, drop-off points, and signals that inform future agentic capabilities.
  • AI Agent Design and Evals: Design, evaluate, and iterate on agentic AI behaviors, including planning logic, tool invocation, state management, and human-in-the-loop decision points.
  • Prototype and Scope New AI Agent Concepts: Collaborate with Product and Engineering to define and scope early-stage agentic solutions. Translate customer insights and system data into experiment-ready prototypes, beta features, or refined prompt workflows.
  • Monitor AI Agent Performance in Production: Track and interpret key metrics—such as task completion rates, fallback frequency, and customer feedback—to assess agent efficacy and prioritize improvements. 
  • Refine Prompts, RAG Strategies & Tooling: Partner with engineering and ML teams to optimize agent behaviors. This includes improving prompt engineering, adjusting retrieval strategies, or enhancing integrations with internal tools
  • Identify and Resolve Agentic Edge Cases: Systematically uncover and document edge cases, unintended behaviors, and regression risks. Work cross-functionally to triage issues and ensure stability of agent interactions in production.
  • Document Agent Workflows & Best Practices: Own the creation and maintenance of internal documentation for agent designs, expected behaviors, and troubleshooting guides. Maintain and evolve internal playbooks for reuse and scale.
  • Enable Cross-Functional Teams & Customers: Support Product Marketing and Enablement by developing clear collateral and training on agentic AI features. Act as a product representative in customer meetings, agile ceremonies, and internal demos.

What You Bring:

  • 3+ years of experience in product, analytics, or technical customer-facing roles within SaaS or enterprise software.
  • Practical experience with agentic AI systems in production/near-production, including multi-step reasoning, tool-use, and human-in-the-loop agents.
  • Familiarity with LLMs, prompt design, or AI orchestration frameworks (e.g., LangChain, LangGraph) is a strong plus.
  • Demonstrated ability to work independently on medium-scope initiatives and balance tradeoffs across requirements, user value, and implementation effort.
  • Skilled at breaking down ambiguous problems, gathering data, and proposing thoughtful, data-driven solutions.
  • Strong communicator who can adjust messaging across technical and non-technical stakeholders.
  • Highly collaborative and comfortable working across engineering, GTM, and design partners.

To Apply:

If you are a visionary product leader with a passion for Conversational AI and a desire to make a significant impact, we encourage you to apply! Please submit your resume and a cover letter outlining your relevant experience and why you are the ideal candidate for this role.

This role is remote and open to candidates located in the United States and Canada only. Please note that we are unable to provide visa sponsorship for this position.

Salary, Benefits & Perks:

At Invoca, all new hires in the U.S. receive benefits starting on day one of employment. Our benefits offerings include:

Please note that benefits for teammates outside the U.S. may vary in accordance with their country’s laws and regulations.

  • Flexible Time Off – We encourage a healthy work-life balance. Our flexible paid time off policy allows you to recharge and take time away as needed.
  • Paid Holidays – Invoca provides 16 U.S. paid holidays, including a winter break, giving you ample opportunity to refresh and spend time with friends and family.
  • Health Benefits – Our healthcare program includes medical, dental, and vision coverage, with multiple plan options so you can choose what works best for you and your family. Fertility assistance is also included.
  • Retirement – Invoca offers a 401(k) plan through Fidelity with a company match of up to 4%.
  • Stock Options – All employees are invited to share in Invoca’s success through stock options.
  • Mental Health Program– Well-being support on a broad range of issues is available through our SpringHealth program.
  • Paid Family Leave – Up to 6 weeks of 100% paid leave is provided for baby bonding, adoption, and caring for family members.
  • Paid Medical Leave – Up to 12 weeks of 100% paid leave is provided for childbirth and medical needs.
  • InVacation – As a thank-you to our long-term team members, we offer a bonus after 7 years of service.
  • Wellness Subsidy – We provide a subsidy that can be applied toward gym memberships, fitness classes, and more.
  • Position Base Range - Salary Range $94,000-$134,000/year plus bonus potential
DEI Statement

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.

#LI-Remote

Top Skills

Langchain
Langgraph
Llms

Invoca Lone Tree, Colorado, USA Office

9380 Station St, , Lone Tree, Colorado ,, United States, 80124

Similar Jobs

2 Hours Ago
Remote or Hybrid
CA, USA
100K-145K Annually
Senior level
100K-145K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves leading vulnerability detection efforts, developing detection solutions, collaborating with teams, and managing projects in the cybersecurity space.
Top Skills: Ai/MlGoPerlPython
2 Hours Ago
Remote or Hybrid
3 Locations
105K-163K Annually
Senior level
105K-163K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Global Partner Services Manager leads a global team to scale delivery programs, driving partner enablement and governance, while ensuring customer satisfaction and measurable business outcomes.
Top Skills: SalesforceTableau
2 Hours Ago
Remote or Hybrid
4 Locations
110K-160K Annually
Mid level
110K-160K Annually
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves managing strategic cloud partner initiatives, ensuring effective communication and coordination among teams, and continuous process improvement.
Top Skills: Cloud MarketplacesSaaS

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account