Arize AI Logo

Arize AI

UX Engineer, LLM Experimentation Platform

Posted 4 Days Ago
Easy Apply
Remote
Hiring Remotely in USA
175K-200K Annually
Mid level
Easy Apply
Remote
Hiring Remotely in USA
175K-200K Annually
Mid level
You will refine existing UX features, prototype interactions, identify user friction points, run usability tests, and collaborate closely with engineers.
The summary above was generated by AI
About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Most engineering teams treat UX refinement as an afterthought squeezed between feature work. We're carving out a dedicated role for it because we believe the difference between "works" and "delightful" is what separates good products from great ones. You'll have the space to really care about craft.

We're a technical team building for technical users (ML engineers, researchers) who are drowning in complexity. Your job is to make that complexity manageable and maybe even enjoyable. We're looking for an engineer who obsesses over the details that make complex tools feel effortless. You'll work on our LLM evaluation and prompt experimentation platform, taking functional features and refining them into intuitive, polished experiences.

What You’ll Do
  • Refine and iterate on UX for existing features - you won't build from scratch, but you'll make things significantly better
  • Watch real users struggle in Fullstory, identify friction points, and fix them
  • Prototype interaction alternatives rapidly (in Figma or code) to test different approaches
  • Work closely with our Senior engineers who own feature architecture - they build the foundation, you perfect the interface
  • Own the "feel" of the product: transitions, feedback, error handling, progressive disclosure
  • Build reusable interaction patterns that the team can leverage
  • Run lightweight usability tests to validate improvements

A typical week might include:

  • Watching 10 user sessions, identifying 3 common friction points
  • Prototyping 2 different flows for evaluator configuration in Figma
  • Implementing the winner with smooth transitions and helpful inline guidance
  • Pairing with Staff engineers to refactor a complex form into a multi-step wizard
  • Running a quick usability test with 5 users on the new onboarding flow
You're a great fit if:
  • You've made products noticeably better through interaction refinement (show us!)
  • You're comfortable with modern frontend frameworks and animation libraries
  • You've used session replay tools and incorporated user feedback into designs
  • You can work in Figma to prototype before committing to code
  • You think about edge cases, loading states, and empty states automatically
  • You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters
  • Bonus: You've built or contributed to design systems
What you DON'T need:
  • Formal design training (though it's welcome)
  • Full-stack experience (we have engineers for that)
  • Experience with our specific tech stack (we care more about your UX sensibility)

The estimated annual salary for this role is between $175,000 - $200,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

Top Skills

Animation Libraries
Figma
Modern Frontend Frameworks

Similar Jobs

21 Minutes Ago
Remote or Hybrid
United States
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
The Senior Named Account Executive will sell Cloudflare services to the Public Sector, develop strategic relationships, manage contracts, and maintain a sales pipeline.
Top Skills: Computer Networking
36 Minutes Ago
Remote or Hybrid
United States
115K-213K Annually
Mid level
115K-213K Annually
Mid level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Advisory Solutions Consultant will support sales teams by understanding customer needs, providing product demonstrations, and participating in the sales process, focusing on Identity Security solutions.
Top Skills: AWSAzureGCPJavaJSONLdapSQLXML
36 Minutes Ago
Remote or Hybrid
United States
119K-222K Annually
Senior level
119K-222K Annually
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Design and build a machine learning platform, deploy ML models, collaborate across teams, and establish monitoring standards for AI solutions.
Top Skills: AIAmazon BedrockAmazon SagemakerAWSDockerFeastMicroservicesMlRestful Apis

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account