Arize AI Logo

Arize AI

UX Engineer, LLM Experimentation Platform

Reposted 23 Days Ago
Easy Apply
Remote
Hiring Remotely in United States
175K-200K Annually
Mid level
Easy Apply
Remote
Hiring Remotely in United States
175K-200K Annually
Mid level
You will refine existing UX features, prototype interactions, identify user friction points, run usability tests, and collaborate closely with engineers.
The summary above was generated by AI
About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors, with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Most engineering teams treat UX refinement as an afterthought squeezed between feature work. We're carving out a dedicated role for it because we believe the difference between "works" and "delightful" is what separates good products from great ones. You'll have the space to really care about craft.

We're a technical team building for technical users (ML engineers, researchers) who are drowning in complexity. Your job is to make that complexity manageable and maybe even enjoyable. We're looking for an engineer who obsesses over the details that make complex tools feel effortless. You'll work on our LLM evaluation and prompt experimentation platform, taking functional features and refining them into intuitive, polished experiences.

What You’ll Do
  • Refine and iterate on UX for existing features - you won't build from scratch, but you'll make things significantly better
  • Watch real users struggle in Fullstory, identify friction points, and fix them
  • Prototype interaction alternatives rapidly (in Figma or code) to test different approaches
  • Work closely with our Senior engineers who own feature architecture - they build the foundation, you perfect the interface
  • Own the "feel" of the product: transitions, feedback, error handling, progressive disclosure
  • Build reusable interaction patterns that the team can leverage
  • Run lightweight usability tests to validate improvements

A typical week might include:

  • Watching 10 user sessions, identifying 3 common friction points
  • Prototyping 2 different flows for evaluator configuration in Figma
  • Implementing the winner with smooth transitions and helpful inline guidance
  • Pairing with Staff engineers to refactor a complex form into a multi-step wizard
  • Running a quick usability test with 5 users on the new onboarding flow
You're a great fit if:
  • You've made products noticeably better through interaction refinement (show us!)
  • You're comfortable with modern frontend frameworks and animation libraries
  • You've used session replay tools and incorporated user feedback into designs
  • You can work in Figma to prototype before committing to code
  • You think about edge cases, loading states, and empty states automatically
  • You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters
  • Bonus: You've built or contributed to design systems
What you DON'T need:
  • Formal design training (though it's welcome)
  • Full-stack experience (we have engineers for that)
  • Experience with our specific tech stack (we care more about your UX sensibility)

The estimated annual salary for this role is between $175,000 - $200,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

Top Skills

Animation Libraries
Figma
Modern Frontend Frameworks

Similar Jobs

An Hour Ago
Remote or Hybrid
New York, NY, USA
149K-246K Annually
Senior level
149K-246K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Advisory Solution Consultant partners with Sales to address identity and security challenges, creating solutions that improve governance and drive secure operations. Responsibilities include customer engagement, technical leadership, and outcomes positioning, alongside continuous learning and collaboration.
Top Skills: Ai-Enhanced TechnologyIdentity ManagementSaaSSecurity Operations
3 Hours Ago
In-Office or Remote
Mountain View, CA, USA
166K-261K Annually
Entry level
166K-261K Annually
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Account Executive will engage with public sector clients in Canada, help them leverage Atlassian's software solutions, and drive sales growth.
3 Hours Ago
In-Office or Remote
San Francisco, CA, USA
149K-233K Annually
Expert/Leader
149K-233K Annually
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Strategist will develop and execute partner strategy to drive P&L growth, utilizing qualitative and quantitative methods. This role requires analysis of market dynamics, multi-layered stakeholder management, and effective communication to ensure successful GTM strategies and profitable growth.
Top Skills: SaaS

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account