Build evaluation infrastructure, observability tooling, diagnostic systems, datasets, annotation workflows, and experiments for production AI agents. Lead a hands-on AI Quality engineering team, improve agent quality, latency, and cost, and partner with AI Core engineering. The role requires developing evaluation pipelines, scorers, dashboards, CI/CD systems, and model-testing frameworks while managing team priorities and technical direction.