ServiceNow Logo

ServiceNow

Senior Staff Machine Learning Engineer, Agentic Systems - Moveworks

Posted Yesterday
Be an Early Applicant
Hybrid
Mountain View, CA
201K-352K Annually
Senior level
Hybrid
Mountain View, CA
201K-352K Annually
Senior level
Build and own distributed runtime infrastructure for Moveworks AI agents. Responsibilities include agent orchestration, distributed session management, event-driven messaging, asynchronous concurrency, observability, caching, and state layers. The role requires designing scalable backend systems using Python or Go, DynamoDB, Redis, SQS, Kafka, gRPC, OpenTelemetry, and related technologies.
The summary above was generated by AI
Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

 

Job Description

The Role

We're building the runtime infrastructure that powers Moveworks' AI agents — the systems that orchestrate, execute, and deliver agent responses to millions of enterprise users in real time. This is not an ML role. This is a distributed systems engineering role at the heart of the agentic AI wave.

Our AI agents can plan, execute multi-step workflows, call tools, wait on human input, and resume — all while maintaining correctness, observability, and low latency. The systems that make this possible are what you'll build and own.

What you get to do in this role:

  • Agent orchestration engine — A state machine that manages long-running agent sessions, coordinating planning, execution, and user interaction across multiple LLM calls and tool invocations
  • Distributed session management — Lease-based ownership using DynamoDB conditional writes, heartbeat protocols, and crash recovery via checkpointing
  • Event-driven message pipeline — SQS FIFO queues for ordered delivery, Kafka consumers for event processing, and real-time streaming via gRPC and Socket.IO
  • Structured concurrency — Python asyncio TaskGroups running multiple concurrent tasks per session (message polling, lease heartbeats, output publishing, orchestrator execution) with fail-fast semantics and graceful cancellation
  • Observability infrastructure — OpenTelemetry instrumentation, distributed trace context propagation across async boundaries, custom span lifecycle management for sessions that span minutes
  • Caching and state layers — Redis, DynamoDB KV stores with per-org/per-bot scoping, batch read optimization, and hot-reload configuration

Qualifications

To be successful in this role you have:

You should have deep experience in at least 3 of these areas:

  • Distributed systems: consistency models, idempotency, exactly-once delivery, distributed locking/leasing
  • Concurrent/async programming: Python asyncio, Go goroutines, structured concurrency, cancellation handling
  • Event-driven architectures: message queues (SQS, Kafka), pub/sub, backpressure, delivery guarantees
  • Database systems for infrastructure: DynamoDB (conditional writes, transactions), Redis (connection pooling, pub/sub)
  • Observability: OpenTelemetry, distributed tracing, span context propagation, Prometheus metrics
  • gRPC/protobuf: streaming RPCs, service interface design, error handling patterns

Required:

  • 10+ years building production backend/infrastructure systems
  • Strong in Python or Go (ideally both)
  • Experience designing and operating systems that handle real traffic at scale
  • Comfort with ambiguity — these are novel problems without textbook solutions

For positions in this location, we offer a base pay of $201,300 - $352,300, plus equity (when applicable), variable/incentive compensation and benefits.  Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure.  Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location.  We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs.  

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity,  veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. 

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. 

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

ServiceNow Denver, Colorado, USA Office

1800 Wazee St, Suite 300, Denver, CO, United States, 80202

Similar Jobs at ServiceNow

2 Months Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design, build, optimize, and scale machine learning infrastructure for training, evaluating, deploying, and serving large language models. Develop reusable workflow automation abstractions, distributed training and inference pipelines, model evaluation and monitoring frameworks, and latency optimizations. Collaborate with machine learning, data infrastructure, analytics, engineering, and product teams while establishing best practices for ML and data engineering.
Top Skills: C++Etl PipelinesGoHugging FaceLarge Language ModelsMicroservicesPythonPyTorchTensorrt-LlmVllm
6 Hours Ago
Remote or Hybrid
125K-187K Annually
Senior level
125K-187K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead end-to-end data and analytics solution sales cycles, co-selling with account executives from opportunity creation through adoption. Own the D&A portfolio, develop account strategies, conduct executive discovery and value-based conversations, deliver technical presentations and demos, and build relationships with data, analytics, AI, and technology leaders. Drive adoption, business outcomes, and growth across existing ServiceNow customers.
Top Skills: AIAutonomous Data AnalyticsBoomiBusiness IntelligenceCloud Data WarehousingData AnalyticsData AppsData GovernanceData IntegrationData ManagementDatabricksInformaticaMicrosoft FabricOracle AnalyticsPalantirPower BIQlikRaptordb ProSalesforce Data 360Servicenow Ai PlatformSnowflakeTableauThoughtspotWorkflow Data Fabric
6 Hours Ago
Hybrid
143K-243K Annually
Senior level
143K-243K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Develop scalable full-stack web applications and platform capabilities using modern web and cloud technologies. Translate requirements into maintainable software, contribute to architecture, perform code reviews and automated testing, debug issues, and collaborate in Agile teams. The role also involves adopting AI-powered engineering tools, mentoring teammates, and delivering reliable, high-quality features.
Top Skills: AgileAi-Powered ToolsAngularAPIsCSS3GraphQLHTML5JavaJavaScriptMicrosoft Sql ServerMySQLNode.jsOracleReactScrumShell ScriptingUnix/Linux

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account