Microsoft Logo

Microsoft

Senior Product Manager - AI Infrastructure

Reposted 20 Days Ago
Remote
Hiring Remotely in United States
120K-261K Annually
Senior level
Remote
Hiring Remotely in United States
120K-261K Annually
Senior level
Own product strategy and multi-year roadmaps for GPU back-end networking. Translate AI workload needs into requirements, lead products through qualification and deployment, coordinate engineering and business teams, influence suppliers, and improve performance, reliability, cost, observability, and launch readiness.
The summary above was generated by AI
Overview

The Azure HPC & AI Infrastructure team defines and delivers the systems that power large-scale AI training and inference. We are seeking a Senior Product Manager to own the product strategy and execution for back-end networking across GPU infrastructure, spanning across clusters and datacenters to power the next generation of AI Factories.
In this role, you will translate workload and customer needs into product requirements, align architecture and investment choices, and drive products from concept through qualification, launch, and fleet deployment. You will work across networking, systems engineering, software, datacenter infrastructure, operations, supply chain, finance, and strategic suppliers to improve performance, reliability, time to market, and total cost of ownership.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 


Responsibilities
  • Define the product strategy, and multi-year roadmap for GPU back-end networking capabilities.
  • Engage strategic customers and internal workload teams to understand requirements, manage competing product priorities to deliver infrastructure for AI workloads at scale.
  • Translate customer AI training and inference workload needs into clear product requirements for bandwidth, latency, topology, congestion management, resiliency, security, observability, and serviceability.
  • Own the end-to-end product lifecycle from concept and plan of record through new product introduction, qualification, launch, scale deployment, and lifecycle improvement.
  • Drive alignment and execution across hardware and software engineering, networking, architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing teams.
  • Influence supplier roadmaps and product definitions across GPU systems, network interface devices, switches, optics, cables, and interconnect technologies; resolve technical and business tradeoffs to improve platform outcomes.
  • Establish success metrics and operating mechanisms for performance, reliability, availability, deployment readiness, cost efficiency, and launch health; use customer signals, telemetry, and incident learnings to prioritize improvements.

Qualifications

Required Qualifications

  • Bachelor's Degree AND 5+ years experience in product/service/program management or software development
    • OR equivalent experience.
  • 1+ years experience with GPU or AI-accelerated hardware systems and infrastructure, including the ability to translate complex system concepts into product requirements, roadmaps, and execution plans.
  • 1+ years experience with datacenter networking or accelerated computing infrastructure, including technologies such as Ethernet, InfiniBand, RDMA, network interface devices, switches, optics, NVLink etc. 

Other Requirements

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:  
    • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. 

Preferred Qualifications

  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development
    • OR equivalent experience.
  • 2+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
  • 4+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
  • 4+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).

#azurecorejobs


Product Management IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar Jobs

One Month Ago
In-Office or Remote
United States
139K-251K Annually
Senior level
139K-251K Annually
Senior level
Cloud • Security • Software • Cybersecurity
Lead product strategy and roadmap for Akamai's core compute offerings, bridging hardware and developer experiences. Gather and document technical requirements, prioritize features, analyze metrics for KPIs and profitability, collaborate cross-functionally, and engage customers and partners to drive compute platform adoption and improvements.
Top Skills: Bare-MetalCloud ComputeHypervisorsInfrastructure-As-CodeLinuxMulti-Tenant Cloud ArchitecturesVirtualization
19 Minutes Ago
Remote
United States
180K-200K Annually
Expert/Leader
180K-200K Annually
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Energy • Infrastructure as a Service (IaaS)
Leads Riot’s enterprise Identity and Access Management program across corporate, cloud, data center, and operational environments. Responsibilities include IAM strategy, Microsoft Entra ID architecture, privileged access management, identity governance, least-privilege models, non-human identity controls, third-party access, automation, compliance, security monitoring, metrics, and leadership of IAM engineers and partners.
Top Skills: Cloud PlatformsConditional AccessIdentity Governance And Administration (Iga)Microsoft Entra IdMulti-Factor Authentication (Mfa)Nist CsfPasswordless AuthenticationPrivileged Access Management (Pam)Privileged Identity Management (Pim)Role-Based Access Control (Rbac)SaaSSingle Sign-On (Sso)Zero Trust
19 Minutes Ago
Remote
United States
160K-175K Annually
Senior level
160K-175K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Energy • Infrastructure as a Service (IaaS)
Designs, implements, and operates enterprise IAM solutions across Entra ID, Active Directory, cloud, SaaS, and data centers. Manages SSO, MFA, PAM, PIM, RBAC, identity governance, lifecycle controls, provisioning automation, third-party access, and non-human identities. Troubleshoots authentication and federation issues, supports identity-threat investigations, maintains technical documentation, and contributes to audit and compliance activities.
Top Skills: Active DirectoryAPIsConditional AccessCyberarkIdentity Governance And AdministrationIso 27001MfaMicrosoft Entra IdNist CsfOauth 2.0Openid ConnectPimPowershellPrivileged Access ManagementRbacSailpointSAMLScimSoc 2SoxSsoZero Trust

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account