ngrok Logo

ngrok

Software Engineer III/Senior, AI Gateway

Reposted 4 Days Ago
Easy Apply
Remote
Hiring Remotely in United States
160K-225K Annually
Mid level
Easy Apply
Remote
Hiring Remotely in United States
160K-225K Annually
Mid level
As a Software Engineer on the AI Gateway Team, you will design and implement distributed systems for secure application connections, optimizing traffic routing and policy enforcement with a focus on scalability and developer experience.
The summary above was generated by AI
About ngrok Inc.

At ngrok, we believe that doing networking the right way should also be the easy way. Over the last 10 years, we’ve given developers and engineers simple interfaces for getting traffic into their apps and APIs without forcing them to deal with legacy proxies, external load balancers, or VPNs, and we’re now part of the standard stack for more than 9 million developers at some of the world’s top technology brands, like GitHub, Okta, HashiCorp, and Twilio.

Over the last few years, we’ve completely changed how that interface looks and works to make it easier, more composable, and infinitely flexible. We now give anyone who needs a “front door” to their apps or APIs powerful tools to orchestrate traffic, secure public endpoints, accelerate their services on a global network, observe all traffic passing to/from their network, and much more. The ngrok that millions love and trust has been completely transformed for the better.

The Opportunity

As a Software Engineer on the AI Gateway Team, you’ll be shaping the foundation of how developers and enterprises securely connect their applications through ngrok. This role gives you the chance to design and implement distributed systems that enforce policies, manage trust, and deliver advanced endpoint capabilities—all at global scale.

You’ll work on challenges that demand both technical depth and creativity: building high-performance distributed systems that route traffic with millisecond precision, securing sensitive workloads, and enabling the next generation of AI-driven applications. Every line of code you ship will directly influence how developers build, secure, and scale their most critical services on ngrok.

This is a remote position for candidates outside of the Bay Area and a hybrid role for candidates within commuting distance to San Francisco. Our Bay Area employees commute to the office on Tuesdays and Wednesdays. At this time, ngrok is unable to provide visa sponsorship for this position. Applicants must be authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship.

What You’ll Do
  • Build and evolve the gateway services that handle traffic routing, policy enforcement.
  • Implement new traffic policy objects (e.g., secrets, IP rules, mTLS/CA policies) to give customers fine-grained control over their applications.
  • Extend and optimize endpoint services that provide reliability and observability for developers.
  • Partner with product, platform, and security teams to ensure traffic management is robust, scalable, and enterprise-ready.
  • Write clean, high-quality, well-tested code and participate in thoughtful design/code reviews.
  • Investigate and resolve production issues across distributed systems.
  • Continuously improve the developer experience—simplifying how teams configure, secure, and scale their traffic.
  • Contribute to the evolution of shared infrastructure, tools, and libraries across ngrok.
You Are a Good Fit If You…
  • Have 3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++.
  • Understand networking and distributed systems fundamentals (protocols, TLS/mTLS, proxies, load balancers, traffic shaping).
  • Have experience building AI gateways, working with LLMs or AI/ML service traffic.
  • Are motivated by building scalable, performant systems that developers love to use.
  • Enjoy working at the intersection of infrastructure, security, and developer tooling/experience.
  • Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability.
Compensation

Senior Software Engineer

  • Tier 1 (SF, LA, Seattle, NYC): $180,000 – $225,000
  • Tier 2 (rest of US): $165,600 – $207,000

Software Engineer III

  • Tier 1 (SF, LA, Seattle, NYC): $160,000 – $200,000
  • Tier 2 (rest of US): $147,200 – $184,000

Job level and actual compensation will be evaluated based on factors including, but not limited to, qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), internal equity with other team members, market data, and specific work location. We provide an attractive mix of salary and equity.

 

#LI-Remote

-----

All candidates must be US-based, and legally authorized to work in the United States.

If your experience is close but doesn’t fulfill all requirements, please apply. ngrok is on a mission to build a special company. To achieve our goal, we are focused on hiring people with different backgrounds, perspectives, and experiences!

Benefits

Compensation for this role depends on level, but we provide a competitive mix of salary and equity.

We provide a 401(k) with a 100% match up to 3% of your salary and a 50% match up to another 2%.

We provide healthcare, dental, and vision with premiums fully covered on the base plan for employees. Half of premiums are covered for dependents.

We offer unlimited PTO and a culture in which the overwhelming majority of employees take more than four weeks. Your manager is also on the hook for encouraging you to do the same.

Top Skills

C
C++
Go
Java
Mtls
Rust
Tls

Similar Jobs

27 Minutes Ago
Remote or Hybrid
United States
64K-196K Annually
Junior
64K-196K Annually
Junior
Agency • Artificial Intelligence • Mobile • Software • Consulting • Design
The Senior Product Manager leads teams in creating and launching digital products, applying project management skills to meet business objectives and user needs.
Top Skills: Gaming PlatformsMobile DevelopmentWeb Development
48 Minutes Ago
Remote or Hybrid
United States
150K-200K Annually
Senior level
150K-200K Annually
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Director of Product will lead the PL Rating product, overseeing vision, roadmap, and team management while driving innovative solutions for customer needs in the B2B SaaS industry.
Top Skills: AmplitudeBigQueryJIRAMicrosoft Office SuitePendoSaaSSmartsheetSnowflake
48 Minutes Ago
Remote or Hybrid
2 Locations
60K-120K Annually
Senior level
60K-120K Annually
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
As a Software Engineer, you will develop and maintain web applications, enhance software quality through design, testing, and collaboration in a remote team environment, using modern technologies.
Top Skills: APIsCi/CdGoGCPJavaScriptKubernetesNode.jsPostgresReactRestful ServicesSQL ServerTypescriptVisual Studio

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account