Arize AI Logo

Arize AI

Infrastructure Software Engineer, On Prem Deployments

Posted 16 Days Ago
Remote
160K-210K
Senior level
Remote
160K-210K
Senior level
The Infrastructure Engineer will design and implement deployment architectures, develop automation tools, and collaborate with customers to meet their on-premises infrastructure needs.
The summary above was generated by AI

The Opportunity

AI is rapidly transforming the world. Whether it’s developing the next generation of human-level intelligence, enhancing voice assistants, or enabling researchers to analyze genetic markers at scale, AI is increasingly integrated into various aspects of our daily lives.
Arize is the leading AI observability and Evaluation platform to help AI teams discover issues, diagnose problems, and improve the results of their AI Applications. We are here to build world class software that helps make AI applications work better.

As our On-Premises Infrastructure Engineer reporting to the Head of AI Infrastructure, you'll be instrumental in designing and implementing deployment architectures and software that bring Arize's powerful capabilities directly into our customers' environments. This is a unique opportunity to bridge the gap between cutting-edge AI observability and enterprise infrastructure requirements.

The Role

We're seeking an exceptional Infrastructure Engineer who can navigate complex enterprise environments and has a proven track record of building scalable on-premises solutions. You'll be a key player in our engineering organization, working directly with the CTO and customers to architect and implement solutions that enable seamless deployment of our platform across diverse customer environments.

We are a fully remote company with offices in Bay Area, NYC

What You’ll Work On

  • Design and implement robust deployment architectures that enable Arize to run efficiently in diverse customer environments, from air-gapped systems to hybrid cloud setups
  • Collaborate with customers to understand their infrastructure requirements and create tailored deployment solutions that meet their security, compliance, and performance needs
  • Develop and maintain automation tools and frameworks that streamline the deployment, upgrade, and maintenance processes for on-premises installations
  • Partner with the product team to ensure new features are compatible with on-premises deployments and create efficient release mechanisms
  • Create comprehensive monitoring and observability solutions that enable customers to maintain and troubleshoot their Arize installations effectively

What Will Set You Apart

  • 5+ years of experience in infrastructure engineering, with significant exposure to enterprise on-premises deployments
  • Deep expertise in container orchestration platforms (especially Kubernetes) and infrastructure-as-code tools like Terraform
  • Strong background in enterprise networking, security requirements, and compliance considerations
  • Experience working with multiple cloud providers (AWS, GCP, Azure) and understanding how to adapt cloud-native architectures for on-premises environments
  • Track record of building and maintaining automation tools that improve deployment reliability and reduce operational overhead
  • Excellent communication skills and ability to work directly with customers to understand and address their infrastructure needs
  • Experience with Python, Golang, and JavaScript is highly desirable

The estimated annual salary and variable compensation for this role is between $160,000 - $210,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.


More About Arize

Arize’s mission is to make the world’s AI work and work for the people. Our founders came together through a common frustration: investments in AI are growing rapidly across businesses and organizations of all types, yet it is incredibly difficult to understand why a machine learning model behaves the way it does after it is deployed into the real world.

Learn more about Arize in an interview with our founders: https://www.forbes.com/sites/frederickdaso/2020/09/01/arize-ai-helps-us-understand-how-ai-works/#322488d7753c


Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

Top Skills

AWS
Azure
GCP
Go
JavaScript
Kubernetes
Python
Terraform

Similar Jobs

An Hour Ago
Easy Apply
Remote
Hybrid
United States
Easy Apply
185K-200K
Expert/Leader
185K-200K
Expert/Leader
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Principal Software Engineer will lead technical and thought innovations for product features, mentor teams, and collaborate on system infrastructure and architecture, requiring a deep expertise in software and data technologies.
Top Skills: AerospikeApache AirflowApache LuigiAWSBashCi/CdDjangoDockerDynamoDBEmrFastapiHbaseHdfsHiveJavaKafkaKubernetesMySQLOpen Table FormatsPostgresPythonRedisScalaScyllaSnowflakeSparkTerraform
An Hour Ago
Remote
Hybrid
3 Locations
131K-211K Annually
Senior level
131K-211K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
A Senior Machine Learning Engineer will provide technical support for AI solutions, collaborate with product teams, assist in model development, and support frontend development using React.
Top Skills: AzureDatabricksDockerGitMlflowPythonReact
An Hour Ago
Remote
Hybrid
New York, NY, USA
105K-130K Annually
Mid level
105K-130K Annually
Mid level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
The Software Engineer develops new systems and solutions using AI capabilities, focusing on backend and frontend development, API integration, and collaboration with teams.
Top Skills: AWSNoSQLPythonRestful ApisSQL

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account