Hut 8 Logo

Hut 8

Principal AI Systems Engineer - Highrise AI

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in USA
Expert/Leader
Remote
Hiring Remotely in USA
Expert/Leader
Designs, deploys, integrates, validates, and operates infrastructure supporting large-scale AI compute clusters. Responsibilities include Linux systems, virtualization, storage, identity and security services, infrastructure automation, provisioning, testing, production acceptance, Tier 3 escalation, troubleshooting, reliability optimization, and lifecycle management. The role collaborates with engineering teams, vendors, NOC personnel, SREs, and data center technicians across multiple sites, including travel for commissioning and complex troubleshooting.
The summary above was generated by AI


About Highrise AI 

Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers and enterprises operating in performance-critical and security-sensitive environments, Highrise delivers scalable GPU compute across dedicated clusters, managed cloud, and confidential environments. 

Highrise combines bare-metal performance with full-stack orchestration, API-driven access, and hardware-enforced isolation to support training, fine-tuning, and production-scale deployment of AI models. From reserved GPU capacity to enterprise-grade confidential compute, Highrise provides flexible infrastructure models tailored to the needs of builders operating at scale. 

Beyond infrastructure, Highrise integrates disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable performance across deployments. These capabilities extend beyond Highrise-owned fleets: through managed services, Highrise also operates third-party GPU hardware on behalf of customers and partners, applying the same operational standards to infrastructure it does not own. 

Highrise is a subsidiary of Hut 8 Corp., an energy infrastructure platform. Hut 8 integrates power, digital infrastructure, and compute at scale. Highrise serves as the compute and operations layer—designing, deploying, and operating next-generation GPU clusters from commissioning through production. 

ROLE OVERVIEW 

We are seeking a principal-level, hands-on AI Systems Engineer to design, deploy, integrate, and operate the supporting infrastructure required for large-scale AI compute clusters. Working alongside senior compute, networking, and infrastructure engineers, this person will lead the deployment and configuration of general-purpose compute, virtualization, high-performance storage, infrastructure services, identity management, and security platforms. 

The engineer will be responsible for bringing these systems from initial installation through integration, validation, and production acceptance. Following deployment, this person will provide Tier 3 technical escalation, advanced troubleshooting, and ongoing optimization of production infrastructure. 

KEY RESPONSIBILITIES 

Systems Infrastructure Deployment and Integration 

  • Lead deployment and configuration of general-purpose x86 servers, Linux operating systems, virtualization platforms, and supporting infrastructure services. 
  • Design, deploy, and manage virtualized infrastructure using VMware, KVM, Proxmox, or equivalent technologies. 
  • Implement and maintain automated bare-metal provisioning, imaging, firmware management, and configuration workflows. 
  • Deploy and integrate core infrastructure services, including DNS, DHCP, NTP, IPAM, and DCIM platforms such as Infoblox and NetBox. 
  • Establish standardized configurations, infrastructure baselines, and scalable deployment procedures across multiple AI cluster environments. 

Storage Infrastructure and Performance 

  • Deploy, configure, and optimize high-performance storage platforms, including WEKA, VAST Data, and other distributed storage solutions. 
  • Implement and manage file, object, and block storage services, including NFS and S3-compatible interfaces. 
  • Validate storage availability, performance, capacity, resilience, and integration with GPU compute environments. 
  • Troubleshoot storage performance bottlenecks, connectivity issues, filesystem errors, and distributed storage failures. 
  • Coordinate with storage vendors and engineering teams on deployment, acceptance testing, upgrades, and performance optimization. 

Identity, Security, and Infrastructure Automation 

  • Deploy and maintain identity and access management services, including Active Directory/LDAP, SSO, SAML/OIDC, and role-based access control (RBAC). 
  • Integrate security and compliance infrastructure, including firewalls, access gateways, vulnerability scanning, logging, and audit systems. 
  • Implement automated provisioning, configuration management, and infrastructure-as-code solutions using Ansible, Terraform, Python, or equivalent tools. 
  • Establish secure administrative access, authentication, authorization, and privileged access management across infrastructure platforms. 
  • Partner with security and compliance teams to implement infrastructure controls, system hardening, access policies, and audit requirements. 

Systems Validation and Production Acceptance 

  • Lead integration testing and operational acceptance of supporting infrastructure prior to commercial cluster deployment. 
  • Validate system availability, redundancy, failover, service dependencies, performance, and recovery procedures. 
  • Identify and remediate configuration inconsistencies, integration issues, and infrastructure reliability risks. 
  • Develop acceptance criteria, testing procedures, operational documentation, and production handoff requirements. 

Tier 3 Operations and Reliability 

  • Serve as a senior technical escalation point for complex production incidents involving systems, virtualization, storage, identity, and infrastructure services. 
  • Perform advanced troubleshooting, root cause analysis, and corrective action planning for recurring or systemic failures. 
  • Support infrastructure upgrades, maintenance, capacity expansion, and lifecycle management with appropriate change controls. 
  • Develop diagnostic tooling, automation, operational runbooks, and monitoring standards to improve reliability and reduce operational overhead. 
  • Collaborate with NOC, SRE, data hall technicians, engineering teams, and external vendors to resolve critical infrastructure issues. 

ABOUT YOU 

Education and Experience 

  • Bachelor's degree in computer science, engineering, information technology, or related discipline, or equivalent practical experience. 
  • 10+ years of hands-on experience engineering and operating enterprise, cloud, HPC, or large-scale data center infrastructure. 
  • Expert-level Linux systems administration, troubleshooting, automation, and infrastructure integration experience. 
  • Strong experience with enterprise x86 platforms, virtualization technologies, and automated provisioning solutions. 
  • Hands-on experience deploying and supporting high-performance or distributed storage platforms, preferably WEKA or VAST Data. 
  • Strong understanding of DNS, DHCP, IPAM, identity management, SSO, RBAC, and core infrastructure services. 
  • Experience with infrastructure automation using Python, Bash, Ansible, Terraform, or equivalent technologies. 
  • Familiarity with security infrastructure, compliance requirements, monitoring, and enterprise authentication systems. 
  • Experience supporting AI/HPC clusters, GPU infrastructure, or large-scale distributed computing environments is highly desirable. 

Core Competencies 

  • Expert-level troubleshooting and problem-solving across hardware, operating systems, virtualization, storage, and infrastructure services. 
  • Strong ownership of deployment outcomes, operational reliability, system performance, and technical documentation. 
  • Ability to independently design and implement complex infrastructure solutions while collaborating with senior engineering peers. 
  • Highly analytical, detail-oriented, and comfortable operating in fast-paced, mission-critical environments. 
  • Excellent written and verbal communication skills with engineering leadership, vendors, and operational stakeholders. 
  • Continuous improvement mindset with a strong emphasis on automation, standardization, and operational efficiency. 

ABOUT THE WORK ENVIRONMENT 

This is a full-time, engineering role supporting large-scale AI compute infrastructure across multiple sites. Travel to data centers for cluster commissioning, acceptance, and complex troubleshooting will be required. Flexibility to assist with critical incidents or maintenance activities outside regular business hours is expected. This role is hybrid or remote depending on location. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. 

WHAT MAKES HIGHRISE A GREAT PLACE TO WORK 

At Highrise, you will directly influence the performance, reliability, and production readiness of large-scale AI clusters, work alongside experienced infrastructure engineers, and help define the technical standards for a growing global AI infrastructure platform. 

At Highrise, you will have the opportunity to: 

  • Work with bright, driven peers from a range of educational and professional backgrounds including software development, energy, engineering, entrepreneurship, investment banking, private equity, and management consulting 
  • Design and pitch new products, services, and other initiatives to a leadership team consisting of serial entrepreneurs and seasoned executives and backed by a board of directors consisting of industry veterans of energy, finance, and government 
  • Debate ideas and alternatives in a truly meritocratic setting where the learning curve is steep and the lessons come from both senior and junior members of the team 
  • Build a lifelong network of friends and professional connections at the cutting-edge intersection of technology, energy, and infrastructure 

 

Similar Jobs

2 Hours Ago
Remote or Hybrid
245K-391K Annually
Expert/Leader
245K-391K Annually
Expert/Leader
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Owns Mastercard’s relationship with a major commercial issuer, advising senior client leaders on portfolio growth, economics, and strategy. Leads initiatives across spend, acquisition, engagement, cobranded portfolios, negotiations, and integrated product solutions. Translates payment and customer data into actionable insights, coordinates cross-functional teams, and builds trusted relationships across Mastercard and client organizations.
2 Hours Ago
Remote or Hybrid
130K-254K Annually
Senior level
130K-254K Annually
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Drive development and roadmap delivery for Mastercard’s commerce media and AdTech products. Own product concepts, requirements, prioritization, milestones, features, and workflows across advertiser solutions, campaign automation, creative decisioning, offers optimization, audiences, and identity resolution. Partner with Engineering, Design, Data Science, Sales, Legal, Privacy, and global stakeholders to translate strategy into products, support go-to-market initiatives, develop business cases, conduct research, and mentor junior product managers.
Top Skills: AdtechArtificial IntelligenceCtvData ScienceDigital Buy-Side And Sell-Side TechnologiesIdentity ResolutionJIRAMachine LearningMartechMonday.ComProgrammatic AdvertisingSocial AdvertisingVideo Advertising
2 Hours Ago
Remote or Hybrid
130K-254K Annually
Senior level
130K-254K Annually
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead product development for Commerce Media advertiser solutions: define strategy and roadmap, write requirements, prioritize milestones, partner with engineering, CX&D and Data Science, drive GTM support, influence cross-functional stakeholders, mentor junior PMs, and deliver new features and optimizations (automation, creative decisioning, campaign and offers workflows).
Top Skills: AdtechCard Linked OffersCtvJIRAMartechMl/AiMonday.ComProgrammatic

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account