Designs, deploys, governs, and supports enterprise Databricks platforms across AWS Commercial and GovCloud environments. Responsibilities include Terraform-based workspace deployment, AWS networking, Unity Catalog administration, CI/CD automation, security and governance controls, platform monitoring, cost optimization, incident escalation, and stakeholder guidance. Requires extensive Databricks administration, AWS infrastructure, infrastructure-as-code, Python, Linux, and federal security environment experience.
This is a remote position.
Location: Remote – United States
Security Clearance: Active Secret or higher REQUIRED
Our client, a growing technology services organization supporting federal government programs, is seeking an experienced Senior Databricks Platform Engineer / Administrator to help design, deploy, govern, and support enterprise Databricks environments for a federal client.
Candidates must currently hold an ACTIVE Secret security clearance or higher. Candidates without an active Secret-level clearance cannot be considered.
The ideal candidate will bring deep hands-on experience building and administering Databricks platforms, particularly within AWS environments, with strong expertise in infrastructure automation, networking, governance, security, CI/CD, and platform operations.
- Deploy and configure Databricks workspaces from the ground up using Terraform and Databricks Secure Reference Architecture across development, test, and production environments.
- Support Databricks deployments within AWS Commercial and AWS GovCloud environments.
- Design and implement supporting AWS networking architecture, including VPCs, subnets, PrivateLink, Transit Gateway, security groups, and DNS.
- Manage Databricks control-plane and data-plane connectivity.
- Administer Unity Catalog, including metastores, catalogs, schemas, external locations, permissions, grants, and row- and column-level security.
- Build and maintain CI/CD pipelines supporting infrastructure deployment and Databricks Asset Bundles.
- Establish platform governance standards, architectural guardrails, tagging strategies, naming conventions, and operating best practices.
- Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM integrations.
- Monitor platform health, utilization, performance, and cost.
- Identify opportunities for rightsizing, cost optimization, and improved platform efficiency.
- Serve as an escalation point for platform incidents, troubleshooting, and root-cause analysis.
- Partner with technical and business stakeholders to provide guidance on platform architecture, governance, security, and operational decisions.
Requirements
- Active Secret security clearance or higher is required.
- U.S. citizenship required.
- 6+ years of experience engineering, administering, or supporting Databricks platforms.
- Strong hands-on experience with Databricks in AWS environments.
- Advanced Terraform experience supporting infrastructure such as networking, IAM, compute, and storage.
- Strong knowledge of Databricks Secure Reference Architecture.
- Hands-on Unity Catalog administration experience.
- Experience with Databricks Asset Bundles or comparable deployment automation frameworks.
- Strong understanding of CI/CD practices and infrastructure-as-code methodologies.
- Python proficiency.
- Linux systems administration experience.
- Hands-on experience with AWS services including:
- VPC
- IAM
- S3
- KMS
- EC2
- CloudWatch
- VPC
- Strong troubleshooting and root-cause analysis capabilities.
- Strong communication skills with the ability to advise stakeholders on technical and platform decisions.
- AWS GovCloud experience.
- Experience working within regulated, security-sensitive, or compliance-heavy environments.
- Experience supporting FISMA High, FedRAMP High, or comparable federal security standards.
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Acts as the GVP of Moveworks Sales’ strategic partner and senior operator, owning sales operating metrics, specialist productivity, territory design, sales plays, forecasting cadence, cross-functional dependencies, and executive narratives. Drives go-to-market execution, improves sales ramp, coordinates Product, Marketing, Enablement, and Customer Success commitments, and provides data-backed recommendations to senior leaders and board forums.
Top Skills:
AIEnterprise Software
Software • Defense
Lead international partnership execution across defense and operational markets. Activate commercial, technical, and delivery partner capabilities within customer opportunities, build repeatable partnership frameworks, and align with Growth, Sales, Product, Technical, and Finance teams. Analyze partner performance and market constraints, develop scaling business cases, and represent Onebrief with senior military, government, enterprise, and coalition stakeholders. The role requires extensive domestic and international travel and potential security clearance eligibility.
Top Skills:
ConfluenceHubspotJIRANotionOnebrief PlatformPartner Relationship Management (Prm) PlatformsSalesforceSlack
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Achieves investment sales objectives by supporting New York Life agents with annuity and mutual fund product expertise, case design, sales presentations, technical guidance, and product training. Builds relationships with agents and management, explains product enhancements and tax considerations, and provides individual and group sales support. Requires approximately five years of investment-product wholesaling experience, relevant FINRA registrations, a life license, and frequent travel of up to 80%.
Top Skills:
FinraSeries 6Series 63Series 7
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
