Spear AI Logo

Spear AI

Data Engineer (Senior)

Posted Yesterday
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
The Data Engineer will implement real-time and offline data pipelines, parse binary formats, design data models, and improve CI/CD processes, contributing to cutting-edge defense technology projects.
The summary above was generated by AI

We’re seeking a skilled Data Engineer to build the next-generation data management and artificial intelligence platform for maritime domain awareness.
Spear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support our nation’s security. As we expand, we’re building a culture where innovation meets mission-critical work. We operate with a flat organizational structure that empowers every team member to make an impact, collaborate directly with leadership, and contribute to projects that matter. Whether you’re joining our Hardware, Software, or Services division, you’ll work alongside talented professionals who are committed to excellence and advancing the capabilities that keep our nation safe and secure.
Spear AI builds sonobuoy sensors that are deployed into the water and collect edge data. We also work with the U.S. Navy to collect and process their SONAR data. You’ll have an opportunity to work on real-world projects that directly impact warfighter capabilities and mission success.

What you’ll do

We’re a small team wearing many hats, and you’d have a wide variety of responsibilities that include:

  • Implement real-time data pipelines with MQTT and Redpanda for stream processing.

  • Implement offline data pipelines using Dagster for batch processing.

  • Parse and process binary message formats from various data sources.

  • Build data warehouses using Postgres, Apache Iceberg, Parquet, and S3.

  • Design data models that allow for high-performance queries.

  • Validate and normalize data sources.

  • Improve local development and CI/CD using modern tooling and GitHub Actions.

Who you are

We’re looking for someone with strong Software Engineering skills who shares our most important values:

  • You’re fanatical about polish. Every detail matters. You love to make sure your code is linted, formatted, fully typed, and has 100% test coverage.

  • You care about correctness. You take pride in the fact that downstream consumers trust libraries and services you build.

  • You obsess over performance. You daydream about Lighthouse scores and query speed.

  • You dive deep. It’s important for you to really know how things work. You’re always building prototypes and setting up experiments to reinforce your understanding.

  • You live on the bleeding edge. You’ve got a long list of upcoming platform features you’re excited about and can’t wait for the next nightly to drop.

  • You’re a great teacher. You know how to break down a concept for a specific audience and make it click with them in a way that gets them excited.

Why work with us
  • We ship — We don’t work on 18-month projects that are irrelevant before they’re even finished.

  • Our work has impact — We build products that are deployed to U.S. submarines and integrate with the sonobuoys we manufacture.

  • We’re growing responsibly — We have the resources to hire a lot more people, but we don’t want to build a massive team of people who don’t share our values.

  • We’re remote — Work from wherever you want. We collaborate in real time on Slack or asynchronously via GitHub.

  • We’re profitable — We aren’t burning through cash trying to make the business work. But we also have investors who believe in us and are committed to our success.

  • We care about doing great work — You don’t need permission to sweat the details here.

  • We don’t take ourselves too seriously — We’re building products that make the world safer. But we don’t let that get to our heads.

Important skills
  • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.)

  • Proficiency in Python and Rust for data engineering workflows.

  • Experience with binary message parsing.

  • Experience with row-based & columnar-based data formats.

  • Experience with OLTP & OLAP databases.

  • Knowledge of distributed systems, streaming architectures, and batch processing patterns.

  • Hands-on experience with a batch orchestrator such as Dagster/Airflow.

  • Hands-on experience with a streaming platform such as Redpanda/Kafka.

  • Hands-on experience with binary message formats such as Protobuf.

Nice to have
  • Experience with IoT devices and sensors.

  • Digital signal processing experience.

  • Geospatial analysis and GIS experience.

  • Familiar with working in monorepos.

What we offer
  • Unlimited PTO — Take the time you need to recharge and maintain work-life balance.

  • Dedicated sick time — Your health and well-being come first.

  • Comprehensive health and benefits – Medical, dental, and vision coverage to keep you and your family protected.

  • 11 Paid Holidays — Enjoy time off throughout the year to celebrate and spend time with loved ones.

  • Professional development — Educational opportunities and resources to help you grow your skills and advance your career.

  • Collaborative environment — Work directly with leadership in our flat organizational structure, where your ideas and contributions matter.

  • Mission-driven work — Contribute to projects that directly support national security and make a real-world impact.

  • Growth opportunities — Join us during an exciting expansion phase where you can help shape our future.

Additional benefit opportunities when you choose Spear AI:
  • 401(k) with company match.

  • Onsite / Remote / Flexible work arrangements or hybrid options (position dependent).

  • Relocation assistance (position dependent).

  • Referral bonuses.

  • Performance bonuses.

  • Life insurance and disability coverage.

  • Technology home office setup stipend.

  • Professional certification reimbursement (position dependent).


We offer competitive compensation tailored to your experience, location, and the impact you’ll make. We’re committed to equitable pay and will share a range aligned to your level and geography during the hiring process. In accordance with state law, candidates in jurisdictions such as CA, CO, WA, NY, and others, where applicable, will be provided a good-faith salary range upon request and throughout the hiring process. This is a full-time, exempt position under the Fair Labor Standards Act (FLSA) and is not eligible for overtime pay.
Compensation for this position is provided on a salaried basis and is not subject to reduction based on hours worked. At Spear AI, you’ll find more than just a job; you’ll join a mission-driven team where your work directly contributes to national security. Our flat organizational structure means your voice matters, your ideas reach leadership, and your impact is visible. As we grow, we’re committed to building robust processes and infrastructure that support both our mission and our people. We value collaboration, continuous improvement, and the expertise each team member brings to the table. If you’re looking for a place to grow professionally while working on projects that truly matter, we’d love to hear from you.

Top Skills

Apache Iceberg
Dagster
Github Actions
Mqtt
Parquet
Postgres
Protobuf
Python
Redpanda
Rust
S3

Similar Jobs

Yesterday
Easy Apply
Remote
USA
Easy Apply
254K-299K Annually
Senior level
254K-299K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead the technical strategy for Coinbase's Data Platform, architecting data systems for AI/ML workloads and ensuring data reliability, performance, and cross-functional alignment.
Top Skills: AIData EngineeringData LakesDatabricksDistributed SystemsKafkaMlSnowflake
Yesterday
Remote or Hybrid
New York, NY, USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves designing data pipelines, developing metrics and visualizations, collaborating with teams to track product KPIs, and ensuring data integrity within a cybersecurity environment.
Top Skills: AirflowAWSAzureCassandraDbtElasticsearchETLGoGCPKafkaOracle CloudPostgresPythonRedisSQLTableau
Yesterday
Remote or Hybrid
New Jersey, USA
95K-115K Annually
Senior level
95K-115K Annually
Senior level
Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
The role involves designing and maintaining ETL/ELT pipelines, integrating diverse data sources, automating Fabric environments, and collaborating with global teams on data solutions.
Top Skills: .Net CoreSparkC#Cosmos DbDynamoDBFabricMariadbMongoDBMySQLPowershellPythonRest ApisSQL Server

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account