Pepper Auditors Logo

Pepper Auditors

Principal Software Engineer, AI

Posted 3 Months Ago
In-Office or Remote
Hiring Remotely in United States
180K-230K Annually
Expert/Leader
In-Office or Remote
Hiring Remotely in United States
180K-230K Annually
Expert/Leader
Build and scale an AI-powered audit workbench that transforms raw evidence into reviewable workpapers. Responsibilities include designing ingestion and extraction pipelines, deterministic recomputation and exception detection, workpaper generation, evaluation infrastructure, and frontend review tools. The role emphasizes production LLM reliability, golden-dataset evaluations, schema design, traceability, deterministic regulatory logic, structured human review, and end-to-end system ownership in a regulated domain.
The summary above was generated by AI

About Pepper Auditors

Pepper's mission is to protect the integrity of every American's employee benefit plan. We are a fast-growing team of technologists and CPAs working to build a modern audit firm that can serve as the fulfillment engine for federally mandated compliance work streams.

The Role

We’re looking for an experienced software engineer to help build and scale our audit workbench; a pipeline-based harness — not a generic agent loop — that takes an engagement from raw evidence to reviewable workpaper. As of today that looks roughly like:

  • Ingestion and extraction

  • Recomputation and exception detection

  • Workpaper generation

  • Eval infrastrcuture

  • Frontend review surface

As one of the first engineering hires, you will help set the technical direction to ensure our audit wokrbench is usable and scalable from our our first 100 clients to our next 10,000.

The hard part

Most "build an AI agent" roles optimize for demo velocity. This one optimizes for a number a CPA stakes their license on. The reliability of this system comes from schema design, deterministic rule logic, validation, and structured human review — not from hoping the model is good. You'll spend as much time on the deterministic-versus-stochastic boundary, eval harnesses, and traceability as on prompts and orchestration. The model does extraction and narrative drafting; the math and the regulatory logic are exact code. If "build something auditable, reproducible, and provably correct in a regulated domain" is more interesting to you than "ship a chatbot," you'll like it here.

You're a strong fit if you

  • Have shipped production LLM systems where correctness mattered — extraction pipelines, agentic workflows, or document-understanding systems — ideally in a domain with real consequences (fintech, legal, healthcare, regtech).

  • Build evals as a reflex. You've maintained golden datasets and caught regressions before they reached users, and you treat "we can't measure whether this got better" as an unacceptable state.

  • Have strong judgment about where to use a model and where to write a deterministic function — with a hard bias toward the latter when dollars or compliance are on the line.

  • Are a genuine 0→1 builder — you can own a system end-to-end, ship it, and operate it in production. You're energized, not unsettled, by being the second engineer in the building.

  • Treat engineering hygiene as default, not overhead.


Nice to haves

  • Familiarity with accounting, audit, ERISA, 401(k) administration, or financial document processing. You do not need audit experience. Our partner CPAs own the domain end-to-end, and the regulatory logic lives in versioned, deterministic code you'll help build.

  • Layout-aware / OCR extraction, retrieval systems, or structured-output generation.

  • Experience building internal tools or review-and-approval UIs.

Logistics

  • Compensation: Estimated $180,000–$230,000 base + equity

  • Location: Remote-first (U.S.).¹ Columbus, Ohio is a plus but not required.

  • Reporting: Directly to the founding team, partnering closely with our partner CPAs on domain and review standards.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

Pepper Auditors Denver, Colorado, USA Office

Denver, United States

Similar Jobs

Yesterday
Remote
2 Locations
165K-291K Annually
Expert/Leader
165K-291K Annually
Expert/Leader
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
Designs and builds agentic AI solutions integrated with Genesys Cloud. Develops scalable Go backend services, JavaScript and TypeScript front-end components, and cloud-native applications on AWS and Kubernetes. Responsibilities include RAG and MCP integrations, prompt engineering, API design, performance optimization, production troubleshooting, code reviews, collaboration with cross-functional teams, and mentoring junior engineers.
Top Skills: Agentic AiAmazon DynamodbAmazon Ec2Amazon EcsAmazon EksAmazon S3AWSAws CloudformationAws FargateAws LambdaAws Step FunctionsCi/CdDockerGenesys Cloud ApisGoJavaScriptKubernetesMcp FrameworkMicroservicesRagRag PipelinesRestful ApisTerraformTypescript
2 Days Ago
Remote
United States
194K-263K Annually
Entry level
194K-263K Annually
Entry level
Edtech
Set technical direction for AI platform foundations, including agent infrastructure, safeguards, observability, access controls, reliability, and adoption. Build internal products that enable teams across engineering, product, and design to use AI agents safely and effectively. Remove manual processes, accelerate delivery, establish shared standards, mentor engineers, and teach teams to direct and evaluate agent output.
Top Skills: AWSClaude CodeCodexCursorHosted Large Language ModelsKotlinKubernetesPostgresPythonReactRedisRuby On RailsSwiftTypescript
3 Days Ago
In-Office or Remote
Boulder, CO, USA
241K-417K Annually
Expert/Leader
241K-417K Annually
Expert/Leader
Cloud • Information Technology • Internet of Things • Professional Services • Software
Lead the technical direction for production-grade agentic AI systems in Splunk Observability Cloud. Architect evaluation frameworks, retrieval and context pipelines, and secure, efficient AI agents that investigate incidents across metrics, traces, logs, and infrastructure. Establish standards for latency, cost, security, and autonomous remediation while mentoring engineers, collaborating with architects, and translating AI research into reliable product features.
Top Skills: Agentic Ai SystemsAi/Ml Evaluation FrameworksCloud-Native InfrastructureDistributed TracingKubernetesLarge Language Models (Llms)LogsMcpOpentelemetryRetrieval PipelinesTelemetry DataTime-Series Databases

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account