Principal Software AI Architect

At Mitratech, we are a team of innovators focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.

For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.

As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!

We are looking for a senior AI specialist to float across multiple product engineering teams and lead the design and implementation of AI features for our SaaS applications. This role will partner with full-stack and platform teams to turn product ideas into robust AI-powered capabilities using LLMs, RAG, agents, and ML pipelines.

• Act as the cross-team expert for LLM and agent-based features across several agile product teams.
• Translate product requirements into end-to-end AI solution designs (models, data, APIs, orchestration, guardrails).
• Design and guide implementation of agentic workflows (e.g., LangChain, AWS Agentcore) integrating with our SaaS APIs and services.
• Architect and oversee RAG pipelines using both unstructured and structured data; define retrieval, embedding, and evaluation strategies.
• Leverage AWS Bedrock and related cloud services to deliver secure, scalable, and cost-effective AI features.
• Embed within multiple agile teams and pair with engineers to review designs, write reference implementations, and ensure high-quality production code.
• Define and promote AI architecture patterns and reusable components that can be adopted across teams.
• Establish and improve observability and evaluation for AI features (logging, metrics, feedback loops, offline/online tests).
• Implement safety, privacy, and compliance practices: guardrails, prompt and output filtering, data isolation, and auditability.
• Coach engineering and product teams on when and how to use AI, run design reviews, and serve as a subject matter expert.
• Maintain internal playbooks, templates, and examples for LLM, agent, and RAG-based solutions.

• 10+ years in software engineering for SaaS or distributed systems.
• 3–5+ years building and shipping production AI/ML or LLM-based features (not just prototypes).
• Prior experience operating at Staff or Principal Engineer / Architect level or equivalent impact across multiple teams.
• Strong hands-on experience with:
• LLMs and agent frameworks (e.g., LangChain, AWS Agentcore, or similar orchestration frameworks).
• RAG architectures (chunking, embeddings, vector stores, retrieval optimization).
• Cloud platforms, ideally AWS (including Bedrock or equivalent managed LLM platforms).
• Proficiency in at least one major back-end language (e.g., Python, Java) and familiarity with modern front-end frameworks (e.g., React).
• Solid understanding of ML fundamentals relevant to product features (embeddings, classification, ranking, anomaly detection).
• Demonstrated ability to:
• Own solution design from idea to production.
• Work within multi-tenant SaaS constraints (security, isolation, access control).
• Balance trade-offs between accuracy, latency, cost, and complexity.

Mitratech remains committed to equitable and transparent pay practices. Final base salary offered may vary from the range listed and will be determined after carefully considering multiple factors during the hiring process, including location, relevant experience and education, required competencies and skill proficiency level, and review of internal equity. We encourage candidates to apply even if they may not meet all listed requirements.
This role can be performed 100% remote anywhere in the US. Anticipated Pay Range: $220k - 250k Annually USD

Total compensation includes US employee benefits and annual bonus eligibility.
Benefits we offer:

• Health, Dental & Vision Insurance
• 401 (k) + Employer Match
• Unlimited PTO + 11 Paid Holidays + 4 Annual Paid Global Wellness Days Off
• STD, LTD & Group Life Insurance
• Paid Parental Leave
• Pet Insurance
• FSA & HSA Options
• Employee Assistance Program

Perks we offer:

• Remote Work
• Career Advancement & Professional Development Opportunities 
• Employee Recognition
• LinkedIn Learning Platform

Mitratech is proud to be an EEOE, M/F/D/V, and we are committed to diversity both in practice and spirit at the corporate level. Mitratech participates in the Electronic Employment Verification Program. E-Verify is an Internet-based system that compares information from an employee’s I-9 to data from the U.S. Department of Homeland Security and Social Security Administration Records. To learn more, visit: everify.com

We are an equal-opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status.