Role Title: App Security Expert
Role Type: Contract
Location: Remote
In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Required Skills: OSWE, LLM security, Ai-sast evaluation, Appsec, Agent security architecture
Scope of Work
Design and implement small, purpose-built application fixtures with embedded security vulnerabilities or secure solutions, specifically addressing OWASP LLM risks such as Sensitive Information Disclosure and Excessive Agency.
Develop deterministic test cases and security-context manifests to robustly assess application security posture.
Create detailed hidden answer keys to enable accurate AI or scanner evaluation of vulnerable versus secure code.
Evaluate and iterate on pipeline methodologies to ensure synthetic tasks and fixtures are challenging yet realistic for AppSec assessment.
Document technical insights and methodologies, ensuring clarity in written feedback and communication.
Collaborate through clear and thorough written and verbal communication to share findings and review peer contributions.
Engage with agent-based security architecture and contribute to continuous improvement of the evaluation pipeline.
Preferred Qualifications
Extensive experience (ideally 5+ years) in application security, secure software development, or CyberSWE roles.
Strong understanding of OSWE, LLM security, AI-powered static analysis (AI-SAST), and AppSec best practices.
Proven track record designing or evaluating security architecture for traditional and agent-based applications.
Expertise in building, securing, and testing application codebases, including identifying and remediating advanced vulnerabilities.
Exceptional written and verbal communication skills, with a focus on precise technical documentation and collaborative feedback.
Experience with synthetic security fixtures and deterministic testing approaches is highly desirable.
Demonstrated ability to deliver thoughtful insights and actionable security recommendations in a remote contribution context.
Similar Jobs
What you need to know about the Colorado Tech Scene
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute



