Evaluate and improve the safety, security, and robustness of large language models. Responsibilities include designing jailbreak, prompt injection, adversarial, and tool-use abuse tests; developing regression suites and evaluation frameworks; identifying vulnerabilities; translating findings into safety recommendations; and documenting methodologies and results for technical and non-technical stakeholders.
This role is for one of our clients
$50 - $90/hourpay
Role Title: AI Safety & Red Teaming Specialist
Role Type: Contractor
Location: Remote
We are looking for an experienced AI Safety & Red Teaming Specialist to help evaluate and strengthen the safety, security, and robustness of next-generation AI systems. In this role, you will leverage your expertise in adversarial AI, LLM security, and AI safety to identify vulnerabilities, design evaluation methodologies, and improve the resilience of large language models against real-world threats.
This opportunity is ideal for professionals passionate about AI security, ethical hacking, and developing robust evaluation frameworks for advanced AI systems.
RequirementsKey Responsibilities
- Design and implement advanced evaluation methodologies for AI system safety, including ethical jailbreak testing, prompt injection detection, LLM red teaming, and tool-use abuse scenarios.
- Develop cross-domain adversarial testing strategies to uncover complex, multi-turn attack patterns and model vulnerabilities.
- Build, maintain, and enhance regression test suites to continuously assess jailbreak susceptibility and prompt injection risks.
- Create comprehensive evaluation frameworks that simulate real-world adversarial threats to improve AI robustness and reliability.
- Collaborate with technical teams to translate security findings into actionable recommendations for AI safety improvements.
- Document testing methodologies, findings, and best practices through clear technical reports and presentations for both technical and non-technical stakeholders.
- 2+ years of experience in AI Safety, Adversarial Machine Learning, LLM Red Teaming, AI Security, or a related field.
- Hands-on experience researching, testing, or identifying vulnerabilities involving prompt injection, ethical jailbreaks, adversarial attacks, or tool-use exploitation.
- Strong understanding of modern LLM architectures, prompt engineering, and AI safety evaluation methodologies.
- Experience developing structured security assessments, regression testing frameworks, and adversarial evaluation strategies.
- Excellent analytical, documentation, and communication skills with the ability to explain complex technical findings clearly.
- Ability to collaborate effectively within cross-functional technical teams.
- Master's or PhD in Computer Science, Cybersecurity, Machine Learning, Artificial Intelligence, or a related discipline.
- Contributions to AI security research, open-source AI safety tools, conference presentations, or published research.
- Experience with AI model evaluation frameworks, prompt engineering techniques, and AI security assessment tools.
- Background in multidisciplinary AI safety, cybersecurity, or adversarial machine learning projects.
- AI Safety
- LLM Red Teaming
- Prompt Injection
- Adversarial Machine Learning
- Ethical Jailbreaking
- AI Security
- Prompt Engineering
- AI Evaluation Frameworks
Similar Jobs
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Own semiconductor backend packaging assembly process development, optimization, and new product introduction. Define process records, windows, specifications, and capability targets while applying DOE, SPC, Six Sigma, FMEA, RCA, and structured problem solving to improve yield, reliability, cost, and process margins. Use MES, manufacturing data, analytics, and AI/ML for predictive control and anomaly detection. Introduce new materials and equipment, lead cross-functional execution, and coach process teams in a high-volume manufacturing environment.
Top Skills:
Ai/MlIndustry 4.0JmpMesPythonSemiconductor Packaging AssemblySQL
Security • Cybersecurity
Own global revenue recognition under ASC 606 and accounting processes including commissions, COGS, and leases. Review tax provisions, returns, transfer pricing, and subsidiary filings; support external audits and cross-functional reporting. Lead accounting projects, process improvements, and AI-driven workflow automation. Requires a CA, Big 4 high-tech experience, strong US GAAP and revenue recognition knowledge, ERP experience, advanced Excel skills, and excellent communication.
Top Skills:
Ai Automation ToolsAsc 340-40Asc 606ExcelMS OfficeNetSuiteUs Gaap
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Designs and deploys production AI assistants, copilots, agents, RAG systems, and intelligent automations. Integrates LLMs with Snowflake, AWS, enterprise applications, and workflow platforms to automate business processes. Builds backend services and serverless workflows, implements observability and responsible AI controls, and scales validated prototypes into reliable production solutions. Partners with technical and business teams to improve decision-making, efficiency, quality, and cost performance.
Top Skills:
AirflowAmazon Api GatewayAmazon BedrockAmazon EventbridgeAmazon S3Amazon SagemakerAnthropicAws LambdaAws Step FunctionsAzure OpenaiDbtGeminiGoMcpMicrosoft Power AutomateMlflowN8NOauthOpenaiPythonRbacSalesforceServicenowSnowflakeSnowflake Cortex SearchSnowflake Ml RegistrySnowparkSsoTypescriptUipathWeights & BiasesWorkato
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
