Develop and maintain automated UI and API testing for Vena’s agentic AI products. Define functional, integration, performance, exploratory, and regression strategies; validate AI model accuracy, consistency, bias, boundaries, and performance; enhance scalable test frameworks and CI/CD pipelines; troubleshoot automation issues; perform root cause analysis; and collaborate with engineering and product teams to improve quality, reliability, and test coverage.
As a Senior Software Developer in Test, you will be responsible for the development, execution, and maintenance of automated tests to support the Software Test Life Cycle for Vena’s agentic AI solutions. You will collaborate closely with development and product teams to define and execute functional, integration, and regression testing strategies, while continuously improving the scalability, stability, and reliability of testing processes.
You will play a key role in defining and implementing testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality. Additionally, you will leverage Generative AI and modern AI tools to enhance test automation, streamline test case development, and improve testing efficiency and coverage.
How You'll Make an Impact
- Analyze functional and technical requirements to define comprehensive test strategies and automation needs
- Design, write, maintain, and manage automated UI and API test suites
- Contribute to building and enhancing scalable automation frameworks (e.g., Playwright, Rest-Assured)
- Identify, plan, and execute exploratory, functional, integration, performance, and regression tests
- Collaborate with development and product teams to validate testing requirements and optimize test coverage
- Champion best practices for automation, test data management, CI/CD integration, and code quality
- Monitor, troubleshoot, and optimize automation pipelines and test frameworks for dependability, scalability, and stability
- Perform root cause analysis and support teams in identifying and preventing defects
We'd Love to See
- 5+ years’ experience in QA/QE and test automation development roles, within a fast-paced Agile environment
- AI Testing Expertise: Proven track record testing AI/ML products (including prompt evaluation, bias detection, or model boundary testing)
- Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines to accelerate test execution and automatically detect flaky tests.
- Strong understanding of software testing methodologies, automation design patterns, and the fundamentals of high-quality test case development
- 3+ years of hands-on experience with at least one automation framework for both UI and API test automation (Playwright, Cypress, Selenium, RestAssured, RestSharp, Pytest, etc.)
- Hands-on experience with version control, issue tracking, and test case management tools (GitHub, Gitlab, JIRA, Xray, Zephyr, Qase, etc.)
- Proficiency with relational databases and data validation (SQL, MS SQL, Oracle, GraphQL, or DB2)
- Proficiency in one or more programming languages (Java, JavaScript, Typescript, C#, or Python)
- Ability to think critically about system architecture and assess the impact of product changes across components
- Strong troubleshooting, analytical, and problem-solving skills
- Exceptional written and verbal communication skills, with the ability to articulate both technical and non-technical concepts
- Interest in AI and willingness to explore AI-driven solutions to enhance performance and drive efficiencies
The base salary range for this role is $114,750-155,250 CAD.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
About
At Vena, we’re reimagining how businesses plan and grow: powered by data, collaboration, and innovation 🌱 Headquartered in Toronto with a global reach, we help finance teams work smarter using the tools they already love (yes, we’re talking about Excel!). Trusted by over 1,800 organizations and 150,000+ users every day, Vena Solutions brings clarity to complexity. We're a people led company that leads with our CORE values (Customer Trust, One Team, Respect & Authenticity and Execution Excellence) and are driven by our mission We’re growing fast, thinking big, and having fun along the way. The future of finance is being built here, and we’d love for you to be part of it 🚀Why Choose Us:💰 CompensationWe offer competitive and comprehensive total rewards packages that we review yearly to stay ahead of the market! Transparency is key, we keep you in the loop on how we design our comp programs. Build your future with our Employee Stock Option Program, Retirement Savings, Support & 401k Matching Programs.🎓 Personal Growth & LearningLevel up your skills with Vena! We support your journey with education subsidies, professional development programs, and learning opportunities to help you grow your career and reach your goals. Your future is bright and we’re here to invest in it!🧘♀️ Health & WellnessYour well-being = our priority! Great health & dental plans, wellness sessions (virtual & in-person), Employee Assistance Program (EAP), and a free Headspace subscription to support your mental health.🌍 Global ReachVena is everywhere you are! With offices in Toronto, London, and Indore, as well as team members across the United States, EMEA and beyond, we're a truly global company. Collaborate with colleagues around the world and bring diverse ideas to life: no passport required!🌴 Time OffRecharge with generous leave options - perfect for vacation, wellness, personal time, parental support, volunteering, and more.🏡 FlexibilityWe embrace a flexible culture that supports different ways of working, depending on the role and location. While some of our teams enjoy hybrid arrangements, others thrive in-office or remotely. With modern workspaces in Toronto, Indore, and London, we offer inspiring environments when you need them - and the freedom to work in ways that work best for you and your team.✨ AI-Powered InnovationAt Vena, we don’t just keep up, we're leading the way! 🚀We empower team members at every level to actively explore AI best practices, identify meaningful opportunities to apply AI in their work, and champion innovative solutions that drive impact.By fostering a culture of curiosity, innovation, and responsible use, we’re building a future where AI enhances how we work, think, and lead. From automating workflows to enhancing insights, AI is woven into everything we do.While every hiring decision is made by people, we may use AI to support application review.👉 Check us out:▶️YouTube💼 LinkedIn🔗GlassDoor* Vacancy Disclosure: Unless otherwise stated, all job postings on our careers site are for existing vacancies. Where explicitly stated, certain postings may be for anticipated vacancies that we expect to open in the near future.
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, build, and maintain customer-facing React frontend systems for search, catalog navigation, data lineage, dashboards, and AI-assisted analysis. Improve performance across large trees, tables, and streaming interfaces; shape product and UX decisions with design and product partners; raise engineering quality through reviews, documentation, complex bug resolution, and mentorship.
Top Skills:
Atlassian Design SystemCypressJavaScriptJestPlaywrightReactTypescript
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Principal Software Engineer responsible for owning customer-facing products end to end, leading technical strategy, architecting large-scale distributed systems, and delivering AI-native experiences. The role involves full-stack implementation, product strategy, system design, code reviews, reliability, testing, telemetry, security, performance, and mentoring engineers. Candidates must have extensive experience building and operating large-scale systems and strong product, UX, communication, and collaboration skills.
Top Skills:
Automated TestingDistributed SystemsProduction Telemetry
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and improve developer experience across large monorepos by leading framework and language migrations, dependency updates, build and CI improvements, automated refactoring, and agentic engineering workflows. The role identifies developer friction, creates safe automation and guardrails, partners with product engineering teams, measures impact, sets technical direction, and mentors engineers on tooling and codebase health.
Top Skills:
Ast-Based ToolingBazelBuckCi/CdCodemodsGradleLlm-Based Coding ToolsNxPants
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
