Web Quality Assurance Analyst

At Cro Metrics, we’re on a mission to redefine growth for organizations and brands through unparalleled digital experiences that inspire action and deliver results. With transformative experimentation as our guide, we bridge bold ideas with practical solutions to create lasting impact.

We are a growth optimization agency that partners with mission-driven and high-growth companies to scale through data-driven experimentation. Our expertise spans A/B testing, personalization, and full-funnel digital strategy—empowering clients to make smarter decisions that drive measurable results.

Our fully remote team of strategists, analysts, engineers, and designers works across industries including eCommerce, fintech, nonprofit, and hospitality. We believe in autonomy, collaboration, and innovation as we help our clients grow smarter and faster.

As a Web Quality Assurance Analyst for Cro Metrics, you will serve as a partner to a team of engineers, program managers, and growth strategists. You’ll be the last line of defense before an A/B test is launched on the client’s website for the world to experience. This is not a “check‑the‑box” QA tester role — you’ll need to be comfortable analyzing many different websites across a wide range of complexities, navigating the technical ins and outs of various web experimentation tools, and ensuring all issues are addressed before your final stamp of approval.

This Web QA position is also a launchpad into other paths at Cro Metrics, including Program Management and Growth Strategy. We invest heavily in teammates who show a strong desire to learn, stretch, and grow—pairing you with mentors and dedicating regular professional‑development time so you can chart your next step inside the organization.

Key Responsibilities

• Partnering closely with the Engineering and Account teams to interpret needs, implement A/B tests, and deliver timely results to clients.

• Manually performing cross browser, functional, visual, and smoke testing daily across a wide variety of websites, and diving deep into each A/B test to ensure reliable functionality of the web experimentation tools.

• Perform QA execution on all low or medium levels of complexity more independently with little to no guidance.

• Perform QA execution on higher levels of complexity, escalations, and troubleshooting with guidance from more senior team members. 

• Ensuring all A/B test issues are identified, understood, and resolved or addressed with the team through regular written check ins, video chats, and retrospectives.

• Documenting learnings and observations regularly to help disseminate information the team needs to succeed.

• Continuously expanding your experimentation knowledge through self‑study, mentorship, and cross‑functional collaboration.

This is a high communication role, and while no specific experience is required, it can get technical at times as you navigate and troubleshoot A/B tests, dev tools, web technologies, etc. You must be capable of learning new technical concepts quickly and regularly, and be able to communicate with both technical and non-technical stakeholders.

• Growth mindset — You’re motivated by curiosity, eager to acquire new skills, and view this role as the first step toward a longer career here (think Program Management or Growth Strategy).

• Empathy — You put yourself in the end user’s shoes, communicate with kindness, and collaborate effectively across disciplines.

• 1+ year quality assurance experience in a professional environment focused on websites or web application or 2+ years customer service experience or other experience in a high communication role. 

• Technically-minded — Although no prior experience in experimentation is required, the position can get fairly technical when it comes to the web functionality, experimentation, and tools, resembling a Tier 2 IT Support role.

• Critical thinking — You can analyze a problem, ask probing questions, and iterate on your own processes.

• Attention to detail — You have high attention to visual detail, can communicate clear and specific step by step instructions, and leave no stone unturned.

• High communication — You enjoy writing (a lot), collaborative problem solving, providing clear plans of action, and jumping on a video call.

• Experience with Jira, Slack, or Zoom.

• Experience working fully remotely. (REWORD - Self starter, self motivation)

• Technical focus in schooling (e.g., Code School, CS Degree).

• Knowledge of User Experience concepts.

• Knowledge of Agile concepts.

• 401(k) with 100% match up to 4%

• Medical, dental, and vision insurance with 90%+ employer contribution

• HSA, HRA, FSA, wellness and pet care benefits

• 4 weeks PTO (5 weeks after 3 years) + paid bereavement and parental leave

• Professional development support with customized career planning

• Laptop and gear of your choice

• Fully remote work culture with welcome packages, surprises, and an annual retreatAccess to group performance coaching sessions

Compensation Range: 45-65K + Benefits