Find your next opportunity

Newest first

AI QA Lead (B2B SaaS / AI Products) Europe

Devico

Location
Remote
Employment
Full-time
Level
Specialist
Category
Data Science & ML
Posted
Deadline

Description

About the project

We are looking for a hands-on AI QA Lead to join our client’s B2B SaaS product with AI-powered functionality. The development team actively works with AI agents, and we need a strong QA specialist who can own product quality, build a QA process that fits this way of working, and catch issues before they reach production.

The engagement starts with a 4-week pilot. A successful pilot can lead to long-term cooperation and growth of the QA team.

This is not a purely managerial role. We need someone who tests, analyzes changes and finds problems themselves.

What you will do

Build and implement the product testing strategy

Define and introduce QA Gates for development and QA - clear quality criteria that changes must meet before merge and release

Shape test strategy independently based on user goals, tickets, previews and product context

Analyze requirements, spot gaps and ask the right clarifying questions

Identify risks and check related functionality that may be affected by changes

Perform functional, integration, regression and exploratory testing

Test AI features: evaluate system behavior, response quality and edge cases

Review pull requests and code changes from a QA risk perspective

Track issues through to fix, run retests and assess release readiness

Write clear, prioritized bug reports with steps to reproduce, expected and actual results

Give release recommendations, flag critical risks and clearly state what remains untested

Coordinate QA work and keep testing transparent for the team

Requirements

5+ years of commercial experience in Software QA

Experience as QA Lead or Senior QA Engineer

Hands-on experience testing AI/LLM-powered features in real SaaS products

Experience working in AI-driven teams (development with AI agents) and building testing processes for them

Strong background in B2B SaaS testing

Excellent exploratory and risk-based testing skills

Ability to understand complex products independently and decide on testing depth and priorities

Experience in API and integration testing

Understanding of code review from a QA perspective

Experience working directly with developers and Product Owners

Fluent English and strong communication skills

Nice to have

Experience evaluating LLM output quality: consistency, hallucinations, unexpected model behavior

Test automation experience and a clear view of what is worth automating

German at a working level

Experience with European B2B SaaS teams

What matters most

The key criterion is independent product judgment. We are looking for someone who doesn’t wait for a ready test plan, but:

understands the user goal and decides how to verify it

sees problems beyond the written acceptance criteria

asks the right questions and finds missing information

finds risks in related scenarios and functionality

makes a well-argued release recommendation

Hiring process

Candidates who pass the initial screening will be offered a short paid practical assignment (about half a day). It helps us understand your real approach to testing, your independence and the quality of issues you find.

Format: contract, starting with a 4-week paid pilot

Workload: full-time during the pilot

Location: Europe, remote

Working hours: overlap with CET (approx. 10:00-17:00 Berlin time)

Languages: English - Upper-Intermediate ; German is a plus

Apply at the source

This role was published by Devico and listed via Djinni. Applications are handled there, not on this site.

View & apply on djinni.co ↗