Free interview kit
QA Engineer interview kit: questions and rubric
5 competencies · 11 questions · anchored 1-to-5 scale · Updated · Written by the Itya team
How to use this kit
- Agree the competencies with the hiring manager before the job is posted.
- Give each interviewer one or two competencies, so nothing is asked twice.
- Ask every candidate the same core questions; follow up freely.
- Rate each competency against the anchors straight after the interview, alone.
- Debrief on quotes, not adjectives, then decide with the rule at the end.
First-round screen
Fifteen to twenty minutes, by phone, video or a disclosed AI screen. The aim is to confirm the basics before the panel spends its time.
- What draws you to testing and quality work, and what kind of testing do you want to do more of?
- Tell me about a bug you found that would have hurt users if it had shipped. How did you find it?
- Which of the tools named in the job description (a test framework, a browser or mobile automation tool, a bug tracker, a CI system) have you used at work, and for what?
- The job description sets out the location, working pattern and start date. Do those work for you, what is your notice period, and what compensation range are you expecting?
Competency 1
Test strategy and risk
No team can test everything. A QA engineer earns their place by choosing what to test, how deeply and at which level, based on what could hurt users most.
Exercise, 20 minutes: here is a half-page spec for a discount-code field at checkout. Codes are a percentage or a fixed amount, have an expiry date and a minimum order value, and some are single-use. Tell me how you would test it, starting with what you would test first and why. There is no build to click through.
Follow up with
- What would you ask the product manager before testing?
- Which of these tests would you automate, and at what level?
- You have one hour before release. What do you test?
Tell me about a release where you had to decide what not to test. How did you decide, and what happened?
Follow up with
- Who did you tell about the risk you were accepting?
- Would you make the same call again?
| Rating | What it looks like |
|---|---|
| 5 · Strong | Questions the spec first, ranks tests by user impact and likelihood, covers boundaries, concurrency and abuse, places each test at the right level, and makes accepted risks visible. |
| 3 · Mixed | Covers boundaries and negative cases and asks some clarifying questions. Needs prompting to rank by risk or to choose the level of each test. |
| 1 · Weak | Lists happy-path checks only, accepts the spec without questions, and cannot rank tests by risk. |
Competency 2
Exploratory testing
Scripted tests find the bugs someone predicted. Exploratory testing, done with a charter and notes, finds the ones nobody did.
Work sample, 10 minutes: here is a sign-up form in a small practice app built for interviews, with a few known bugs. Explore it with this charter: "find problems a first-time user on a phone could hit." Think aloud as you go.
Follow up with
- What did you try that you would not find in a scripted test?
- What would your session notes say?
- What would you explore with another 30 minutes?
Tell me about a serious bug you found by exploring rather than by following a test case.
Follow up with
- What made you look there?
- What did you add to the regression checks afterwards?
| Rating | What it looks like |
|---|---|
| 5 · Strong | Works from a charter, applies heuristics deliberately, records coverage and gaps, finds the subtle bugs, and turns findings into lasting regression checks. |
| 3 · Mixed | Explores with some structure and finds the obvious bugs. Needs prompting on heuristics such as boundaries, interruptions or device conditions. |
| 1 · Weak | Explores without a plan, tries only valid input, and keeps no notes on what was covered. |
Competency 3
Test automation
Automation lets a team release often without retesting everything by hand. Badly built automation does the opposite: slow, flaky suites that people learn to ignore.
Work sample, 10 minutes: here is a short UI test in Playwright, Cypress or Selenium. It waits a fixed five seconds, finds a button by a long CSS path tied to the layout, and logs in through the UI at the start of every test. What would you change?
Follow up with
- How would you find the button instead?
- What should this test check through the UI, and what through the API?
Tell me about an automated test suite you built or maintained. How was it structured, and how reliable was it?
Follow up with
- How long did it take to run, and what did you do about it?
- How did you handle test data?
What would you do if the UI suite fails on a different test about one run in five, and developers have started re-running it until it passes?
Follow up with
- What would you do this week while you investigate?
| Rating | What it looks like |
|---|---|
| 5 · Strong | Puts each test at the cheapest level that catches the risk, writes stable tests with isolated data, keeps the suite fast and trusted, and treats every flaky test as a bug. |
| 3 · Mixed | Writes working automated tests that run in CI and fixes obvious flakiness. Needs prompting on test levels, locators or isolated test data. |
| 1 · Weak | Automates everything through the UI with fixed waits, and accepts flaky runs as normal. |
Competency 4
Bug reporting and communication
A bug nobody can reproduce or prioritize does not get fixed. QA engineers turn what they saw into reports developers can act on, and speak for the user when severity is in doubt.
Work sample, 10 minutes: write the bug report for this. On checkout, applying a valid discount code and then removing an item sometimes leaves the discount in place below the minimum order value. You saw it on the staging build in Chrome on Android.
Follow up with
- What severity and priority would you give it, and why?
- What would you check before filing it?
Tell me about a time a developer or product manager disagreed that something was a bug, or that it mattered. What did you do?
Follow up with
- What evidence did you bring?
- What was decided, and did you agree?
| Rating | What it looks like |
|---|---|
| 5 · Strong | Writes reports a developer can act on the first time, narrows conditions before filing, argues severity from user impact with evidence, and keeps the working relationship strong when overruled. |
| 3 · Mixed | Writes clear, reproducible reports with steps and environment. Argues severity reasonably, but needs prompting to narrow conditions or bring evidence of impact. |
| 1 · Weak | Writes reports that cannot be reproduced, sets severity without reasons, and argues from opinion. |
Competency 5
Building quality into the team
Quality is built during design and development, not inspected in at the end. Strong QA engineers shape stories early, help developers test their own work, and give release advice the team trusts.
Tell me about a time you changed how your team tested, not just what you tested.
Follow up with
- How did you get developers on board?
- How did you know it helped?
What would you do if the team wants to release today and you have found a bug you think is serious, but the product owner thinks it is minor?
Follow up with
- What would you say, and to whom?
- What would you do if they release anyway?
| Rating | What it looks like |
|---|---|
| 5 · Strong | Shapes stories before code is written, helps developers test their own work, gives clear release advice with options, and leaves the team testing better than before. |
| 3 · Mixed | Joins refinement, raises risks and works well with developers. Changes how the team tests only when asked. |
| 1 · Weak | Sees quality as testing at the end, works apart from developers, and either blocks releases alone or stays silent. |
Never ask
- Don't ask a candidate's age, or their graduation year to work it out. Why: age says nothing about testing skill, and age-based decisions are unlawful in many places.
- Don't ask about marital status, children, pregnancy or plans to start a family. Why: none of it is job-related, and the question is still put mostly to women, which makes it discriminatory as well as irrelevant.
- Don't ask about religion, caste, community or the origin of a surname, directly or by proxy ('What does your father do?'). Why: in India these questions signal caste and religion, which have no bearing on the job.
- Don't ask 'Where are you from originally?' or 'What is your native place?'. Why: it invites judgments about region, language and community. If location matters, ask whether the candidate can work from the job's location.
- Don't ask about citizenship or nationality. Why: it is not job-related and can be unlawful discrimination in the US, the EU and elsewhere. Ask only whether the candidate has the right to work in the job's location, or will need sponsorship.
- Don't ask about health conditions, disabilities or past medical leave. Why: the only relevant question is whether the candidate can perform the essential functions of the job, with or without reasonable accommodation.
- Don't ask for salary history where the law restricts it: many US states and cities do, and the EU Pay Transparency Directive requires member states to. Why: it carries past pay gaps into the new offer. Ask for the expected range; in India, where current pay is commonly asked, still set the offer from the role's band.
- Don't ask the candidate to test your live product or find bugs in your real app as an assignment. Why: that is unpaid QA work. Use a practice app or a prepared spec with planted issues, like the exercises in this kit.
Making the decision
Each interviewer rates their competencies alone, against the anchors, before the debrief. The must-haves are test strategy and risk, exploratory testing, and bug reporting and communication; for an automation-focused role, add test automation. Any 1 on a must-have is a no, and so is any competency rated 1 by two interviewers. A hire needs an average of 3.5 or higher. The hiring manager decides after the debrief and records the exercise evidence behind each rating.
Questions people ask
- What is a good practical exercise for a QA engineer interview?
- A short "test this feature" exercise. Hand the candidate a half-page spec with a few gaps, such as the discount-code field above, and ask how they would test it. In 20 minutes it shows whether they question the spec, think in risks and boundaries, and pick the right level for each test.
- Should a QA engineer be able to code?
- It depends on the role. For a QA automation engineer or SDET, yes: test code is production code, so review it like code. For a role focused on exploratory testing, reading code helps but is not a must-have. Say which role you are hiring for in the job description.
- How do we interview a manual tester moving into automation?
- Rate test strategy, exploratory skill and bug reporting as you would for anyone, and judge automation on reasoning rather than polish. The ten-minute review of a flawed UI test shows whether they know why tests break. Testing instincts are harder to teach than a framework.
- Do ISTQB certifications matter when hiring QA engineers?
- A certification shows the candidate knows the vocabulary of testing. It does not show judgment, and many strong testers have never taken one. Treat it as a small plus at most, and let the exercises show the skill.
A kit is step one.
Itya holds every interviewer to the same rubric, records the interview, and drafts the scorecard with the quotes behind each rating. The AI drafts; your team decides. Free plan, unlimited teammates.