Visual verdicts a reviewer can act on
A first run of a visual suite records nothing it can compare — Playwright writes the baselines and reports each test as failed. 2.16.0 listed every one of those assertions twice, one of them green. This release makes the verdicts true and gives a reviewer the path to act on them.
- One assertion, one record, the right word.
toMatchVisualBaselinereads the committed file to decide what happened: a first write isnew, a rewrite under--update-snapshotsisupdated(and the rewritten baseline is attached, so the report has a picture of it), and a match ispassed. Two assertions resolving at once can no longer report each other's verdict. (UnderupdateSnapshots: 'none'a missing baseline fails the test and Playwright attaches nothing for it, so the report does not list that comparison — unchanged here.) - A native
toHaveScreenshotfailure stays visible even when it shares a name with atoMatchVisualBaselinepass in the same test. - Each comparison records where its committed baseline lives —
baselinePath, relative to your Playwright config's directory — sotr visual acceptpromotes a render into the file Playwright actually reads, not the per-run copy in the report. (The platform records the decision; only the CLI, which has your checkout, writes the file.) - Merged shard reports keep their comparisons and their images. A merged report used to claim comparisons nothing could show.
- The report uses the platform's words — Wipe, Pixel diff, This run — so a comparison reads the same in the HTML report, in Studio and in the cloud.
Released as @testrelic/playwright-analytics 2.16.2 and @testrelic/core 2.9.1. Report schema moves to 1.7.0; the addition is optional.