AI Groups Your Tests for You: Modules, Everywhere
TestRelic Team
Organizing tests by functional area — Authentication, Checkout, Dashboard — used to mean doing it yourself, by hand, and keeping it up to date as the suite grew. Modules does it automatically, and this week it got fast enough and smart enough to trust.
Free, local, and on by default
A new Modules view groups your test cases by what they actually test, using an in-process embedding model — no LLM call, no token cost, no configuration. It runs on every ingest, so new tests get placed without you doing anything, and it names new groups deterministically from your file structure and test descriptions rather than guessing.
An AI escape hatch for the rest
Some tests resist automatic classification — vague titles, no discoverable file path. For those, Auto Group with AI is a one-click pass that reuses your existing module names as vocabulary, so it extends "Authentication" instead of minting "Auth" next to it.
And when a one-shot pass isn't precise enough, Ask AI lets you steer directly:
- "Merge Checkout into Products"
- "Create a Notifications module for anything under
tests/notifications/" - "Move the three flaky login tests into Authentication"
Every one of those is a real write, not a suggestion — and like any manual edit, it's never overwritten by the automatic classifier later.
Now on Overview, and now in the CLI
The repo Overview tab gained a Modules panel that answers a different question than the Modules view itself: not "what's in each group" but "which group should I look at first" — grouping coverage, per-module failure counts, and suggested merges for modules that look like duplicates.
And Studio's own Tests view now groups by the same AI-classified Modules, in both Local and Cloud mode — so the grouping you build on the web is the same grouping you see from the terminal.
Get started
Open a repository's Test Cases tab and switch to the Modules toggle. See Modules for the full reference.