CLI Reference
testrelic-deepeval installs a single command-line entry point: testrelic (not testrelic-deepeval).
Commands
| Command | Purpose |
|---|---|
testrelic login | Save credentials (to ~/.testrelic/credentials.toml) — supports --api-key <key> and --base-url <url> |
testrelic logout | Remove credentials |
testrelic test <path> | Run deepeval test run <path> with a credential check |
testrelic view [run_id] | Open the latest (or a specific) eval run in the browser |
testrelic drain | Replay queued offline uploads |
testrelic version | Print the SDK version |
testrelic migrate-from-confident | Print migration steps from Confident AI |
Usage examples
Authenticate
Terminal
testrelic login
Pass values non-interactively:
Terminal
testrelic login --api-key <key> --base-url <url>
Credentials are written to ~/.testrelic/credentials.toml (mode 0600 on POSIX).
Sign out
Terminal
testrelic logout
Run an evaluation
testrelic test wraps deepeval test run <path> and first checks that credentials are available:
Terminal
testrelic test tests/
Open a run
Open the latest eval run in your browser:
Terminal
testrelic view
Open a specific run by ID:
Terminal
testrelic view <run_id>
Replay the offline queue
When uploads can't be delivered, they're written to the offline queue at ~/.testrelic/queue/. Replay them once connectivity is restored:
Terminal
testrelic drain
drain reads the queued uploads from ~/.testrelic/queue/ and re-sends them to the cloud. Successfully delivered items are cleared from the queue.
Print the version
Terminal
testrelic version
Migrate from Confident AI
Print step-by-step migration guidance:
Terminal
testrelic migrate-from-confident
Files and locations
| Path | Purpose |
|---|---|
~/.testrelic/credentials.toml | Saved credentials (mode 0600 on POSIX) |
~/.testrelic/queue/ | Offline upload queue (replayed by testrelic drain) |