Migrating from Confident AI
Already running DeepEval with Confident AI's hosted dashboard? Moving to TestRelic takes three small changes, and your test code stays exactly the same — DeepEval is still the authoring API.
What changes
| Step | Confident AI | TestRelic |
|---|---|---|
| Install | pip install deepeval | pip install testrelic-deepeval |
| Authenticate | deepeval login | testrelic login --api-key tr_... |
| Where results land | Confident AI | your TestRelic org |
What stays the same
- Every
LLMTestCase,ConversationalTestCase,Golden,EvaluationDataset, andMetricworks as-is. deepeval test runworks as-is — the TestRelic plugin runs alongside DeepEval.- All built-in DeepEval metrics (G-Eval, AnswerRelevancy, Faithfulness, …) produce the same scores; TestRelic never recomputes them.
Step by step
1. Install the package
pip install "testrelic-deepeval[deepeval]"
testrelic-deepeval is additive — it sits beside DeepEval and changes nothing about how DeepEval runs.
2. Log in to TestRelic
testrelic login --api-key tr_yourkey
3. Stop the duplicate upload (recommended)
By default DeepEval still uploads to Confident AI if its key is set, so you'd get the run in both places. To send to TestRelic only, unset the Confident AI key — for example:
deepeval logout
Or unset CONFIDENT_API_KEY in your CI environment.
Run testrelic migrate-from-confident to print these steps in your terminal at any time.
A note on history
Your historical comparisons start fresh from your first TestRelic run — prior run history is not copied over. New runs trend from there, in the DeepEval / eval workspace.