How to create tests

To create a tests, create a project and go to the Annotations tab. Click on the Create Test button and provide the following details:

  • Name: A unique name for the test.
  • Description: A brief description of the test.
  • Pick a Scale: Choose the scale on which you want to evaluate the test. You can choose among the following options:
    • Binary: Choose this option if you want to evaluate the test on a binary scale.
    • Rating: Choose this option if you want to evaluate the test on a rating scale.

Start Annotating

Once you have created a test and captured traces to it, you can start annotating the captured traces. Go to the Annotations tab and use the scale you picked while creating the test to annotate the test. The chart at the top will show you how the scores are trending over time.

Add to Dataset

Once annotated or while annotating, you can add the traces to a dataset. This will allow you to run evaluations on the dataset and get insights into the performance of your application. To add traces to a dataset, click on the checkbox button on the first column of each row and click on the Add to Dataset button.