To create a new Test Set, navigate to:
- Evaluation > Test Sets and click the New button in the top right corner of the list.
- A pop-up with Test Set details will open.
Fill in the Test Set fields:
- Name
- Description
- System name. The system name is used to identify the Test Set (for example, when creating an Evaluation Job), so it is strongly recommended not to change it after a Test Set has been created.
- Type. The type defines whether the Test Set will be used with RAG Tools or with Prompt Templates. The type can be changed later from the Settings tab of the Test Set details screen.
- File. If you have an Excel file with test data, upload it here. A maximum of 2 columns will be used to generate Test Set records: the first column for evaluation input and the second column for expected output. The expected output column is optional. You can also skip the file upload and add data manually or import a file later.
Click Save when you are ready to proceed.
If you have uploaded a file during Test Set creation, Test Set records will be populated after you click Save.
You can also add Test Set records manually. Click Add record in the top right corner of the Test Set record list. Fill in the fields: Evaluation input (required) and Expected output (optional).
Click Add if you want to add just one record, and Add New if you want to save the current record and create another one.
Please note that you need to click the Save button in the top right corner of the screen in order to save added Test Set records.