Prompt and response pairs
Instruction, reasoning, creative and safety prompts with rubric-scored responses.
Overview
Each item is a prompt, one or more candidate responses, a rubric score and a written rationale in English plus the source language. Rater agreement is reported per language and per prompt category so you can weight the low-agreement slices yourself.
Specification
- Format
- JSONL
- Categories
- Instruction, reasoning, creative, safety
- Rationale
- Required, bilingual
- Rubric version
- v3, shipped with the set
Sample
Illustrative sample. It shows the structure, fields and metadata of this dataset with invented values, not real recordings or records. A real sample pack is sent on request.
| id | language | turns | domain | speaker_roles | excerpt | label | reviewer_agreement | qa_status |
|---|---|---|---|---|---|---|---|---|
| tx_0001 | English | 6 | LLM alignment | writer, reviewer | Customer reports a delayed refund and asks for a status update. | resolved | agree | accepted |
| tx_0002 | English | 12 | LLM alignment | writer, reviewer | Agent confirms identity and explains what happens next. | escalated | agree | accepted |
| tx_0003 | English | 4 | LLM alignment | writer, reviewer | User asks a follow-up that depends on the previous turn. | resolved | split, adjudicated | accepted |
| tx_0004 | English | 9 | LLM alignment | writer, reviewer | Customer switches topic and the agent re-confirms the goal. | clarified | agree | accepted |
| tx_0005 | English | 7 | LLM alignment | writer, reviewer | Conversation closes with a summary and a confirmation. | resolved | agree | accepted |
Quality assurance
- Rubric qualification test
- Hidden gold at 5%
- Monthly rater re-certification
More in the catalogue
Full catalogue
Agent and customer chat
Support chat across industries with intent, entity and resolution labels.
Learn more
BFSI agent and customer chat
Banking support chat covering disputes, onboarding, cards and collections.
Learn more
Retail agent and customer chat
Order, returns, delivery and product enquiry conversations.
Learn moreWant a real sample before you commit?
The sample above shows the structure. We also send a representative slice that includes the hard cases, plus the QA report and licence terms. No call required.