Preference ranking pairs
Pairwise preferences with a written reason on every comparison.
Overview
Preference data for RLHF and DPO where the rater must justify the choice in writing. Disagreement rate is published per language, which matters more than the headline agreement number when you are weighting a training mix.
Specification
- Format
- JSONL
- Rationale
- Required
Sample
Illustrative sample. It shows the structure, fields and metadata of this dataset with invented values, not real recordings or records. A real sample pack is sent on request.
| id | language | turns | domain | speaker_roles | excerpt | label | reviewer_agreement | qa_status |
|---|---|---|---|---|---|---|---|---|
| tx_0001 | English | 6 | LLM alignment | writer, reviewer | Customer reports a delayed refund and asks for a status update. | resolved | agree | accepted |
| tx_0002 | English | 12 | LLM alignment | writer, reviewer | Agent confirms identity and explains what happens next. | escalated | agree | accepted |
| tx_0003 | English | 4 | LLM alignment | writer, reviewer | User asks a follow-up that depends on the previous turn. | resolved | split, adjudicated | accepted |
| tx_0004 | English | 9 | LLM alignment | writer, reviewer | Customer switches topic and the agent re-confirms the goal. | clarified | agree | accepted |
| tx_0005 | English | 7 | LLM alignment | writer, reviewer | Conversation closes with a summary and a confirmation. | resolved | agree | accepted |
Quality assurance
- Rubric qualification
- Hidden gold items
- Speed anomaly detection
More in the catalogue
Full catalogue
Agent and customer chat
Support chat across industries with intent, entity and resolution labels.
Learn more
BFSI agent and customer chat
Banking support chat covering disputes, onboarding, cards and collections.
Learn more
Retail agent and customer chat
Order, returns, delivery and product enquiry conversations.
Learn moreWant a real sample before you commit?
The sample above shows the structure. We also send a representative slice that includes the hard cases, plus the QA report and licence terms. No call required.