Visual question answering
Image and question pairs with grounded answers and reasoning traces.
Overview
Questions written by people looking at the image, not generated from captions, which produces the ambiguous and referential questions real users ask. Answers are grounded to a region where grounding is possible.
Specification
- Format
- JSONL plus images
- Questions
- Human written
- Grounding
- Region linked where applicable
- Reasoning
- Trace included
Sample
Illustrative sample. It shows the structure, fields and metadata of this dataset with invented values, not real recordings or records. A real sample pack is sent on request.
| item_id | modalities | image_file | audio_file | text | language | alignment_check | qa_status |
|---|---|---|---|---|---|---|---|
| mm_0001 | image + text | sample_0001.jpg | - | Customer reports a delayed refund and asks for a status update. | English | text matches image | accepted |
| mm_0002 | image + text | sample_0002.jpg | - | Agent confirms identity and explains what happens next. | English | text matches image | accepted |
| mm_0003 | audio + video + text | sample_0003.jpg | sample_0003.wav | User asks a follow-up that depends on the previous turn. | English | text matches image | accepted |
| mm_0004 | image + text | sample_0004.jpg | - | Customer switches topic and the agent re-confirms the goal. | English | text matches image | accepted |
| mm_0005 | image + text | sample_0005.jpg | - | Conversation closes with a summary and a confirmation. | English | text matches image | accepted |
Quality assurance
- Grounding verification
- Answer agreement reported
- Ambiguity flagging
More in the catalogue
Full catalogue
General conversation speech
Spontaneous telephonic conversation from native speakers, recruited against region quotas.
Learn more
Call centre speech
Real support calls with agent and customer channels separated and code-switching preserved.
Learn more
BFSI call centre speech
Banking support calls covering balance, dispute, collections and onboarding flows.
Learn moreWant a real sample before you commit?
The sample above shows the structure. We also send a representative slice that includes the hard cases, plus the QA report and licence terms. No call required.