Skip to content
Karmyug

Data annotation and labelling

Labels scored by how correct they are, not by how fast they were drawn.

What data annotation means here

Annotation quality is a measurement problem before it is a labour problem. If you cannot say what fraction of your labels are wrong and where they are wrong, throughput is not a useful number.

We hide gold tasks in the stream, run two to three way consensus on ambiguous classes, and report inter-annotator agreement per class with every delivery.

Visual labelling to a written taxonomy
Visual labelling to a written taxonomy

What we can take on

  • 2D bounding boxes

    Detection labels at volume across images and video frames.

  • Polygon and mask

    Instance and semantic segmentation for irregular shapes.

  • Keypoint and pose

    Skeletal points for pose, gesture and facial landmark work.

  • 3D cuboids and LiDAR

    Point cloud annotation with camera and LiDAR synchronised.

  • OCR and document

    Word boxes, key-value linking, table structure and handwriting.

  • Text labelling

    Entities, intents, sentiment and custom taxonomies.

The types of data annotation we run

The full breakdown, not the headline categories. Anything not on this list is a scoping call away.

Text annotation. Sentiment and emotion tagging, Named-entity recognition, Intent and taxonomy classification, Summarisation and extraction review, Question-answer pair validation, Toxicity and safety flagging.

Audio annotation. Speech transcription verification, Speaker identification and diarisation, Sound-event tagging, Language and dialect identification, Emotion and tone tagging.

Image annotation. 2D bounding boxes, Polygon and semantic segmentation, Keypoint and pose estimation, Facial landmark annotation, OCR word and layout boxes, Image-level classification.

Video annotation. Multi-object tracking, Action and activity recognition, Instance segmentation across frames, Lane and drivable-area marking, Frame-level event tagging, Temporal boundary annotation.

3D and sensor annotation. LiDAR point-cloud cuboids, Camera-LiDAR sensor fusion, Radar and depth-map labelling, Spatial scene segmentation.

Road-scene labels for perception models
Road-scene labels for perception models

The forms the data takes

What you actually receive: file types, structure and the metadata that travels with it.

Image: boxes, polygons, masks
COCO, Pascal VOC and YOLO exports, with class IDs from your taxonomy.
Video: tracking and events
Per-frame tracks with persistent object IDs, interpolation and event boundaries.
Text: entities, intent, sentiment
Span and document labels in JSONL, CoNLL or your own schema.
Audio: segments and tags
Timestamped segments, speaker and event labels, in JSON or TextGrid.
3D and sensor
Cuboids and point-cloud segmentation for LiDAR and depth data.
Documents
Word boxes, key-value links and table structure for OCR and document AI.

How the data is collected

From the first brief to the batch you receive, step by step.

  1. 01

    You send the raw data, or we collect it

    Annotation starts from your files through a secure transfer, or from data we collected for you, so the label and the source stay linked.

  2. 02

    Guidelines with worked examples

    We turn your labelling spec into written guidelines with examples of the edge cases, and agree them with you before volume work starts.

  3. 03

    Pre-labelling where it helps

    Model or heuristic pre-labels are used only where reviewers can fix them faster than they can draw from scratch, and never to skip review.

  4. 04

    Layered review

    Peer review, then expert review on a risk-weighted sample, with gold tasks injected so label quality is measured while the work runs.

  5. 05

    Disagreements settled, not averaged

    Contested items go to a senior reviewer, and the ruling is written back into the guidelines.

Document structure and key-value linking
Document structure and key-value linking

How a project runs

  1. 01

    Scoping call

    We agree volume, languages, demographic quotas, formats and what counts as a rejected item.

  2. 02

    Guidelines and gold set

    Written guidelines with worked examples, plus a gold set every contributor is tested against.

  3. 03

    Pilot batch

    A small paid batch you accept before anything scales. Most guideline problems surface here.

  4. 04

    Production

    Work flows through capture checks, automated QC, peer review and expert review.

  5. 05

    Delivery

    Incremental batches in your format with a data card, QA report and agreement scores.

  6. 06

    Iteration

    Rejections feed back into the guidelines so the same mistake is not made twice.

How quality is checked

Checks that run during the work, not a sample at the end.

  • Inter-annotator agreement reported per class
  • Gold tasks injected into the queue at a fixed rate
  • Per-class IoU scoring for visual labels
  • Reviewer sampling raised automatically on low-agreement classes
  • Rejection breakdown delivered with every batch

Industries that use it

Where teams bring us data annotation, and what they use it for.

Why teams pick us for data annotation

  • IoU against gold

    Accepted work clears 0.9 IoU on the gold set, per class, not on average.

  • Consensus on hard classes

    Ambiguous classes are labelled two or three times and reconciled.

  • Class-level reporting

    You see which classes your annotators disagreed on, not one headline number.

  • Secure workspaces

    Private NDA-only pools, secure view mode and no downloads where required.

Start with a pilot batch of data annotation.

A small paid batch against your real guidelines, priced up front. You accept it before we scale.

  • Reply within one working day
  • Volumes, languages, quality target and price
  • No sequences, no list

Request data annotation

The more specific the failure you are trying to fix, the more useful our first reply will be.

We use this only to reply to you. No sequences, no list. See our privacy policy.

Questions we get asked

What accuracy can you commit to?

It depends on the class. We set a per-class threshold during the pilot and report against it, rather than quoting a single figure that averages away the hard classes.

Can you use our annotation tool?

Yes. We work in your tool, in ours, or in an open-source stack you nominate.

How do you handle guideline changes mid-project?

As a written change order with a re-baselined gold set. Items labelled under the old guideline are flagged so you can decide whether to relabel them.