Skip to content

Video labelling workflows that survive QA

Video multiplies every image-labelling problem by time. Most failures are drift: a track that slowly slides off its object, or a segment boundary nobody agreed on.

Read the guide
Sequence & context → Aligned annotations → Reviewed transitionsThree connected layers illustrate how sequential source context is preserved in aligned labels and reviewed transitions.
Sequence & contextAligned annotationsReviewed transitions

Three annotation types, three failure modes

TypeTypical failureControl
Object tracksID switches after occlusionReview every occlusion event, not random frames
Temporal segmentsInconsistent start/end boundariesWritten boundary rules with frame examples
Dense captionsGeneric, repetitive languageVocabulary guidance and spot-checks for specificity

Interpolation needs its own review

Common video annotation tools support keyframe interpolation between manually set frames. Interpolation saves time but hides error between keyframes. A QA pass should sample interpolated frames specifically, weighted toward fast motion.

People in the frame

Large egocentric video collections such as Ego4D documented consent and de-identification procedures as part of the dataset release (Grauman et al., arXiv:2110.07058). Owners of archival footage should expect the same question: did the people recorded agree to this use?

Owner checklist for licensable video

  • Recording consent or legal basis per collection site.
  • Faces, plates and screens: blurred, retained, or consented?
  • Annotation schema version recorded with each batch.
  • Frame rate and resolution documented, including any re-encoding.

Have an annotated dataset or specialist expertise?

Tell us what you own, how the labels were reviewed and which rights you can license. A short overview of your dataset or annotation business is a useful place to start.

Prepare for a licensing conversation