Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video

By Mark Everingham, Josef Sivic, Andrew Zisserman. 2006

689 citations recorded by the source corpus.

We investigate the problem of automatically labelling appearances of characters in TV or film material. This is tremendously challenging due to the huge variation in imaged appearance of each character and the weakness and ambiguity of available annotation. However, we demonstrate that high precision can be achieved by combining multiple sources of information, both visual and textual. The principal novelties that we introduce are: (i) automatic generation of time stamped character annotation by aligning subtitles and transcripts; (ii) strengthening the supervisory information by identifying when characters are speaking; (iii) using complementary cues of face matching and clothing matching to propose common annotations for face tracks. Results are presented on episodes of the TV series “Buffy the Vampire Slayer”.

Subfields: Computer Vision and Pattern Recognition, Information Extraction

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Xiaogang Wang
  5. Bernt Schiele
  6. Andrew Zisserman
  7. Jitendra Malik
  8. Cordelia Schmid

In Information Extraction

  1. Ivan Laptev
  2. Tinne Tuytelaars
  3. Punarjay Chakravarty
  4. Lior Wolf
  5. Juergen Gall
  6. Tal Hassner
  7. Itay Maoz
  8. B. Taskar

Citations in the corpus