Joint face representation adaptation and clustering in videos

19Citations
Citations of this article
33Readers
Mendeley users who have this article in their library.

This article is free to access.

Abstract

Clustering faces in movies or videos is extremely challenging since characters’ appearance can vary drastically under different scenes. In addition, the various cinematic styles make it difficult to learn a universal face representation for all videos. Unlike previous methods that assume fixed handcrafted features for face clustering, in this work, we formulate a joint face representation adaptation and clustering approach in a deep learning framework. The proposed method allows face representation to gradually adapt from an external source domain to a target video domain. The adaptation of deep representation is achieved without any strong supervision but through iteratively discovered weak pairwise identity constraints derived from potentially noisy face clustering result. Experiments on three benchmark video datasets demonstrate that our approach generates character clusters with high purity compared to existing video face clustering methods, which are either based on deep face representation (without adaptation) or carefully engineered features.

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2016). Joint face representation adaptation and clustering in videos. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9907 LNCS, pp. 236–251). Springer Verlag. https://doi.org/10.1007/978-3-319-46487-9_15

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 18

67%

Researcher 6

22%

Professor / Associate Prof. 2

7%

Lecturer / Post doc 1

4%

Readers' Discipline

Tooltip

Computer Science 22

76%

Engineering 4

14%

Agricultural and Biological Sciences 2

7%

Business, Management and Accounting 1

3%

Save time finding and organizing research with Mendeley

Sign up for free