Markov random fields for sketch based video retrieval

Hu, Rui; James, Stuart; Wang, Tinghuai; Collomosse, John

Abstract

We describe a new system for searching video databases using free-hand sketched queries. Our query sketches depict both object appearance and motion, and are annotated with keywords that indicate the semantic category of each object. We parse space-time volumes from video to form graph representation, which we match to sketches under a Markov Random Field (MRF) optimization. The MRF energy function is used to rank videos for relevance and contains unary, pairwise and higher-order potentials that reflect the colour, shape, motion and type of sketched objects. We evaluate performance over a dataset of 500 sports footage clips.

Citation

Hu, R., James, S., Wang, T., & Collomosse, J. (2013). Markov random fields for sketch based video retrieval. In ICMR '13: Proceedings of the 3rd ACM conference on International conference on multimedia retrieval. https://doi.org/10.1145/2461466.2461510

• Conference Name: ICMR'13: International Conference on Multimedia Retrieval
• Conference Location: Dallas, Texas, USA
• Start Date: Apr 16, 2013
• End Date: Apr 19, 2013
• Online Publication Date: Apr 16, 2013
• Publication Date: 2013-04
• Deposit Date: Dec 13, 2023
• Publisher: Association for Computing Machinery (ACM)
• Book Title: ICMR '13: Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
• DOI: https://doi.org/10.1145/2461466.2461510
• Public URL: https://durham-repository.worktribe.com/output/1962775