PhD in Visual Information Retrieval
Level 8 - Doctorate Degrees (PhD/DPhil)
| Status | Complete |
|---|---|
| Part Time | No |
| Years | 2010 - 2015 |
| Project Title | Visual Narratives: Free-Hand Sketch for Visual Search and Navigation of Video |
| Project Description | Media retrieval has been dominated by text-based queries utilising meta-data tags, but such queries are cumbersome to describe the appearance and in the case of video temporal information. We propose methods using sketch as an intuitive way to describe and search such media content. Sketch based Video retrieval has traditionally applied complex model fitting, in contrast, we explore representations suitable for index structure to achieve sublinear query time. Which also makes it possible to get the user in the loop through relevance feedback. Secondly, we propose Sketch based Human Pose Retrieval (SBHPR), a method of finding humans postures within videos using stickman depictions. Developing a manifold based retrieval method and learning a domain adaptation to improve precision on new videos. Finally, we extended the SBHPR method to a storyboard allowing a sequence of pose and action labels (run, jump) to be intertwined. This is demonstrated for video segment retrieval and synthesis of a new video, by extending the motion graph technique. |
| Awarding Institution | University of Surrey |