Skip to main content

Research Repository

Advanced Search

All Outputs (16)

Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins (2023)
Conference Proceeding
Nisi, V., James, S., Bala, P., Del Bue, A., & Jardim Nunes, N. (2023). Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins. In L. Holloway-Attaway, & J. T. Murray (Eds.), Interactive Storytelling: 16th International Conference on Interactive Digital Storytelling, ICIDS 2023, Kobe, Japan, November 11–15, 2023, Proceedings, Part I. https://doi.org/10.1007/978-3-031-47655-6_8

As the concept of the Metaverse becomes a reality, storytelling tools sharpen their teeth to include Artificial Intelligence and Augmented Reality as prominent enabling features. While digitally savvy and privileged populations are well-positioned to... Read More about Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins.

Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity (2021)
Conference Proceeding
Dionísio, M., Nisi, V., Xin, J., Bala, P., James, S., & Jardim Nunes, N. (2021). Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity. In J. Baalsrud Hauge, J. C. Cardoso, L. Roque, & P. A. Gonzalez-Calero (Eds.), International Conference on Entertainment Computing (IFIP-ICEC) - Work In Progress (WIP) Track. https://doi.org/10.1007/978-3-030-89394-1_35

The use of Conversational Interfaces has evolved rapidly in numerous fields; in particular, they are an interesting tool for Serious Games to leverage on. Conversational Interfaces can assist Serious Games’ goals, namely in presenting knowledge throu... Read More about Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity.

Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning (2018)
Conference Proceeding
Gay, P., James, S., & Del Bue, A. (2018). Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning. In Computer Vision – ACCV 2018 14th Asian Conference on Computer Vision, Perth, Australia, December 2–6, 2018, Revised Selected Papers, Part III. https://doi.org/10.1007/978-3-030-20893-6_21

Recent approaches on visual scene understanding attempt to build a scene graph – a computational representation of objects and their pairwise relationships. Such rich semantic representation is very appealing, yet difficult to obtain from a single im... Read More about Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning.

Multi-view Aggregation for Color Naming with Shadow Detection and Removal (2018)
Conference Proceeding
Dahy Elkhouly, M., James, S., & Del Bue, A. (2018). Multi-view Aggregation for Color Naming with Shadow Detection and Removal. In 2018 IEEE International Conference on Image Processing, Applications and Systems (IPAS). https://doi.org/10.1109/IPAS.2018.8708885

This paper presents a set of methods for classifying the color attribute of objects when multiple images of the same objects are available. This problem is more complex than the single image estimation since varying environmental effects, such as, sh... Read More about Multi-view Aggregation for Color Naming with Shadow Detection and Removal.

3D Sketching in Virtual Reality for immersive model search (2018)
Conference Proceeding
Giunchi, D., James, S., & Steed, A. (2018). 3D Sketching in Virtual Reality for immersive model search. In Expressive '18: Proceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering (1-12). https://doi.org/10.1145/3229147.3229166

We describe a novel method for searching 3D model collections using free-form sketches within a virtual environment as queries. As opposed to traditional sketch retrieval, our queries are drawn directly onto an example model. Using immersive virtual... Read More about 3D Sketching in Virtual Reality for immersive model search.

Evolutionary Data Purification for Social Media Classification (2016)
Conference Proceeding
James, S., & Collomosse, J. (2016). Evolutionary Data Purification for Social Media Classification. In Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR). https://doi.org/10.1109/ICPR.2016.7900039

We present a novel algorithm for the semantic labeling of photographs shared via social media. Such imagery is diverse, exhibiting high intra-class variation that demands large training data volumes to learn representative classifiers. Unfortunately... Read More about Evolutionary Data Purification for Social Media Classification.

A Particle Filtering approach to salient video object localization (2014)
Conference Proceeding
Gray, C., James, S., Collomosse, J., & Asente, P. (2014). A Particle Filtering approach to salient video object localization. In 2014 IEEE International Conference on Image Processing (ICIP). https://doi.org/10.1109/ICIP.2014.7025038

We describe a novel fully automatic algorithm for identifying salient objects in video based on their motion. Spatially coherent clusters of optical flow vectors are sampled to generate estimates of affine motion parameters local to super-pixels iden... Read More about A Particle Filtering approach to salient video object localization.

Enhanced Digital Literacy by Multi-modal Data Mining of the Digital Lifespan (2014)
Conference Proceeding
Collomosse, J., James, S., Durrant, A., Trujillo-Pisanty, D., Moncur, W., Orzech, K. M., …Chantler, M. (2014). Enhanced Digital Literacy by Multi-modal Data Mining of the Digital Lifespan. In Proceedings of Digital Economy (DE2014)

Social media pervades modern digital society, yet despite its regular use the general level of digital literacy and awareness of online representations of self remain low. We report progress on the RCUK DE funded ‘Charting the Digital Lifespan’ proje... Read More about Enhanced Digital Literacy by Multi-modal Data Mining of the Digital Lifespan.

Interactive Video Asset Retrieval Using Sketched Queries (2014)
Conference Proceeding
James, S., & Collomosse, J. (2014). Interactive Video Asset Retrieval Using Sketched Queries. In Proceedings of Conference on Visual Media Production (CVMP) (1-8). https://doi.org/10.1145/2668904.2668940

We present a new algorithm for searching video repositories using free-hand sketches. Our queries express both appearance (color, shape) and motion attributes, as well as semantic properties (object labels) enabling hybrid queries to be specified. Un... Read More about Interactive Video Asset Retrieval Using Sketched Queries.

Admixed Portrait: Design Intervention to Prompt Reflection on Being Online as a New Parent (2014)
Conference Proceeding
Trujillo-Pisanty, D., Durrant, A., Martindale, S., James, S., & Collomosse, J. (2014). Admixed Portrait: Design Intervention to Prompt Reflection on Being Online as a New Parent. In DIS '14: Proceedings of the 2014 conference on Designing interactive systems (503-512). https://doi.org/10.1145/2598510.2602962

This Pictorial documents the process of designing a device as an intervention within a field study of new parents. The device was deployed in participating parents' homes to invite reflection on their everyday experiences of portraying self and other... Read More about Admixed Portrait: Design Intervention to Prompt Reflection on Being Online as a New Parent.

ReEnact: Sketch Based Choreographic Design from Archival Dance Footage (2014)
Conference Proceeding
James, S., Fonseca, M. J., & Collomosse, J. (2014). ReEnact: Sketch Based Choreographic Design from Archival Dance Footage. In ICMR '14: Proceedings of International Conference on Multimedia Retrieval (313-320). https://doi.org/10.1145/2578726.2578766

We describe a novel system for synthesising video choreography using sketched visual storyboards comprising human poses (stick men) and action labels. First, we describe an algorithm for searching archival dance footage using sketched pose. We match... Read More about ReEnact: Sketch Based Choreographic Design from Archival Dance Footage.

Markov random fields for sketch based video retrieval (2013)
Conference Proceeding
Hu, R., James, S., Wang, T., & Collomosse, J. (2013). Markov random fields for sketch based video retrieval. In ICMR '13: Proceedings of the 3rd ACM conference on International conference on multimedia retrieval. https://doi.org/10.1145/2461466.2461510

We describe a new system for searching video databases using free-hand sketched queries. Our query sketches depict both object appearance and motion, and are annotated with keywords that indicate the semantic category of each object. We parse space-t... Read More about Markov random fields for sketch based video retrieval.

Annotated Free-Hand Sketches for Video Retrieval Using Object Semantics and Motion (2012)
Conference Proceeding
Hu, R., James, S., & Collomosse, J. (2012). Annotated Free-Hand Sketches for Video Retrieval Using Object Semantics and Motion. . https://doi.org/10.1007/978-3-642-27355-1_44

We present a novel video retrieval system that accepts annotated free-hand sketches as queries. Existing sketch based video retrieval (SBVR) systems enable the appearance and movements of objects to be searched naturally through pictorial representat... Read More about Annotated Free-Hand Sketches for Video Retrieval Using Object Semantics and Motion.

Skeletons from sketches of dancing poses
Conference Proceeding
Fonseca, M. J., James, S., & Collomosse, J. (2012). Skeletons from sketches of dancing poses. In 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). https://doi.org/10.1109/vlhcc.2012.6344537

The contribution of this paper is a sketch parser able to recognize the several components of a skeleton described using the drawing of a stick-man. We describe the sketch parser in detail, and briefly outline how it is applied to form the front-end... Read More about Skeletons from sketches of dancing poses.