Skip to main content

Research Repository

Advanced Search

All Outputs (28)

Interactive Digital Storytelling Navigating the Inherent Currents of the Diasporic Mind (2024)
Presentation / Conference Contribution
Nisi, V., Bala, P., Pessoa, M., James, S., & Nunes, N. (2024, December). Interactive Digital Storytelling Navigating the Inherent Currents of the Diasporic Mind. Presented at International Conference on Interactive Digital Storytelling (ICIDS 2024), Barranquilla, Colombia

Due to a recent increase in conflicts, natural disasters, and economic crises, a growing wave of migrant populations has been searching for asylum in Europe. For this population of asylum seekers, the migration process, like currents and rapids, can... Read More about Interactive Digital Storytelling Navigating the Inherent Currents of the Diasporic Mind.

Maps from Motion (MfM): Generating 2D Semantic Maps from Sparse Multi-view Images (2024)
Presentation / Conference Contribution
Toso, M., Fiorini, S., James, S., & Del Bue, A. (2025, March). Maps from Motion (MfM): Generating 2D Semantic Maps from Sparse Multi-view Images. Presented at International Conference on 3D Vision (3DV), Singapore

World-wide detailed 2D maps require enormous collective efforts. OpenStreetMap is the result of 11 million registered users manually annotating the GPS location of over 1.75 billion entries, including distinctive landmarks and common urban objects. A... Read More about Maps from Motion (MfM): Generating 2D Semantic Maps from Sparse Multi-view Images.

ArtAI4DS: AI Art and Its Empowering Role in Digital Storytelling (2024)
Presentation / Conference Contribution
Fernandes, T., Nisi, V., Nunes, N., & James, S. (2024, September). ArtAI4DS: AI Art and Its Empowering Role in Digital Storytelling. Presented at IFIP International Conference on Entertainment Computing, Manaus, Brazil

In an era of global interconnections, storytelling is a compelling medium for fostering understanding, building connections, and facilitating cultural exchange. Throughout history, visual imagery has been used to enrich narratives. However, this has... Read More about ArtAI4DS: AI Art and Its Empowering Role in Digital Storytelling.

Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving (2024)
Presentation / Conference Contribution
Tsesmelis, T., Palmieri, L., Khoroshiltseva, M., Islam, A., Elkin, G., Itzhak Shahar, O., Scarpellini, G., Fiorini, S., Ohayon, Y., Alali, N., Aslan, S., Morerio, P., Vascon, S., gravina, E., Cristina Napolitano, M., Scarpati, G., zuchtriegel, G., Spühler, A., Fuchs, M. E., James, S., …Del Bue, A. (2024, December). Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving. Presented at Conference on Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, Vancouver, Canada

This paper proposes the RePAIR dataset that represents a challenging benchmark to test modern computational and data driven methods for puzzle-solving and reassembly tasks. Our dataset has unique properties that are uncommon to current benchmarks for... Read More about Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving.

PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections* (2024)
Presentation / Conference Contribution
Taiana, M., Toso, M., James, S., & Bue, A. D. (2024, March). PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections*. Presented at 2024 International Conference on 3D Vision (3DV), Davos, Switzerland

Robustly estimating camera poses from a set of images is a fundamental task which remains challenging for differentiable methods, especially in the case of small and sparse camera pose graphs. To overcome this challenge, we propose Pose-refined Rotat... Read More about PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections*.

IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model (2024)
Presentation / Conference Contribution
Bortolon, M., Tsesmelis, T., James, S., Poiesi, F., & Bue, A. D. (2024, May). IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model. Presented at 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan

We introduce IFFNeRF to estimate the six degrees-of-freedom (6DoF) camera pose of a given image, building on the Neural Radiance Fields (NeRF) formulation. IFFNeRF is specifically designed to operate in real-time and eliminates the need for an initia... Read More about IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model.

Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins (2023)
Presentation / Conference Contribution
Nisi, V., James, S., Bala, P., Del Bue, A., & Jardim Nunes, N. (2023, November). Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins. Presented at 16th International Conference on Interactive Digital Storytelling, ICIDS 2023, Kobe, Japan

As the concept of the Metaverse becomes a reality, storytelling tools sharpen their teeth to include Artificial Intelligence and Augmented Reality as prominent enabling features. While digitally savvy and privileged populations are well-positioned to... Read More about Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins.

Geolocation of Cultural Heritage using Multi-View Knowledge Graph Embedding (2023)
Presentation / Conference Contribution
Mohamed, H. A., Vascon, S., Hibraj, F., James, S., Pilutti, D., Del Bue, A., & Pelillo, M. (2022, August). Geolocation of Cultural Heritage using Multi-View Knowledge Graph Embedding. Presented at International Conference on Pattern Recognition (ICPR) 2022 International Workshops and Challenge, Montreal, Canada

GANzzle: Reframing jigsaw puzzle solving as a retrieval task using generative mental images (2022)
Presentation / Conference Contribution
Talon, D., Del Bue, A., & James, S. (2022, October). GANzzle: Reframing jigsaw puzzle solving as a retrieval task using generative mental images. Presented at IEEE International Conference on Image Processing, Bordeaux, France

Puzzle solving is a combinatorial challenge due to the difficulty of matching adjacent pieces. Instead, we infer a mental image from all pieces, which a given piece can then be matched against avoiding the combinatorial explosion. Exploiting advancem... Read More about GANzzle: Reframing jigsaw puzzle solving as a retrieval task using generative mental images.

Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling using Crowd-Generated Content (2022)
Presentation / Conference Contribution
Bala, P., James, S., Del Bue, A., & Nisi, V. (2022, December). Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling using Crowd-Generated Content. Presented at Interactive Storytelling (ICIDS 2022), Santa Cruz, USA

Digital Storytelling can exploit numerous technologies and sources of information to support the creation, refinement and enhancement of a narrative. Research on text editing tools has created novel interactions that support authors in different stag... Read More about Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling using Crowd-Generated Content.

Multi-view 3D Objects Localization from Street-level Scenes (2022)
Presentation / Conference Contribution
Ahmad, J., Toso, M., Taiana, M., James, S., & Del Bue, A. (2022, May). Multi-view 3D Objects Localization from Street-level Scenes. Presented at Image Analysis and Processing – ICIAP 2022, Lecce, Italy

Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity (2021)
Presentation / Conference Contribution
Dionísio, M., Nisi, V., Xin, J., Bala, P., James, S., & Jardim Nunes, N. (2021, November). Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity

The use of Conversational Interfaces has evolved rapidly in numerous fields; in particular, they are an interesting tool for Serious Games to leverage on. Conversational Interfaces can assist Serious Games’ goals, namely in presenting knowledge throu... Read More about Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity.

re-OBJ:Jointly learning the foreground and background for object instance re-identification (2019)
Presentation / Conference Contribution
James, S. (2019, September). re-OBJ:Jointly learning the foreground and background for object instance re-identification. Presented at Image Analysis and Processing – ICIAP 2019, Trento, Italy

Conventional approaches to object instance re-identification rely on matching appearances of the target objects among a set of frames. However, learning appearances of the objects alone might fail when there are multiple objects with similar appearan... Read More about re-OBJ:Jointly learning the foreground and background for object instance re-identification.

Model Retrieval by 3D Sketching in Immersive Virtual Reality (2018)
Presentation / Conference Contribution
Giunchi, D., James, S., & Steed, A. (2018, March). Model Retrieval by 3D Sketching in Immersive Virtual Reality. Presented at IEEE Annual International Symposium Virtual Reality, Reutlingen, Germany

Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning (2018)
Presentation / Conference Contribution
Gay, P., James, S., & Del Bue, A. (2018, December). Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning. Presented at ACCV 2018: Computer Vision – ACCV 2018, Perth, Australia

Recent approaches on visual scene understanding attempt to build a scene graph – a computational representation of objects and their pairwise relationships. Such rich semantic representation is very appealing, yet difficult to obtain from a single im... Read More about Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning.

Multi-view Aggregation for Color Naming with Shadow Detection and Removal (2018)
Presentation / Conference Contribution
Dahy Elkhouly, M., James, S., & Del Bue, A. (2018, December). Multi-view Aggregation for Color Naming with Shadow Detection and Removal. Presented at 2018 IEEE International Conference on Image Processing, Applications and Systems (IPAS), Sophia Antipolis, France

This paper presents a set of methods for classifying the color attribute of objects when multiple images of the same objects are available. This problem is more complex than the single image estimation since varying environmental effects, such as, sh... Read More about Multi-view Aggregation for Color Naming with Shadow Detection and Removal.

3D Sketching in Virtual Reality for immersive model search (2018)
Presentation / Conference Contribution
Giunchi, D., James, S., & Steed, A. (2028, August). 3D Sketching in Virtual Reality for immersive model search. Presented at Expressive '18: Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering, Victoria, BC, Canada

We describe a novel method for searching 3D model collections using free-form sketches within a virtual environment as queries. As opposed to traditional sketch retrieval, our queries are drawn directly onto an example model. Using immersive virtual... Read More about 3D Sketching in Virtual Reality for immersive model search.

Evolutionary Data Purification for Social Media Classification (2016)
Presentation / Conference Contribution
James, S., & Collomosse, J. (2016, December). Evolutionary Data Purification for Social Media Classification. Presented at 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico

We present a novel algorithm for the semantic labeling of photographs shared via social media. Such imagery is diverse, exhibiting high intra-class variation that demands large training data volumes to learn representative classifiers. Unfortunately... Read More about Evolutionary Data Purification for Social Media Classification.