Skip to main content

Research Repository

Advanced Search

All Outputs (40)

PaintBranch: Asynchronous Collaborative Art in Virtual Reality (2025)
Presentation / Conference Contribution
David, A., Giunchi, D., James, S., Steed, A., & Esteves, A. (2025, March). PaintBranch: Asynchronous Collaborative Art in Virtual Reality. Presented at 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Saint Malo, France

We describe the development of PaintBranch, a virtual reality prototype designed to support asynchronous collaborative art. By incorporating version control (VC), PaintBranch aims to promote creative idea generation and reduce conflicts during collab... Read More about PaintBranch: Asynchronous Collaborative Art in Virtual Reality.

Interactive Digital Storytelling Navigating the Inherent Currents of the Diasporic Mind (2024)
Presentation / Conference Contribution
Nisi, V., Bala, P., Pessoa, M., James, S., & Nunes, N. (2024, December). Interactive Digital Storytelling Navigating the Inherent Currents of the Diasporic Mind. Presented at International Conference on Interactive Digital Storytelling (ICIDS 2024), Barranquilla, Colombia

Due to a recent increase in conflicts, natural disasters, and economic crises, a growing wave of migrant populations has been searching for asylum in Europe. For this population of asylum seekers, the migration process, like currents and rapids, can... Read More about Interactive Digital Storytelling Navigating the Inherent Currents of the Diasporic Mind.

6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model (2024)
Presentation / Conference Contribution
Matteo, B., Tsesmelis, T., James, S., Poiesi, F., & Del Bue, A. (2024, September). 6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model. Presented at Computer Vision – ECCV 2024 18th European Conference, Milan, Italy

We propose 6DGS to estimate the camera pose of a target RGB image given a 3D Gaussian Splatting (3DGS) model representing the scene. 6DGS avoids the iterative process typical of analysis-by-synthesis methods (e. g.iNeRF) that also require an initiali... Read More about 6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model.

GANzzle + + : Generative approaches for jigsaw puzzle solving as local to global assignment in latent spatial representations (2024)
Journal Article
Talon, D., Del Bue, A., & James, S. (2025). GANzzle + + : Generative approaches for jigsaw puzzle solving as local to global assignment in latent spatial representations. Pattern Recognition Letters, 187, 35-41. https://doi.org/10.1016/j.patrec.2024.11.010

Jigsaw puzzles are a popular and enjoyable pastime that humans can easily solve, even with many pieces. However, solving a jigsaw is a combinatorial problem, and the space of possible solutions is exponential in the number of pieces, intractable for... Read More about GANzzle + + : Generative approaches for jigsaw puzzle solving as local to global assignment in latent spatial representations.

Maps from Motion (MfM): Generating 2D Semantic Maps from Sparse Multi-view Images (2024)
Presentation / Conference Contribution
Toso, M., Fiorini, S., James, S., & Del Bue, A. (2025, March). Maps from Motion (MfM): Generating 2D Semantic Maps from Sparse Multi-view Images. Presented at International Conference on 3D Vision (3DV), Singapore

World-wide detailed 2D maps require enormous collective efforts. OpenStreetMap is the result of 11 million registered users manually annotating the GPS location of over 1.75 billion entries, including distinctive landmarks and common urban objects. A... Read More about Maps from Motion (MfM): Generating 2D Semantic Maps from Sparse Multi-view Images.

Positional diffusion: Graph-based diffusion models for set ordering (2024)
Journal Article
Giuliari, F., Scarpellini, G., Fiorini, S., James, S., Morerio, P., Wang, Y., & Del Bue, A. (2024). Positional diffusion: Graph-based diffusion models for set ordering. Pattern Recognition Letters, 186, 272-278. https://doi.org/10.1016/j.patrec.2024.10.010

Positional reasoning is the process of ordering an unsorted set of parts into a consistent structure. To address this problem, we present Positional Diffusion, a plug-and-play graph formulation with Diffusion Probabilistic Models. Using a diffusion p... Read More about Positional diffusion: Graph-based diffusion models for set ordering.

ArtAI4DS: AI Art and Its Empowering Role in Digital Storytelling (2024)
Presentation / Conference Contribution
Fernandes, T., Nisi, V., Nunes, N., & James, S. (2024, September). ArtAI4DS: AI Art and Its Empowering Role in Digital Storytelling. Presented at IFIP International Conference on Entertainment Computing, Manaus, Brazil

In an era of global interconnections, storytelling is a compelling medium for fostering understanding, building connections, and facilitating cultural exchange. Throughout history, visual imagery has been used to enrich narratives. However, this has... Read More about ArtAI4DS: AI Art and Its Empowering Role in Digital Storytelling.

Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving (2024)
Presentation / Conference Contribution
Tsesmelis, T., Palmieri, L., Khoroshiltseva, M., Islam, A., Elkin, G., Itzhak Shahar, O., Scarpellini, G., Fiorini, S., Ohayon, Y., Alali, N., Aslan, S., Morerio, P., Vascon, S., gravina, E., Cristina Napolitano, M., Scarpati, G., zuchtriegel, G., Spühler, A., Fuchs, M. E., James, S., …Del Bue, A. (2024, December). Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving. Presented at Conference on Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, Vancouver, Canada

This paper proposes the RePAIR dataset that represents a challenging benchmark to test modern computational and data driven methods for puzzle-solving and reassembly tasks. Our dataset has unique properties that are uncommon to current benchmarks for... Read More about Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving.

PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections* (2024)
Presentation / Conference Contribution
Taiana, M., Toso, M., James, S., & Bue, A. D. (2024, March). PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections*. Presented at 2024 International Conference on 3D Vision (3DV), Davos, Switzerland

Robustly estimating camera poses from a set of images is a fundamental task which remains challenging for differentiable methods, especially in the case of small and sparse camera pose graphs. To overcome this challenge, we propose Pose-refined Rotat... Read More about PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections*.

IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model (2024)
Presentation / Conference Contribution
Bortolon, M., Tsesmelis, T., James, S., Poiesi, F., & Bue, A. D. (2024, May). IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model. Presented at 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan

We introduce IFFNeRF to estimate the six degrees-of-freedom (6DoF) camera pose of a given image, building on the Neural Radiance Fields (NeRF) formulation. IFFNeRF is specifically designed to operate in real-time and eliminates the need for an initia... Read More about IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model.

Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins (2023)
Presentation / Conference Contribution
Nisi, V., James, S., Bala, P., Del Bue, A., & Jardim Nunes, N. (2023, November). Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins. Presented at 16th International Conference on Interactive Digital Storytelling, ICIDS 2023, Kobe, Japan

As the concept of the Metaverse becomes a reality, storytelling tools sharpen their teeth to include Artificial Intelligence and Augmented Reality as prominent enabling features. While digitally savvy and privileged populations are well-positioned to... Read More about Inclusive Digital Storytelling: Artificial Intelligence and Augmented Reality to re-centre Stories from the Margins.

Geolocation of Cultural Heritage using Multi-View Knowledge Graph Embedding (2023)
Presentation / Conference Contribution
Mohamed, H. A., Vascon, S., Hibraj, F., James, S., Pilutti, D., Del Bue, A., & Pelillo, M. (2022, August). Geolocation of Cultural Heritage using Multi-View Knowledge Graph Embedding. Presented at International Conference on Pattern Recognition (ICPR) 2022 International Workshops and Challenge, Montreal, Canada

GANzzle: Reframing jigsaw puzzle solving as a retrieval task using generative mental images (2022)
Presentation / Conference Contribution
Talon, D., Del Bue, A., & James, S. (2022, October). GANzzle: Reframing jigsaw puzzle solving as a retrieval task using generative mental images. Presented at IEEE International Conference on Image Processing, Bordeaux, France

Puzzle solving is a combinatorial challenge due to the difficulty of matching adjacent pieces. Instead, we infer a mental image from all pieces, which a given piece can then be matched against avoiding the combinatorial explosion. Exploiting advancem... Read More about GANzzle: Reframing jigsaw puzzle solving as a retrieval task using generative mental images.

Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling using Crowd-Generated Content (2022)
Presentation / Conference Contribution
Bala, P., James, S., Del Bue, A., & Nisi, V. (2022, December). Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling using Crowd-Generated Content. Presented at Interactive Storytelling (ICIDS 2022), Santa Cruz, USA

Digital Storytelling can exploit numerous technologies and sources of information to support the creation, refinement and enhancement of a narrative. Research on text editing tools has created novel interactions that support authors in different stag... Read More about Writing with (Digital) Scissors: Designing a Text Editing Tool for Assisted Storytelling using Crowd-Generated Content.

Multi-view 3D Objects Localization from Street-level Scenes (2022)
Presentation / Conference Contribution
Ahmad, J., Toso, M., Taiana, M., James, S., & Del Bue, A. (2022, May). Multi-view 3D Objects Localization from Street-level Scenes. Presented at Image Analysis and Processing – ICIAP 2022, Lecce, Italy

Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity (2021)
Presentation / Conference Contribution
Dionísio, M., Nisi, V., Xin, J., Bala, P., James, S., & Jardim Nunes, N. (2021, November). Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity

The use of Conversational Interfaces has evolved rapidly in numerous fields; in particular, they are an interesting tool for Serious Games to leverage on. Conversational Interfaces can assist Serious Games’ goals, namely in presenting knowledge throu... Read More about Amnesia in the Atlantic: an AI Driven Serious Game on Marine Biodiversity.