Skip to main content

Research Repository

Advanced Search

Outputs (32)

Self-Regulated Sample Diversity in Large Language Models (2024)
Presentation / Conference Contribution
Liu, M., Frawley, J., Wyer, S., Shum, H. P. H., Uckelman, S. L., Black, S., & Willcocks, C. G. (2024, June). Self-Regulated Sample Diversity in Large Language Models. Presented at NAACL 2024: 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Mexico City

∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified States (2024)
Presentation / Conference Contribution
Bond-Taylor, S., & Willcocks, C. G. (2024, May). ∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified States. Presented at The International Conference on Learning Representations (ICLR), Vienna Austria

This paper introduces ∞-Diff, a generative diffusion model defined in an infinite-dimensional Hilbert space, which can model infinite resolution data. By training on randomly sampled subsets of coordinates and denoising content only at those location... Read More about ∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified States.

Unaligned 2D to 3D Translation with Conditional Vector-Quantized Code Diffusion using Transformers (2023)
Presentation / Conference Contribution
Corona-Figueroa, A., Bond-Taylor, S., Bhowmik, N., Gaus, Y. F. A., Breckon, T. P., Shum, H. P., & Willcocks, C. G. (2023, October). Unaligned 2D to 3D Translation with Conditional Vector-Quantized Code Diffusion using Transformers. Presented at ICCV23: 2023 IEEE/CVF International Conference on Computer Vision, Paris, France

Generating 3D images of complex objects conditionally from a few 2D views is a difficult synthesis problem, compounded by issues such as domain gap and geometric misalignment. For instance, a unified framework such as Generative Adversarial Networks... Read More about Unaligned 2D to 3D Translation with Conditional Vector-Quantized Code Diffusion using Transformers.

Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields (2023)
Presentation / Conference Contribution
Isaac-Medina, B., Willcocks, C., & Breckon, T. (2023, June). Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields. Presented at IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023, Vancouver, BC

Neural Radiance Fields (NeRF) have attracted significant attention due to their ability to synthesize novel scene views with great accuracy. However, inherent to their underlying formulation, the sampling of points along a ray with zero width may res... Read More about Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields.

Dynamic Unary Convolution in Transformers (2023)
Journal Article
Duan, H., Long, Y., Wang, S., Zhang, H., Willcocks, C. G., & Shao, L. (2023). Dynamic Unary Convolution in Transformers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(11), 12747 - 12759. https://doi.org/10.1109/tpami.2022.3233482

It is uncertain whether the power of transformer architectures can complement existing convolutional neural networks. A few recent attempts have combined convolution with transformer design through a range of structures in series, where the main cont... Read More about Dynamic Unary Convolution in Transformers.

Denoising Diffusion Probabilistic Models on SO(3) for Rotational Alignment (2022)
Presentation / Conference Contribution
Leach, A., Schmon, S. M., Degiacomi, M. T., & Willcocks, C. G. (2022, April). Denoising Diffusion Probabilistic Models on SO(3) for Rotational Alignment. Presented at ICLR 2022 Workshop on Geometrical and Topological Representation Learning

Probabilistic diffusion models are capable of modeling complex data distributions on high-dimensional Euclidean spaces for a range applications. However, many real world tasks involve more complex structures such as data distributions defined on mani... Read More about Denoising Diffusion Probabilistic Models on SO(3) for Rotational Alignment.

Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes (2022)
Presentation / Conference Contribution
Bond-Taylor, S., Hessey, P., Sasaki, H., Breckon, T., & Willcocks, C. (2022, October). Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes. Presented at ECCV 2022: European Conference on Computer Vision, Tel Aviv, Israel

Whilst diffusion probabilistic models can generate high quality image content, key limitations remain in terms of both generating high-resolution imagery and their associated high computational requirements. Recent Vector-Quantized image models have... Read More about Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes.

MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray (2022)
Presentation / Conference Contribution
Corona-Figueroa, A., Frawley, J., Bond-Taylor, S., Bethapudi, S., Shum, H. P., & Willcocks, C. G. (2022, July). MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray. Presented at 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, Scotland

Computed tomography (CT) is an effective med-ical imaging modality, widely used in the field of clinical medicine for the diagnosis of various pathologies. Advances in Multidetector CT imaging technology have enabled additional functionalities, inclu... Read More about MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray.

Multi-view Vision Transformers for Object Detection (2022)
Presentation / Conference Contribution
Isaac-Medina, B., Willcocks, C., & Breckon, T. (2022, August). Multi-view Vision Transformers for Object Detection. Presented at International Conference on Pattern Recognition, Montreal, Canada