Language as a latent sequence: Deep latent variable models for semi-supervised paraphrase generation (2023)
Journal Article
Yu, J., Cristea, A. I., Harit, A., Sun, Z., Aduragba, O. T., Shi, L., & Al Moubayed, N. (2023). Language as a latent sequence: Deep latent variable models for semi-supervised paraphrase generation. AI open, 4, 19-32. https://doi.org/10.1016/j.aiopen.2023.05.001

This paper explores deep latent variable models for semi-supervised paraphrase generation, where the missing target pair for unlabelled data is modelled as a latent paraphrase sequence. We present a novel unsupervised model named variational sequence... Read More about Language as a latent sequence: Deep latent variable models for semi-supervised paraphrase generation.

Is Unimodal Bias Always Bad for Visual Question Answering? A Medical Domain Study with Dynamic Attention (2022)
Conference Proceeding
Sun, Z., Harit, A., Cristea, A. I., Yu, J., Al Moubayed, N., & Shi, L. (2022). Is Unimodal Bias Always Bad for Visual Question Answering? A Medical Domain Study with Dynamic Attention. . https://doi.org/10.1109/bigdata55660.2022.10020791

Medical visual question answering (Med-VQA) is to answer medical questions based on clinical images provided. This field is still in its infancy due to the complexity of the trio formed of questions, multimodal features and expert knowledge. In this... Read More about Is Unimodal Bias Always Bad for Visual Question Answering? A Medical Domain Study with Dynamic Attention.

Efficient Uncertainty Quantification for Multilabel Text Classification (2022)
Conference Proceeding
Yu, J., Cristea, A. I., Harit, A., Sun, Z., Aduragba, O. T., Shi, L., & Al Moubayed, N. (2022). Efficient Uncertainty Quantification for Multilabel Text Classification. . https://doi.org/10.1109/ijcnn55064.2022.9892871

Despite rapid advances of modern artificial intelligence (AI), there is a growing concern regarding its capacity to be explainable, transparent, and accountable. One crucial step towards such AI systems involves reliable and efficient uncertainty qua... Read More about Efficient Uncertainty Quantification for Multilabel Text Classification.

Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification (2022)
Conference Proceeding
Sun, Z., Harit, A., Cristea, A. I., Yu, J., Shi, L., & Al Moubayed, N. (2022). Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification. . https://doi.org/10.1109/ijcnn55064.2022.9892257

Graph neural networks (GNNs) have attracted extensive interest in text classification tasks due to their expected superior performance in representation learning. However, most existing studies adopted the same semi-supervised learning setting as the... Read More about Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification.

INTERACTION: A Generative XAI Framework for Natural Language Inference Explanations (2022)
Conference Proceeding
Yu, J., Cristea, A. I., Harit, A., Sun, Z., Aduragba, O. T., Shi, L., & Al Moubayed, N. (2022). INTERACTION: A Generative XAI Framework for Natural Language Inference Explanations. . https://doi.org/10.1109/ijcnn55064.2022.9892336

XAI with natural language processing aims to produce human-readable explanations as evidence for AI decisionmaking, which addresses explainability and transparency. However, from an HCI perspective, the current approaches only focus on delivering a s... Read More about INTERACTION: A Generative XAI Framework for Natural Language Inference Explanations.

In-Materio Extreme Learning Machines (2022)
Book Chapter
Jones, B. A., Al Moubayed, N., Zeze, D. A., & Groves, C. (2022). In-Materio Extreme Learning Machines. In G. Rudolph, A. V. Kononova, H. Aguirre, P. Kerschke, G. Ochoa, & T. Tušar (Eds.), Parallel Problem Solving from Nature – PPSN XVII (505-519). Springer Verlag. https://doi.org/10.1007/978-3-031-14714-2_35

Nanomaterial networks have been presented as a building block for unconventional in-Materio processors. Evolution in-Materio (EiM) has previously presented a way to congure and exploit physical materials for computation, but their ability to scale as... Read More about In-Materio Extreme Learning Machines.

Towards Intelligently Designed Evolvable Processors (2022)
Journal Article
Jones, B. A., Chouard, J. L., Branco, B. C., Vissol-Gaudin, E. G., Pearson, C., Petty, M. C., …Groves, C. (2022). Towards Intelligently Designed Evolvable Processors. Evolutionary Computation, 30(4), 479-501. https://doi.org/10.1162/evco_a_00309

Evolution-in-Materio is a computational paradigm in which an algorithm reconfigures a material’s properties to achieve a specific computational function. This paper addresses the question of how successful and well performing Evolution-in-Materio pro... Read More about Towards Intelligently Designed Evolvable Processors.

Enhanced Methods for Evolution in-Materio Processors (2022)
Conference Proceeding
Jones, B. A., Al Moubayed, N., Zeze, D. A., & Groves, C. (2022). Enhanced Methods for Evolution in-Materio Processors. . https://doi.org/10.1109/icrc53822.2021.00026

Evolution-in-Materio (EiM) is an unconventional computing paradigm, which uses an Evolutionary Algorithm (EA) to configure a material's parameters so that it can perform a computational task. While EiM processors show promise, slow manufacturing and... Read More about Enhanced Methods for Evolution in-Materio Processors.

A Generative Bayesian Graph Attention Network for Semi-supervised Classification on Scarce Data (2021)
Conference Proceeding
Sun, Z., Harit, A., Yu, J., Cristea, A., & Al Moubayed, N. (2021). A Generative Bayesian Graph Attention Network for Semi-supervised Classification on Scarce Data. . https://doi.org/10.1109/ijcnn52387.2021.9533981

This research focuses on semi-supervised classification tasks, specifically for graph-structured data under datascarce situations. It is known that the performance of conventional supervised graph convolutional models is mediocre at classification ta... Read More about A Generative Bayesian Graph Attention Network for Semi-supervised Classification on Scarce Data.

Confidence Measures for Carbon-Nanotube / Liquid Crystals Classifiers (2018)
Conference Proceeding
Vissol-Gaudin, E., Kotsialos, A., Groves, C., Pearson, C., Zeze, D., Petty, M., & Al-moubayed, N. (2018). Confidence Measures for Carbon-Nanotube / Liquid Crystals Classifiers. In 2018 IEEE Congress on Evolutionary Computation (CEC) : 8-13 July 2018, Rio de Janeiro, Brazil ; proceedings (646-653). https://doi.org/10.1109/cec.2018.8477779

This paper focuses on a performance analysis of single-walled-carbon-nanotube / liquid crystal classifiers produced by evolution in materio. A new confidence measure is proposed in this paper. It is different from statistical tools commonly used to e... Read More about Confidence Measures for Carbon-Nanotube / Liquid Crystals Classifiers.

An Exploration of Dropout with RNNs for Natural Language Inference (2018)
Conference Proceeding
Gajbhiye, A., Jaf, S., Al-Moubayed, N., McGough, A. S., & Bradley, S. (2018). An Exploration of Dropout with RNNs for Natural Language Inference. In V. Kurková, Y. Manolopoulos, B. Hammer, L. S. Iliadis, & I. G. Maglogiannis (Eds.), Artificial neural networks and machine learning - ICANN 2018 : 27th international Conference on Artificial Neural Networks, Rhodes, Greece, October 4-7, 2018, proceedings. Part III (157-167). https://doi.org/10.1007/978-3-030-01424-7_16

Dropout is a crucial regularization technique for the Recurrent Neural Network (RNN) models of Natural Language Inference (NLI). However, dropout has not been evaluated for the effectiveness at different layers and dropout rates in NLI models. In thi... Read More about An Exploration of Dropout with RNNs for Natural Language Inference.

Identifying Changes in the Cybersecurity Threat Landscape using the LDA-Web Topic Modelling Data Search Engine (2017)
Book Chapter
Al Moubayed, N., Wall, D., & McGough, A. (2017). Identifying Changes in the Cybersecurity Threat Landscape using the LDA-Web Topic Modelling Data Search Engine. In T. Tryfonas (Ed.), Human aspects of information security, privacy and trust : 5th International Conference, HAS 2017, held as part of HCI International 2017, Vancouver, BC, Canada, July 9-14, 2017, proceedings (287-295). Springer Verlag. https://doi.org/10.1007/978-3-319-58460-7_19

Successful Cybersecurity depends on the processing of vast quantities of data from a diverse range of sources such as police reports, blogs, intelligence reports, security bulletins, and news sources. This results in large volumes of unstructured tex... Read More about Identifying Changes in the Cybersecurity Threat Landscape using the LDA-Web Topic Modelling Data Search Engine.

Using Machine Learning in Trace-driven Energy-Aware Simulations of High-Throughput Computing Systems (2017)
Conference Proceeding
McGough, A. S., Al Moubayed, N., & M, F. (2017). Using Machine Learning in Trace-driven Energy-Aware Simulations of High-Throughput Computing Systems. In Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering Companion (ICPE '17 Companion), April 22 - 26, 2017, L’Aquila, Italy (55-60). https://doi.org/10.1145/3053600.3053612

When performing a trace-driven simulation of a High Throughput Computing system we are limited to the knowledge which should be available to the system at the current point within the simulation. However, the trace-log contains information we would n... Read More about Using Machine Learning in Trace-driven Energy-Aware Simulations of High-Throughput Computing Systems.

SMS Spam Filtering using Probabilistic Topic Modelling and Stacked Denoising Autoencoder (2016)
Conference Proceeding
Al Moubayed, N., Breckon, T., Matthews, P., & McGough, A. (2016). SMS Spam Filtering using Probabilistic Topic Modelling and Stacked Denoising Autoencoder. In A. E. P. Villa, P. Masulli, & A. J. Pons Rivero (Eds.), Artificial neural networks and machine learning – ICANN 2016 : 25th International Conference on Artificial Neural Networks, Barcelona, Spain, September 6-9, 2016 ; proceedings. Part II (423-430). https://doi.org/10.1007/978-3-319-44781-0_50

In This paper we present a novel approach to spam filtering and demonstrate its applicability with respect to SMS messages. Our approach requires minimum features engineering and a small set of labelled data samples. Features are extracted using topi... Read More about SMS Spam Filtering using Probabilistic Topic Modelling and Stacked Denoising Autoencoder.