On Isotropy, Contextualization and Learning Dynamics of Contrastive-based Sentence Representation Learning
(2023)
Presentation / Conference Contribution
Xiao, C., Long, Y., & Al Moubayed, N. (2023, July). On Isotropy, Contextualization and Learning Dynamics of Contrastive-based Sentence Representation Learning. Presented at Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada
Outputs (9)
Length is a Curse and a Blessing for Document-level Semantics (2023)
Presentation / Conference Contribution
Xiao, C., Li, Y., Hudson, G. T., Lin, C., & Al Moubayed, N. (2023, December). Length is a Curse and a Blessing for Document-level Semantics. Presented at The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), SingaporeIn recent years, contrastive learning (CL) has been extensively utilized to recover sentence and document-level encoding capability from pre-trained language models. In this work, we question the length generalizability of CL-based models, i.e., thei... Read More about Length is a Curse and a Blessing for Document-level Semantics.
PetBERT: automated ICD-11 syndromic disease coding for outbreak detection in first opinion veterinary electronic health records (2023)
Journal Article
Farrell, S., Appleton, C., Noble, P. M., & Al Moubayed, N. (2023). PetBERT: automated ICD-11 syndromic disease coding for outbreak detection in first opinion veterinary electronic health records. Scientific Reports, 13(1), Article 18015. https://doi.org/10.1038/s41598-023-45155-7Effective public health surveillance requires consistent monitoring of disease signals such that researchers and decision-makers can react dynamically to changes in disease occurrence. However, whilst surveillance initiatives exist in production anim... Read More about PetBERT: automated ICD-11 syndromic disease coding for outbreak detection in first opinion veterinary electronic health records.
Personalising monitoring for chemotherapy patients through predicting deterioration in renal and hepatic function (2023)
Journal Article
Chambers, P., Watson, M., Bridgewater, J., Forster, M. D., Roylance, R., Burgoyne, R., Masento, S., Steventon, L., Harmsworth King, J., Duncan, N., & al Moubayed, N. (2023). Personalising monitoring for chemotherapy patients through predicting deterioration in renal and hepatic function. Cancer Medicine, 12(17), 17856-17865. https://doi.org/10.1002/cam4.6418Background
In those receiving chemotherapy, renal and hepatic dysfunction can increase the risk of toxicity and should therefore be monitored. We aimed to develop a machine learning model to identify those patients that need closer monitoring, enabl... Read More about Personalising monitoring for chemotherapy patients through predicting deterioration in renal and hepatic function.
Predicting acute clinical deterioration with interpretable machine learning to support emergency care decision making (2023)
Journal Article
Boulitsakis Logothetis, S., Green, D., Holland, M., & Al Moubayed, N. (2023). Predicting acute clinical deterioration with interpretable machine learning to support emergency care decision making. Scientific Reports, 13(1), Article 13563. https://doi.org/10.1038/s41598-023-40661-0The emergency department (ED) is a fast-paced environment responsible for large volumes of patients with varied disease acuity. Operational pressures on EDs are increasing, which creates the imperative to efficiently identify patients at imminent ris... Read More about Predicting acute clinical deterioration with interpretable machine learning to support emergency care decision making.
Addressing Performance Inconsistency in Domain Generalization for Image Classification (2023)
Presentation / Conference Contribution
Stirling, J., & Moubayed, N. A. (2023, June). Addressing Performance Inconsistency in Domain Generalization for Image Classification. Presented at 2023 International Joint Conference on Neural Networks (IJCNN), Gold Coast, AustraliaDomain Generalization (DG) in computer vision aims to replicate the human ability to generalize well under a shift of data distribution, or domain. In recent years, the field of domain generalization has seen a steady increase in average left-out tes... Read More about Addressing Performance Inconsistency in Domain Generalization for Image Classification.
Natural Language Explanations for Machine Learning Classification Decisions (2023)
Presentation / Conference Contribution
Burton, J., Al Moubayed, N., & Enshaei, A. (2023, June). Natural Language Explanations for Machine Learning Classification Decisions. Presented at 2023 International Joint Conference on Neural Networks (IJCNN), Gold Coast, AustraliaThis paper addresses the challenge of providing understandable explanations for machine learning classification decisions. To do this, we introduce a dataset of expert-written textual explanations paired with numerical explanations, forming a data-to... Read More about Natural Language Explanations for Machine Learning Classification Decisions.
Language as a latent sequence: Deep latent variable models for semi-supervised paraphrase generation (2023)
Journal Article
Yu, J., Cristea, A. I., Harit, A., Sun, Z., Aduragba, O. T., Shi, L., & Al Moubayed, N. (2023). Language as a latent sequence: Deep latent variable models for semi-supervised paraphrase generation. AI open, 4, 19-32. https://doi.org/10.1016/j.aiopen.2023.05.001This paper explores deep latent variable models for semi-supervised paraphrase generation, where the missing target pair for unlabelled data is modelled as a latent paraphrase sequence. We present a novel unsupervised model named variational sequence... Read More about Language as a latent sequence: Deep latent variable models for semi-supervised paraphrase generation.
Negation Invariant Representations of 3D Vectors for Deep Learning Models applied to Fault Geometry Mapping in 3D Seismic Reflection Data (2023)
Journal Article
Kluvanec, D., McCaffrey, K. J., Phillips, T. B., & Al Moubayed, N. (2023). Negation Invariant Representations of 3D Vectors for Deep Learning Models applied to Fault Geometry Mapping in 3D Seismic Reflection Data. IEEE Transactions on Geoscience and Remote Sensing, 61, https://doi.org/10.1109/tgrs.2023.3273329We can represent the orientation of a plane in 3D by its normal vector. However, every plane has two normal vectors that are negatives of each other. We propose four novel representations of vectors in 3D that are negation invariant and can be used b... Read More about Negation Invariant Representations of 3D Vectors for Deep Learning Models applied to Fault Geometry Mapping in 3D Seismic Reflection Data.