Skip to main content

Research Repository

Advanced Search

Outputs (663)

Dynamic Unary Convolution in Transformers (2023)
Journal Article
Duan, H., Long, Y., Wang, S., Zhang, H., Willcocks, C. G., & Shao, L. (2023). Dynamic Unary Convolution in Transformers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(11), 12747 - 12759. https://doi.org/10.1109/tpami.2022.3233482

It is uncertain whether the power of transformer architectures can complement existing convolutional neural networks. A few recent attempts have combined convolution with transformer design through a range of structures in series, where the main cont... Read More about Dynamic Unary Convolution in Transformers.

Using Model Explanations to Guide Deep Learning Models Towards Consistent Explanations for EHR Data (2022)
Journal Article
Watson, M., Awwad Shekh Hasan, B., & Al Moubayed, N. (2022). Using Model Explanations to Guide Deep Learning Models Towards Consistent Explanations for EHR Data. Scientific Reports, 12(19899), Article 19899. https://doi.org/10.1038/s41598-022-24356-6

It has been shown that identical Deep Learning (DL) architectures will produce distinct explanations when trained with different hyperparameters that are orthogonal to the task (e.g. random seed, training set order). In domains such as healthcare and... Read More about Using Model Explanations to Guide Deep Learning Models Towards Consistent Explanations for EHR Data.

A directed graph convolutional neural network for edge-structured signals in link-fault detection (2021)
Journal Article
Kenning, M., Deng, J., Edwards, M., & Xie, X. (2022). A directed graph convolutional neural network for edge-structured signals in link-fault detection. Pattern Recognition Letters, 153, 100-106. https://doi.org/10.1016/j.patrec.2021.12.003

The growing interest in graph deep learning has led to a surge of research focusing on learning various characteristics of graph-structured data. Directed graphs have generally been treated as incidental to definitions on the more general class of un... Read More about A directed graph convolutional neural network for edge-structured signals in link-fault detection.

Distillation of human–object interaction contexts for action recognition (2022)
Journal Article
Almushyti, M., & Li, F. W. (2022). Distillation of human–object interaction contexts for action recognition. Computer Animation and Virtual Worlds, 33(5), Article e2107. https://doi.org/10.1002/cav.2107

Modeling spatial-temporal relations is imperative for recognizing human actions, especially when a human is interacting with objects, while multiple objects appear around the human differently over time. Most existing action recognition models focus... Read More about Distillation of human–object interaction contexts for action recognition.

EfficientTDNN: Efficient Architecture Search for Speaker Recognition (2022)
Journal Article
Wang, R., Wei, Z., Duan, H., Ji, S., Long, Y., & Hong, Z. (2022). EfficientTDNN: Efficient Architecture Search for Speaker Recognition. IEEE/ACM Transactions on Audio, Speech and Language Processing, 30, 2267-2279. https://doi.org/10.1109/taslp.2022.3182856

Convolutional neural networks (CNNs), such as the time-delay neural network (TDNN), have shown their remarkable capability in learning speaker embedding. However, they meanwhile bring a huge computational cost in storage size, processing, and memory.... Read More about EfficientTDNN: Efficient Architecture Search for Speaker Recognition.