Length is a Curse and a Blessing for Document-level Semantics
(2023)
Presentation / Conference Contribution
Xiao, C., Li, Y., Hudson, G. T., Lin, C., & Al Moubayed, N. (2023, December). Length is a Curse and a Blessing for Document-level Semantics. Presented at The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), Singapore
In recent years, contrastive learning (CL) has been extensively utilized to recover sentence and document-level encoding capability from pre-trained language models. In this work, we question the length generalizability of CL-based models, i.e., thei... Read More about Length is a Curse and a Blessing for Document-level Semantics.