Length is a Curse and a Blessing for Document-level Semantics
(2023)
Conference Proceeding
Xiao, C., Li, Y., Hudson, G. T., Lin, C., & Al Moubayed, N. (2023). Length is a Curse and a Blessing for Document-level Semantics.
In recent years, contrastive learning (CL) has been extensively utilized to recover sentence and document-level encoding capability from pre-trained language models. In this work, we question the length generalizability of CL-based models, i.e., thei... Read More about Length is a Curse and a Blessing for Document-level Semantics.