LoRACSE
LoRACSE: Contrastive Learning of Sentence Embedding using LoRA
Last updated
LoRACSE: Contrastive Learning of Sentence Embedding using LoRA
Last updated
Proposed LoRACSE, a novel contrastive learning method for sentence embedding using LoRA. With 0.067% parameters of the SotA model, it remains comparable performance. Enhanced training efficiency while reducing computational resources.
Evaluated our method on different downstream tasks, including sentiment analysis and text classification with BERT and other contrastive learning models, showcasing comparable performance to SotA models.