![](https://ds.cs.umass.edu/wp-content/uploads/sites/53/2023/05/Microsoft_logo.svg_-1024x1024.png)
Simple Strategies to Select Layers for Fine-Tuning Language Encoders
Partner: Microsoft, MAIDAP
Participants: Gayatri Belapurkar, Saloni Chalkapurkar, Abhilasha Lodha, Yuanming Tao
Description: We proposed two-layer selection methods for fine-tuning language encoders that can comprehensively make the transfer learning process for common NLP tasks such as GLUE and SuperGLUE more resource efficient.