Simple Strategies to Select Layers for Fine-Tuning Language Encoders
Partner: Microsoft, MAIDAP
Participants: Gayatri Belapurkar, Saloni Chalkapurkar, Abhilasha Lodha, Yuanming Tao
Description: We proposed two-layer selection methods for fine-tuning language encoders that can comprehensively make the transfer learning process for common NLP tasks such as GLUE and SuperGLUE more resource efficient.