3 EMNLP

PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning

Findings of the Conference on Empirical Methods in Natural Language Processing (Findings of EMNLP) 2024 PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning Gyeongman Kim, Doohyuk Jang, Eunho Yang  Recent advancements in large lang...

2 EMNLP

Distilling Linguistic Context for Language Model Compression

EMNLP 2021 Distilling Linguistic Context for Language Model Compression Geondo Park, Gyeongman Kim, Eunho Yang  A computationally expensive and memory intensive neural network lies behind the recent success of language representation learning. Knowledge distillation, a major tech...

1 EMNLP

Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation

EMNLP 2020 Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation Minki Kang, Moonsu Han, Sung Ju Hwang  We propose a method to automatically generate a domain- and task-adaptive maskings of the given text for self-supervised pr...