Lightweight Pre-Trained Korean Language Model Based on Knowledge Distillation and Low-Rank Factorization.

A notable trend in NLP research has been the continuous growth in the size of language models, leading to the development of large language models (LLMs) [ 6 , 7 , 8 , 9 , 10 , 11 ].

also in 2,380 other papers