Construction and Application of Ancient Chinese Large Language Model

Li Shen, Hu Renfen and Wang Lijun

Chinese Journal of Language Policy and Planning ›› 2024, Vol. 9 ›› Issue (5) : 22-33.

Welcome to visit Chinese Journal of Language Policy and Planning!
Chinese Journal of Language Policy and Planning ›› 2024, Vol. 9 ›› Issue (5) : 22-33. DOI: 10.19689/j.cnki.cn10-1361/h.20240502

Construction and Application of Ancient Chinese Large Language Model

  • Li Shen, Hu Renfen and Wang Lijun
Author information +
History +

Abstract

General-purpose large language models demonstrate notable capabilities in language comprehension and generation, achieving results comparable to or surpassing human performance in many language information processing tasks. Nevertheless, when general models are applied to ancient Chinese texts, their effectiveness is often unsatisfactory. Similarly, fine-tuning open-source foundational models encounter difficulties in adequately incorporating domain-specific knowledge. To address this challenge, this study introduces a large language model, AI Taiyan, specifically designed for understanding and generating ancient Chinese. Experimental results show that with an appropriately designed model, data processing, foundational training, and fine-tuning, satisfactory results can be achieved with merely 1.8 billion parameters. In key tasks related to ancient Chinese information processing such as punctuation, identification of allusions, explanation of word meanings, and translation between ancient and modern Chinese, this model exhibits a clear advantage over both general-purpose large models and domain-specific models, achieving or surpassing human baseline performance. This research provides a reference framework for the efficient construction of specialized domain-specific large language models. Furthermore, the paper discusses the application of this model in fields such as the collation of ancient texts, dictionary editing, and language research, supplemented by case studies.

Key words

large language model / information processing of ancient Chinese / artificial intelligence

Cite this article

Download Citations
Li Shen, Hu Renfen and Wang Lijun. Construction and Application of Ancient Chinese Large Language Model[J]. Chinese Journal of Language Policy and Planning. 2024, 9(5): 22-33 https://doi.org/10.19689/j.cnki.cn10-1361/h.20240502

Accesses

Citation

Detail

Sections
Recommended

/