Research on Named Entity Recognition in Low-Resource Corpus Based on Improved RoBERTa-BiLSTM-CRF: A Case Study of the Intangible Cultural Heritage Text Yimakan
Sun Ruiying, Wang Si. Research on Named Entity Recognition in Low-Resource Corpus Based on Improved RoBERTa-BiLSTM-CRF: A Case Study of the Intangible Cultural Heritage Text Yimakan[J]. Libraly Journal, 2026, 45(7): 68-77.
[1] Pakhale, K. Comprehensive overview of named entity recognition: models, domain specific applications and challenges[PP/OL].arXiv[2025-08-01]. https://arxiv.org/html/2309.14084v1.
[2] 焦凯楠,李欣,朱容辰.中文领域命名实体识别综述[J].计算机工程与应用,2021, 57(16): 1-15.
[3] Zheng S C, Wang F, Bao H Y, et al. Joint extraction of entities and relations based on a novel tagging scheme[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics(Volume 1: Long Papers). ACL, 2017: 1227-1236.
[4] Li J, Sun A X, Han J L, et al. A survey on deep learning for named entity recognition[J]. IEEE Transactions on Knowledge and Data Engineering, 2022, 34(1): 50-70.
[5] Grishman R, Sundheim B. Message understanding conference6: a brief history[C]//COLING 1996 Volume 1: the 16th International Conference on Computational Linguistics. Association for Computational Linguistics, 1996:466-471.
[6] 李冬梅,罗斯斯,张小平,等.命名实体识别方法研究综述[J].计算机科学与探索,2022, 16(9): 1954-1968.
[7] Li K L, Ai W, Tang Z, et al. Hadoop recognition of biomedical named entity using conditional random fields[J]. IEEE Transactions on Parallel and Distributed Systems, 2015, 26(11): 3040-3051.
[8] Cortes C, Vapnik V. Supportvector networks[J]. Machine Learning, 1995, 20(3): 273-297.
[9] Mor B, Garhwal S, Kumar A. A systematic review of hidden Markov models and their applications[J]. Archives of Computational Methods in Engineering, 2021, 28(3): 1429-1448.
[10] Huang Z H, Xu W, Yu K. Bidirectional LSTM-CRF models for sequence tagging[PP/OL]. arXiv(2015-08-09)[2025-08-02]. https://doi.org/10.48550/arXiv.1508.01991.
[11] ukovGregoricˇ A, Bachrach Y, Coope S. Named entity recognition with parallel recurrent neural networks[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics(Volume 2: Short Papers). ACL, 2018: 69-74.
[12] 王佳雯,王剑,线岩团,等.融入中心句的涉案新闻要素实体识别方法[J].通信技术,2021, 54(4): 835-841.
[13] Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[J/OL]. Advances in Neural Information Processing Systems. [2025-08-02]. https://papers.nips.cc/paper/7181attentionisallyouneed.pdf.
[14] Devlin J, Chang M W, Lee K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[PP/OL]. V2. arXiv(2019-05-24)[2025-07-02]. https://doi.org/10.48550/arXiv.1810.04805.
[15] Liu Y H, Ott M, Goyal N, et al. RoBERTa: a robustly optimized BERT pretraining approach[PP/OL]. arXiv(2019-07-26)[2025-06-24]. https://doi.org/10.48550/arXiv.1907.11692.
[16] Lan Z Z, Chen M D, Goodman S, et al. ALBERT: a lite BERT for self-supervised learning of language representations[PP/OL]. V6. arXiv(2020-02-09)[2025-08-01]. https://doi.org/10.48550/arXiv.1909.11942.
[17] Clark K, Luong M T, Le Q V, et al. ELECTRA: pretraining text encoders as discriminators rather than generators[PP/OL]. arXiv(2020-03-23)[2025-06-06]. https://doi.org/10.48550/arXiv.2003.10555.
[18] Dong C H, Zhang J J, Zong C Q, et al. Character-based LSTM-CRF with radical-level features for Chinese named entity recognition[C]//Lin C Y, Xue N W, Zhao D Y, et al. Natural Language Understanding and Intelligent Applications. Cham: Springer, 2016: 239-250.
[19] 龙星全,李佳.基于Bert-BiLSTM-CRF模型的中文命名实体识别[J].吉林大学学报(信息科学版),2025, 43(2): 384-393.
[20] 张颖怡,章成志,周毅,等.基于ChatGPT的多视角学术论文实体识别:性能测评与可用性研究[J].数据分析与知识发现,2023, 7(9): 12-24.
[21] 赵萌,王昊,李晓敏.中国民歌多情感识别及情感变化规律分析研究[J].数据分析与知识发现,2023, 7(7): 111-124.
[22] 张卫,王昊,李晓敏,等.数字人文视角下古诗意象知识抽取及其文化图式构建研究[J].图书情报工作,2022, 66(24): 104-117.
[23] 胡昊天,邓三鸿,张逸勤,等.数字人文视角下的非物质文化遗产文本自动分词及应用研究[J].图书馆杂志,2022, 41(8): 76-83.
[24] 刘江峰,冯钰童,王东波,等.数字人文视域下SikuBERT增强的史籍实体识别研究[J].图书馆论坛,2022, 42(10): 61-72.
[25] 武帅,杨秀璋,何琳,等.基于句法特征和BertBiLSTMMHACRF的细粒度古籍实体识别研究[J].数据分析与知识发现,2024, 8(12): 136-148.
[26] 林立涛,王东波,刘江峰,等.数字人文视域下典籍动物命名实体识别研究——以SikuBERT预训练模型为例[J].图书馆论坛,2022, 42(10): 42-50.
[27] 吴梦成,林立涛,齐月,等.数字人文视域下先秦典籍植物知识挖掘与组织研究[J].图书情报工作,2023, 67(12): 103-113.
[28] 闾晴.古代中国医学文献术语自动抽取研究[D].南京:南京农业大学,2023.
[29] 崔斌,王东波,黄水清.基于“食货志”典籍文本的农作物空间分布特征研究[J].图书情报工作,2024, 68(8): 133-145.
[30] 刘佳,边俊伊.基于混合深度学习的藏医古籍命名实体识别研究[J].现代情报,2023, 43(11): 37-46.
[31] 贾玉祥,晁睿,昝红英,等.融入篇章信息的文学作品命名实体识别[J].中文信息学报,2023, 37(11): 100-109.
[32] Barros C, Vicente M, Lloret E. Tackling the challenge of computational identification of characters in fictional narratives[C]//2019 IEEE International Conference on Cognitive Computing(ICCC). IEEE, 2019: 122-129.
[33] 郭顺利,苏新宁,房旭辉.融合NER和Apriori算法的游记文本关联知识挖掘及推荐服务研究[J].现代情报,2023, 43(11): 123-134.
[34] 徐晨飞,叶海影,包平.基于深度学习的方志物产资料实体自动识别模型构建研究[J].数据分析与知识发现,2020, 4(8): 86-97.
[35] 李娜.基于深度学习的《方志物产》用途实体自动识别模型构建与应用[J].数字图书馆论坛,2022, 18(12): 19-28.
[36] 王雨生.数字人文视域下红色文献资源知识图谱构建研究[D].长春:长春师范大学,2023.
[37] 崔金英,颜佳.基于深度学习模型的命名实体识别对比研究——以民国电影类期刊为例[J].图书馆杂志,2025, 44(1): 108-119.
[38] 张卫东,陈希鹏,李心怡,等.基于多任务联合学习的长白山民间文学实体抽取方法研究[J].现代情报,2025, 45(5): 15-23; 98.
[39] 刘浏,王东波.命名实体识别研究综述[J].情报学报,2018, 37(3): 329-340.
[40] 陈亮,杜新宇.结构化数据的关系抽取系统的设计与实现[J].信息技术,2020, 44(12): 48-52.
[41] 环科尤,华却才让,才让当知,等.基于深度学习的格萨尔史诗命名实体识别研究[J].中文信息学报,2022, 36(8): 46-53.