Research on the Construction and Application of Intelligent Reference Service in University Libraries Based on Large Language Model: A Case Study of Shandong University Library

Abstract

Abstract: With the rapid development of artificial intelligence technology, university libraries need toinnovate the reference service models. This paper proposes a solution combining “pre-trained models+alocal knowledge base” to build an intelligent reference service system powered by large language models.Through the organic integration of four layers: data resources, model training, application services, andinteractive display, the system enhances the human-computer and human-AI collaboration capabilities ofintelligent libraries. Taking Shandong University Library as an example, this paper elaborates the specificapplication and effectiveness evaluation results of the system in management service, space service,resource service and other scenarios. The research shows that the system has significant advantages inimproving service efficiency and optimizing user experience, offering more comprehensive, detailed andpersonalized consultation services. This provides a new solution and practical path for university librariesto carry out intelligent services.

Key words: Large language model, Reference service, Knowledge service, Smart library, University library

Fu Guorui, Wang Pingli, Wang Yizhan, Song Xigui(Shandong University Library). Research on the Construction and Application of Intelligent Reference Service in University Libraries Based on Large Language Model: A Case Study of Shandong University Library[J]. Libraly Journal, 2025, 44(416): 31-40.

References

[ 1 ] 国务院. 中共中央国务院印发《数字中国建设整体布局规划》[EB / OL]. [2024-02-29]. https / /www. gov. cn / zhengce/ 2023-02/ 27/ content_5743484.htm.
[ 2 ] 中央网信办,教育部,工业和信息化部,等. 中央网信办等四部门印发《2022 年提升全民数字素养与技能工作要点》[EB / OL]. [2024-02-29]. http / /www. cac. gov. cn / 2022-03 / 02 / c _1647826931080748. htm eqid=a49d97a3001427d40000000364560c35 .

[ 3 ] 陆伟,刘家伟,马永强,等. ChatGPT 为代表的大模型对信息资源管理的影响[J]. 图书情报知识, 2023, 40(2):6 9; 70 .

[ 4 ] Buehler M J. Mechgpt a language-based strategyfor mechanics and materials modeling that connectsknowledge across scales disciplines and modalities J .Applied Mechanics Reviews 2024 76 2 021001 .

[ 5 ] Bhatia G El M B N Cavusoglu H et al. Fintrala family of gpt-4 level multimodal financial largelanguage models J / OL . Arxiv. 2024-06-14 .https / / arxiv. org / html / 2402. 10986v3 .

[ 6 ] Wu S Fei H Qu L et al. Next-gpt any-to-anymultimodal llm J / OL . Arxiv. 2024-06-25 .https / / arxiv. org / html / 2309. 05519v3 .

[ 7 ] 清华大学. Thudm / chatglm-6b EB / OL . 2024-04-14 . https / / github. com/ THUDM/ ChatGLM-6B .

[ 8 ] 北京大学. Github-pku-yuangroup / chatlaw:中文法律大模型[ EB / OL ]. [ 2024-04-14 ]. https / /github. com / PKU-YuanGroup / ChatLaw .

[ 9 ] 上海交通大学. Waic 2023 |白玉兰科学大模型发布[ EB / OL ]. [ 2024-04-14 ]. https / / mp.weixin. qq. com / s / 3eON8L4b7-d-1URwgdR6Bg .

[10] 云瀚应用“chatbk1. 0 博看智慧咨询”简介[EB /OL ]. [ 2024-03-17 ]. https / / www. calsp. cn /2023 / 10 / 20 / bulletin-202310-01 .

[11] 郭亚军,寇旭颍,冯思倩,等. 大语言模型赋能图书馆参考咨询服务:逻辑、场景与体系[J]. 图书馆论坛,2025(1):118 127 .

[12] 张鹤译,王鑫,韩立帆,等. 大语言模型融合知识图谱的问答系统研究[J]. 计算机科学与探索, 2023, 17(10):2377 2388 .

[13] 文森,钱力,胡懋地,等. 基于大语言模型的问答技术研究进展综述[J]. 数据分析与知识发现,2024(6): 16 29 .

[14] 王翼虎,白海燕,孟旭阳. 大语言模型在图书馆参考咨询服务中的智能化实践探索[J]. 情报理论与实践,2023, 46(8):96 103 .

[15] 张银玲. 基于“知识库+AIML”的高校图书馆智能参考咨询服务[J]. 长江信息通信,2022 (9): 229 231. [16] 吴进,冯劭华,昝栋. ChatGPT 与高校图书馆参考咨询服务[J]. 大学图书情报学刊,2023, 41(5): 25 29. [ 17 ] Lian Z Sun L Sun H et al. Gpt-4v withemotion a zero-shot benchmark for generalizedemotion recognition J . Information Fusion2024 108 102367 .

[18] Klimkowski K. Deepl translate and deepl write astools for text mediation in plurilingual workplaces J .Academic Journal of Modern Philology 2023 19 .

[19] 李卫姣,蔡迎春,王润凝. AI 驱动下大学图书馆的角色重塑与战略整合[ J]. 图书馆杂志,2024(11):50 60 .

[20] Longpre S Le Hou Vu T et al. The flan collectiondesigning data and methods for effectiveinstruction tuning J . Arxiv 2201. 13688 2023 .

[21] Christiano P Leike J Brown T B et al. Deepreinforcement learning from human preferences J .Advances in Neural Information Processing Systems2017 4302 4310 .

[22] 赵鑫,窦志成,文继荣. 大语言模型时代下的信息检索研究发展趋势[J]. 中国科学基金,2023, 37(5): 786 792 .

[23] Wei J Tay Y Bommasani R et al. Emergentabilities of large language models J . Arxiv 2206.07682 2022 .

[24] Brown T B Mann B Ryder N et al. Languagemodels are few-shot learners J . Advances inNeural Information Processing Systems 2020 331877 1901 .

[25] Wei J Wang X Schuurmans D et al. Chain-ofthoughtprompting elicits reasoning in largelanguage models J . Advances in NeuralInformation Processing Systems 2023 35 2482424837. [26] Sun T Shao Y Qian H et al. Black-box tuningfor language-model-as-a-service J . Arxiv 2201.03514 2022. [27] 罗飞,崔滨,辛小江,等. 大语言模型嵌入图书馆知识服务的风险范式与管控策略[J]. 图书与情报,2023(3):99 106 .

[28] 郭利敏,付雅明. 以大语言模型构建智慧图书馆:框架和未来[J]. 图书馆杂志,2023, 42 (11 ): 22 30 .

[29] 刘倩倩,刘圣婴,刘炜. 图书情报领域大模型的应用模式和数据治理[J]. 图书馆杂志,2023(12): 22 35 .

[30] Hendrycks D Burns C Basart S et al. Measuringmassive multitask language understanding J .Arxiv 2009. 03300 2020 .

[31] Huang Y Bai Y Zhu Z et al. C-eval a multilevelmulti-discipline chinese evaluation suite forfoundation models J . Arxiv 2305. 08322 2023 .

[32 ] Cobbe K Kosaraju V Bavarian M et al.Training verifiers to solve math word problems J .Arxiv 2110. 14168 2021 .

[33] Chen M Tworek J Jun H et al. Evaluating largelanguage models trained on code J . Arxiv 2107.03374 2021 .

[34] Es S James J Espinosa-Anke L et al. Ragasautomated evaluation of retrieval augmentedgeneration J . Arxiv 2309. 15217 2023 .

[35] 腾讯云智服数智化驱动服务的先行者[EB / OL] .

[ 2024-04-05 ]. https / / yzf. qq. com / xv / html /admin / chat / home .

[36 ] Green B F Wolf A K Chomsky C et al.Baseball an automatic question-answerer C .Papers presented at the May 9-11 1961 Westernjoint IRE-AIEE-ACM computer conference 1961219 224 .

[37 ] Woods W A. Lunar rocks in natural englishexplorations in natural language question answeringZ North Holland 1977 2024 521 569.

[1]	Wang Xiyu1 2, Wang Dongbo1 2（1 College of Information Management NanjingAgricultural University 2 Research Center for Humanities and Social Computing Nanjing AgriculturalUniversity）. Research on Automatic Word Segmentation of Cross-Language Classics Based on Large Language Model [J]. Libraly Journal, 2025, 44(413): 104-115.
[2]	Wei Guangqi1, Sun Tao2, Lu Weiping1, Chen Jia2（1 Guangzhou Academy of FineArts Library 2 Guangzhou Academy of Fine Arts Information Fechnology Center）. Art University Libraries from the Perspective of Future Learning Centers: Development Direction and Role Transformation [J]. Libraly Journal, 2025, 44(413): 83-92.
[3]	Jia Minghua, Ji Fan, Zhang Yuanjun, Zhao Jingru （Peking University Library）. Research and Practice on Literature Donation Management Platform from the Perspective of User Demand: A Case Study of Peking University Library [J]. Libraly Journal, 2025, 44(413): 64-72.
[4]	Zhang Chunmei, Hou Xi （Fudan University Library）. Cultural and Creative Concepts and Product Development Practices from the Perspective of University Library [J]. Libraly Journal, 2025, 44(413): 46-55.
[5]	Yu Caihua Nie Haoshuang School of Management Science and Engineering NanjingUniversity of Information Science and Technology. Evolutionary Interpretation, Driving Forces and Value Propositionof Smart Libraries: An Analysis Based on Introduction to SmartLibraries [J]. Libraly Journal, 2025, 44(412): 109-115.
[6]	Chen Jing, Shi Xiaoqing (Library of Shandong University, Weihai). Design and Implementation Evaluation of Red Culture Reading Promotion Activities in University Libraries Based on the 5W Theory [J]. Libraly Journal, 2025, 44(411): 144-153.
[7]	Sun Jie, Song Denghan (Wuhan University Library). Research on In-depth Reading Promotion Based on FRBR Family Entity Relationship Model [J]. Libraly Journal, 2025, 44(410): 90-102.
[8]	Yang Feng, Zhang Xuelei, Wang Yisong, Li Juan (Xi’an Jiaotong University Library). Exploration and Practice of Library Knowledge Service Innovation Driven by Artificial Intelligence [J]. Libraly Journal, 2025, 44(410): 63-73.
[9]	Xue Fei1, Wang Jingjing2 , Ye Ying3, 4 (1 Zhejiang University Library, 2 School of Journalismand Communication, Shandong University, 3 National Experimental Base for Intelligent Evaluation and Governanceof Fudan University, 4 Jiangsu International Joint Informatics Laboratory of Nanjing University). On the Trends of GenAI Driven by DeepSeek with Application Prospects in Libraries [J]. Libraly Journal, 2025, 44(409): 43-50.
[10]	Hu Die1, 2, Lin Litao3, Liu Liu1, 2, Shen Si4, Wang Dongbo1, 2 (1 College of Information Management, Nanjing Agricultural University, 2 Research Center for Humanities and Social Computing, Nanjing Agricultural University, 3 School of Information Management, Nanjing University, 4 School of Economics and Management, Nanjing University of Science and Technology). Discipline Classification of Humanities and Social Sciences Academic Papers Based on Large Language Models [J]. Libraly Journal, 2025, 44(408): 110-122.
[11]	Tang Zhengui1, Luo Jinkun2, Hu Rong3 (1 School of Journalism and Cultural Communication, Guangxi University of Finance and Economics, 2 New Engineering Industry College, Putian University, 3 College of Teacher Education, Southwest University). Starry Sky Memory: A Framework for Constructing Smart Data from Ancient Chinese Celestial Phenomenon Records [J]. Libraly Journal, 2025, 44(408): 70-83.
[12]	Liu Jiangfeng, Zhang Ran, Zhang Jundong, Pei Lei (1 Data Intelligence and Cross Inno¬vation Laboratory, Nanjing University, 2 School of Information Management, Nanjing University). Empowering Computational Research in the History of Ideas with Generative Artificial Intelligence: Model Construction and Applications [J]. Libraly Journal, 2025, 44(407): 113-127.
[13]	Liu Chunmei, Yang Hui (Tsinghua University Library). Research on the Book Seals of Tsinghua University Library [J]. Libraly Journal, 2025, 44(405): 146-158.
[14]	Liu Linlin, Chang Xinyue (Shenyang University of Technology Library). Research on the Construction of Subject Branch Platform in University Libraries in the Digital Intelligence Era [J]. Libraly Journal, 2024, 43(404): 61-68.
[15]	Fu Aiwen, Shao Bo ( School of Information Management, Nanjing University, Nanjing University Library). Reconstructing the Document Resource Guarantee System Based on Large Language Model [J]. Libraly Journal, 2024, 43(402): 60-69.