Analysis of Influencing Factors on Citation Frequency of Academic Papers Based on Altermetrics Perspective and Prediction

Abstract

Abstract: This paper innovatively constructs the prediction model of influencing factors on citation of
academic papers. Taking SCI&SSCI scientific research papers of our university as an example, it verifies
the validity and accuracy of machine learning model in predicting citation frequency of academic papers.
The conclusions of this paper can provide reference for university libraries to carry out decision support
services. This paper combs the related literature of influencing factors and prediction methods of cited
frequency of academic papers, constructs the characteristic space of influencing factors of academic papers
by combining traditional literature measurement and Altmetrics index, and compares the effectiveness and
accuracy of three kinds of machine learning models of linear regression, neural network and support vector
machine in predicting cited frequency of academic papers through experiments. The conclusion of this
paper proves that the prediction accuracy of feature space constructed from the perspective of altmetrics is
greatly improved, and that the support vector machine model shows excellent performance in the empirical
research of the impact prediction of academic papers.

Key words: Altmetrics, Citation frequency of academic papers, Influencing factors, Machine learing

Duan Dan, Liang Baijing, Yu Wenwen, Sun Xin, Zhang Lu. Analysis of Influencing Factors on Citation Frequency of Academic Papers Based on Altermetrics Perspective and Prediction[J]. Libraly Journal, 2020, 39(4): 102-112.

References

[ 1 ] 白晓梅. 基于社会网络分析的学术影响力评估与
预测[D]. 大连: 大连理工大学, 2017.
[ 2 ] 中国科学技术信息研究所.2016年度中国科技论
文统计与分析年度研究报告[M]. 北京: 科学技术
文献出版社, 2018: 230-235.
[ 3 ] Gross P L, Gross E M. College Libraries and
Chemical Education[J]. Science, 1927, 66(1713):
385.
[ 4 ] BEEL J, GIPP B. Google Scholar’s ranking
algorithm: the impact of citation counts (an empirical
study)[C]//Proceedings of the 3rd IEEE International
Conference on Research Challenges in Information
Science. Piscataway: IEEE, 2009: 439-446.
[ 5 ] 何春建.单篇论文学术影响力评价指标构建[J].
图书情报工作, 2017, 2(61): 98-106.
[ 6 ] Priem, Jason, Piwowar, et al. Altmetrics in the wild:
Using social media to explore scholarly impact
[J/OL]. Computer Science, 2012(3). [2018-12-26].
http://arXiv.org/abs/: 1203.4745v1.
[ 7 ] 晏晓菁. 基于社会网络的学术团体识别及其学术
影响力研究[D]. 苏州: 苏州大学, 2018.
[ 8 ] 《图书情报工作》杂志社. 计量学研究的发展与
创新[M]. 北京: 海洋出版社, 2014.4.
[ 9 ] 赵思喆.基于回归模型的学术论文与学术期刊影
响力预测研究[D]. 曲阜: 曲阜师范大学, 2018.
[10] Garfield E. The Evolution of the Science Citation
Index[J]. International Microbiology, 2010, 10(1):
65-69.
[11] Bornmann L, Daniel H D.What Do Citation Counts
Measure? A Review of Studies on Citing Behavior[J].
Journal of Documentation, 2008, 64(1): 45-80.
[12] 叶鹰.国际学术评价指标研究现状及发展综述[J].
情报学报, 2014, 33(2): 215-224.
[13] Thelwall M. Bibliometrics to Webometrics[J]. Journal

of Information Science, 2007, 34(4): 1-18.

[14] Jerome K Vanclay. Factors affecting citation rates
in environmental science[J]. Journal of Informetrics,
Volume 7, Issue 2013(4): 265-271.
[15] Iman Tahamtan, Askar Safipour Afshar, Khadijeh
Ahamdzadeh. Factors affecting number of citations:
a comprehensive review of the literature [J].
Scientometrics, 2016, 107(3): 1195-1225.
[16] 鲍玉芳, 马建霞.科学论文被引频次预测的现状
分析与研究[J]. 情报杂志, 2015, 34(5): 66-71.
[17] 牟象禹, 龚凯乐, 谢娟, 等.论文被引频次的影响
因素研究——以国内图书情报领域为例[J]. 图书
情报知识, 2018(4): 43-52.
[18] P r i e m J , P i w o w a r H A , H e m m i n g e r b M .
Altmetrics in the wild: Using social media to
explore scholarly impact[J/OL].Computerscience,
2012. [2016-10-27]. http://arxiv.org /abs/
1203.4745v1.
[19] Rodrigo Costas, Zohreh Zahedi, Paul Wouters.
Do “altmetrics” correlate with citations? Extensive
comparison of altmetric indicators with citations from
a multidisciplinary perspective[J]. Journal of the
Association for Information Science and Technology,
2015, 66 (10): 2003-2019.
[20] 余厚强, 邱均平.替代计量指标分层与聚合的理
论研究[J].图书馆杂志, 2014(10): 13-19.
[21] 李宏, 王海南, 由庆斌.补充计量学的实证研究现
状及面临挑战[J]. 情报理论与实践, 2018, 41(12):
76-81.
[22] 宿晓燕. 基于社交媒体的论文影响力分析和预测[D].
大连: 大连理工大学, 2017.
[23] 鲍玉芳, 马建霞.科学论文被引频次预测的现状
分析与研究[J]. 情报杂志, 2015, 34(5): 66-71.
[24] 周志华. 机器学习[M]. 北京: 清华大学出版社,
2016.
[25] 何清, 李宁, 罗文娟, 等.大数据下的机器学习
算法综述[J]. 模式识别与人工智能, 2014, 27(4):
327-336.
[26] Lawrence D Fu, Constantin F. Aliferis Using
content-based and bibliometric features for machine
learning models to predict citation counts in the
biomedical literature[J]. Scientometrics, 2010,
85(1): 257-270.
[27] Rui Yan, Jie Tang, Xiaobing Liu, et al. Citation
count prediction: Learning to estimate future
citations for literature[C]// Proceedings of the 20th
ACM Conference on Information and Knowledge
Management, CIKM 2011, Glasgow, United
Kingdom, October 24-28, 2011.
[28] Tian Yu, Guang Yu, Pengyu Li, et al. Citation impact
prediction for scientific papers using stepwise
regression analysis[J]. Scientometrics, 2014, 101:
1233-1252.
[29] 丁筠.学术期刊影响力指数(CI)预测模型的构建[J].
情报科学, 2017, 35(2): 27-32, 37.
[30] Wang D, Song C, Barabási A L. Quantifying longterm
scientific impact[J]. Science, 2013, 342(6154):
127-132.
[31] Tahamtan I, Afshar A S, Ahamdzadeh K.Factors
Affecting Number of Citations: A Comprehensive
Review of the Literature[J]. Scientometrics, 2016,
107(3): 1195-1225.
[32] 牟象禹, 龚凯乐, 谢娟, 等. 论文被引频次的影响
因素研究——以国内图书情报领域为例[J]. 图书
情报知识, 2018(4): 43-52.
[33] 耿骞, 景然, 靳健, 等. 学术论文引用预测及影响
因素分析[J]. 图书情报工作, 2018, 62(14): 29-40.
[34] Xuemei Li, Mike Thelwall, Dean Giustini. Validating
online reference managers for scholarly impact
measurement[J]. Scientometrics, 2012, 91(2):
461-471.
[35] Lutz Bornmann, Loet Leydesdorff, Jian Wang. How
to improve the prediction based on citation impact
percentiles for years shortly after the publication
date?[J]. Journal of Informetrics, 2014, 8(1):
175-180.
[36] Koen Frenken, Roderik Ponds, Frank Van Oort.
The citation impact of research collaboration in
science-based industries: A spatial-institutional
analysis[J]. Papers in Regional Science, 2010, 89(2):
351-371.
[37] Jiawei Han, Micheline Kamber, Jian Pei. 数据挖
掘概念与技术[M]. 北京: 机械工业出版社, 2016:
288-289.
[38] 段丹, 张璐, 孙昕. 财经高校图书馆微信公众号
信息传播效果评价研究——基于前馈BP神经网
络模型的实证分析[J]. 知识管理论坛, 2018, 3(4):
235-244.
[39] 张良均, 等. MATLAB数据分析与挖掘实战[M]. 北
京: 机械工业出版社, 2015: 52-53.
[40] Lewis C. Statistical Methods. 6th ed[M/OL].
[41] 韩家炜, 堪博. 数据挖掘概念与技术 (原书第2版)
[M]. 范明, 孟小峰, 译. 北京: 机械工业出版社,
2007.
[42] Eberly L E. Multiple Linear Regression[J]. Methods
in Molecular Biology, 2007, 404(2): 165.
[43] Kohonen T. An introduction to neural computing[J].
Neural Networks, 1988(1): 3-16.
[44] McCulloch W S, W Pitts. A lofical calculus of the
ideas immanent in nervous activity[J]. Bulletin of
Mathematical Biophysics, 1943, 5(4): 115-133.
[45] Werbos P.Beyond regression: New tools for
prediction and analysis in the behavior science[D].
Harvard University, 1974.
[46] Rumelhart D E, G E Hinton, R J Williams.Learning
internal representations by error propagation[J]//
Parallel Distributed Processing: Explorations in the
Microstructure of Cognition, 1986(1): 318-362.
[47] Cortes C, V N Vapnik.Support vector networks[J].
Machine Learning, 20(3): 273-297.
[48] 佩德罗·多明戈斯.终极算法: 机器学习和人工
智能如何重塑世界[M]. 北京: 中信出版社, 2017.
[49] 章成志, 丁睿祎, 王玉琢.基于学术论文全文内容
的算法使用行为及其影响力研究[J]. 情报学报,
2018, 37(12): 1175-1187.
[50] DONG Y, Johnson R A, Chawla N V.Will this
paper increase your h-index?: Scientific impact
prediction[C]. Machine Learning and Knowledge
Discovery in Datebases, ECML PKDD 2015.Proto:
Springer, 2015: 149-158.
[51] 刘韩. 人工智能简史[M]. 北京: 人民邮电出版社,
2018.
[52] Chang Chihchung, Lin Chihjen.LIBSVM: a library
for SVMs Version 2.3 [DB/OL]. [2001-06-08].
http://www.csic.ntu.edu.tw/~cjlin/papers/ libsvm.pdf.
[53] Mingyang Wang, GuangYu, Shuang An, et
al, Discovery of factors influencing. citation
impact based on a soft fuzzy rough set[J/OL].
modelScientometrics, 2012, 93: 635. https: //doi.
org/10.1007/s11192-012-0766-x.
[54] 邱均平, 董克.作者共现网络的科学研究结构
揭示能力比较研究[J]. 中国图书馆学报, 2014,
40(1): 15-24.

[1]	Luo Yifan, Liu Yidi, Chu Jiewang (Management School of Anhui University). Research on the Influencing Factors of Research Behavior Among Information Resource Management Graduate Students Using AIGC [J]. Libraly Journal, 2025, 44(407): 56-67.
[2]	Song Jiali, Chen Xiaofen, Cheng Jiejing ( Jiangsu Vocational College of Finance and Economics Library, Jiangsu College of Nursing Library, School of Social Development, Yangzhou University). A Study of Digital Reading Literacy and Individual Influential Factors among Secondary School Students [J]. Libraly Journal, 2024, 43(402): 85-96.
[3]	Yu Haiyan, Jiang Shenyu, Zhu Weiqi (School of Economics and Management, East China Normal University). Research on the Influencing Factors of Scientific Data Reuse in the Field of Machine Learning Based on Information Adoption Model [J]. Libraly Journal, 2024, 43(402): 5-15.
[4]	Liu Zhouying, Zhao Yuxiang, Zhang Yan, Zhang Xuanhui, Zhu Qinghua ( Faculty of Humanities and Social Sciences, Nanjing Forestry University, School of Information Management, Nanjing University, Research Institute for Data Management and Innovation, Nanjing University). Exploring the Factors Influencing Public Participation Behavior in Open Data Contests of Digital Humanities [J]. Libraly Journal, 2024, 43(400): 123-135.
[5]	Jia Yuting, Wu Dan( School of Information Management, Wuhan University, Center for Studies of Human-Computer Interaction and User Behavior, Wuhan University). A Grounded Analysis of the Influencing Factors of Generation Z’s Willingness to Use Public Digital Culture Mobile Service Platforms in a Multi-Device Environment [J]. Libraly Journal, 2024, 43(398): 16-26.
[6]	Shi Yu, Mao Yihong, Zhang Guixiang ( College of Information Management, Nanjing Agricultural University, School of Information Resource Management, Renmin University of China). A Meta-Analysis Research on Influencing Factors of Users’ Adoption Intention of Personalized Algorithm Recommendation Services [J]. Libraly Journal, 2024, 43(394): 96-108.
[7]	Xu Jia(School of History and Archives, Yunnan University)Liu Yu(School of Journalism, Yunnan University). A Study on the Influencing Factors of Information CommunicationEffect of Popular Science Videos: A Case Study of the Institute ofPhysics CAS Official Account on Bilibili [J]. Libraly Journal, 2023, 42(391): 108-116.
[8]	Lian Jingwen, Zhao Yuxiang, Zhang Xuanhui, Zhu Qinghua( School of Information Management, Nanjing University, School of Economics and Management, NanjingUniversity of Science and Technology). Exploring the Factors Influencing the Sustainability ofCultural Heritage Crowdsourcing Projects: A DelphiApproach with Case Study [J]. Libraly Journal, 2023, 42(390): 74-86.
[9]	Qiu Yue, Zhu Shiqin, Fan Dandan. Research on the Construction of Quality Evaluation System of Chinese Books Based on Multi-dimensional Index Fusion [J]. Libraly Journal, 2021, 40(3): 109-115.
[10]	Tang Changle (Department of Library, Information and Archive, Shanghai University). A Grounded Theory Approach to Influence Factors of Value Co-creation of Government’s Open Data [J]. Libraly Journal, 2021, 40(11): 22-30.
[11]	Yu Houqiang (School of Information Management, Sun Yat-sen University)Cao Xueting (Jiangsu Broadcasting Corporation). A Review of Context Information and Application of Mendeley#br# Readership Altmetrics [J]. Libraly Journal, 2021, 40(11): 14-21.
[12]	Shen Guo, Chen Huilan (Library of Donghua University). Change of Ranking by Chinese Academy of Sciences Library and Its Influencing Factors [J]. Libraly Journal, 2021, 40(10): 133-141.
[13]	Xiao Qishi, Wu Chunying, Sun Zhiqing. Research and Empirical Analysis of Social Impact Evaluation Framework for Scientific and Technological Projects Based on Altmetrics [J]. Libraly Journal, 2019, 38(5): 79-87.
[14]	Tian Zhifu. Characteristics and Factors Analysis of the Temporal and Spatial Pattern of Public Libraries in China#br# [J]. Libraly Journal, 2019, 38(1): 16-23.
[15]	Yan Yana, Nie Lanbo, Wang Jing. A Comparative Analysis of the Citation Measurement and Altmetrics Measurement of the Literature: Taking Papers on Research Hotspots from ESI as an Example [J]. Libraly Journal, 2018, 37(3): 100-107.