Research and Empirical Analysis of Social Impact Evaluation  Framework for Scientific and Technological Projects Based on Altmetrics

Abstract

Abstract: The evaluation of social impact of scientific and technological projects has received global
attention. Altmetrics, as a new evaluation method based on social media, has potential value to be applied
to the evaluation of scientific and technological projects. This paper analyzes the feasibility of introducing
Altmetrics into the evaluation of scientific and technological projects, constructs the social impact
evaluation framework and evaluation method based on Altmetrics, and conducts empirical analysis with
Plum Analytics. The analysis results show that Altmetrics provides new ideas, new ways and new tools for
the evaluation of social impact of scientific and technological projects, which can be used as a supplemental
evaluation method for scientific and technological projects.

Key words: Altmetrics, Social media, Evaluation of scientific and technological projects, Social impact

Xiao Qishi, Wu Chunying, Sun Zhiqing. Research and Empirical Analysis of Social Impact Evaluation Framework for Scientific and Technological Projects Based on Altmetrics[J]. Libraly Journal, 2019, 38(5): 79-87.

References

[ 1 ] 王茜, 谭宗颖, 钱力. 科学研究社会影响力评价综述[J]. 图书情报工作, 2015, 59(14):143-148.
[ 2 ] Impact and the next Framework Programme forResearch and Innovation (FP9) [EB/OL]. [2018-09-03]. https://www.leru.org/files/Publications/Impact-and-the-next-Framework-Programmefor-Research-and-Innovation.pdf.
[ 3 ] 泉州科技创新项目立项评审要求及各领域科
技创新项目评审工作具体方案公示[EB/OL].
[2018-11-09]. http://www.gov-fund.com/fujian/details/13182.
[ 4 ] Pulido CM, Redondo-Sama G, Sorde’- Mart’ T,Flecha R (2018) Social impact in social media: Anew method to evaluate the social impact of research
[J/OL]. PLoS ONE 13(8): e0203117 [2018-11-09].https:// doi.org/10.1371/ journal.pone.0203117.
[ 5 ] Applying relevance-assessing methodologies toHorizon 2020 [EB/OL]. [2018-09-04]. https://ec.europa.eu/research/evaluations/pdf/ archive/other_reports_studies_and_documents/applying_relevance-assessing_methodologies_to_horizon_2020_metho_expert_group.pdf.
[ 6 ] 赵晏强, William Nixon, 李印结, 等.Altmetric在科研机构成果产出影响力评价中的应用研究[J]. 情报杂志, 2016, 35(6):144-150, 182.
[ 7 ] 王睿, 胡文静, 郭伟. 常用Altmetrics工具比较[J].现代图书情报技术, 2014(12):18-26.
[ 8 ] 吴胜男, 赵蓉英.Altmetrics应用工具的发展现状及趋势之分析[J].情报科学, 2018, 36(6):3-8, 39.
[ 9 ] 刘焕成, 胡雨薇, 李素巧. Altmetrics与传统科研评价方法对比研究[J]. 评价与管理, 2017, 15(3):9-12.
[10] Comparative scientometric assessment of the resultsof ERC funded projects [EB/OL]. [2018-09-04].https://erc.europa.eu/sites/default/files/document/file/ERC_Alternative_Metrics_report.pdf.
[11] Melero R. Altmetrics: a complement to conventionalmetrics [J]. Biochemia Medica.2015, 25(2):152-160.

[12] Grischa Fraumann. Valuation of altmetrics inresearch funding [D/OL]. [2018-11-13]. https://tampub.uta.fi/bitstream/handle/10024/101653/GRADU-1498478872.pdf?sequence=1.
[13] Lutz Bornmann, Robin Haunschild, JonathanAdams. Do altmetrics assess societal impact in thesame way as case studies? An empirical analysistesting the convergent validity of altmetricsbased on data from the UK Research ExcellenceFramework (REF) [EB/OL]. [2018-12-25]. https://www.researchgate.net/publication/326342851_Do_altmetrics_assess_societal_impact_in_the_same_way_as_case_studies_An_empirical_analysis_testing_the_convergent_validity_of_altmetrics_based_on_data_from_the_UK_Research_Excellence_Framework_REF.
[14] 石凤娟. 基于社交网络的学术论文影响力评价研究[D]. 郑州: 郑州大学, 2018.
[15] 郭颖, 肖仙桃. 国内学者影响力评价Altmetrics指标研究[J/OL]. 情报理论与实践. [2018-12-20]. http://kns.cnki.net/kcms/detail/11.1762.g3.20181205.1306.008.html.
[16] Ursula Oberst. Measuring the Societal Impact ofResearch with Altmetrics: An Experiment [J/OL].Journal for library culture, 2017[2018-12-25]. https://openaccess.leidenuniv.nl/handle/1887/57323.
[17] 程菲. 科技论文影响力综合评价研究[D]. 太原:中北大学, 2016.
[18] 杨柳, 陈贡. Altmetrics视角下科研机构影响力评价指标的相关性研究[J]. 图书情报工作, 2015,59(15):106-114, 132.
[19] The donut and Altmetric Attention Score [EB/OL].
[2018-09-04]. https://www.altmetric.com/aboutour-data/the-donut-and-score/.
[20] PlumX Metrics [EB/OL]. [2018-11-09]. https://plumanalytics.com/learn/about-metrics/.
[21] 完整与替代补充计量[EB/OL]. [2018-11-12].http://ntur.lib.ntu.edu.tw/retrieve/215457/4. 完整與替代補充計量.pdf
[22] 蔡明月.网络计量学指标Altmetrics与图书信息服务[EB/OL]. [2018-09-04]. https://concert.stpi.narl.org.tw/uploads/schedule_file/speaker_file/file/15/Altmetrics_20151120.pdf.
[23] SETO FY2018-Photovoltaics [EB/OL]. [2018-11-03]. https://www.energy.gov/eere/solar/seto-fy2018-photovoltaics.

[1]	Chen Subai, Gu Chenyu (School of Journalism and Communication, Xiamen University). “Desensitized” Digital Natives: A Study of Social MediaUsers’ Privacy Protection Intentions Based on an ExtendedTheory of Planned Behavior [J]. Libraly Journal, 2023, 42(386): 121-132.
[2]	.Gu Runde, Chen Yuanyuan, Dong Wei. Research on Social Media Users’ Fatigue and Transfer Behavior Based on Grounded Theory [J]. Libraly Journal, 2021, 40(6): 110-118.
[3]	Qiu Yue, Zhu Shiqin, Fan Dandan. Research on the Construction of Quality Evaluation System of Chinese Books Based on Multi-dimensional Index Fusion [J]. Libraly Journal, 2021, 40(3): 109-115.
[4]	Yu Houqiang (School of Information Management, Sun Yat-sen University)Cao Xueting (Jiangsu Broadcasting Corporation). A Review of Context Information and Application of Mendeley#br# Readership Altmetrics [J]. Libraly Journal, 2021, 40(11): 14-21.
[5]	Duan Dan, Liang Baijing, Yu Wenwen, Sun Xin, Zhang Lu. Analysis of Influencing Factors on Citation Frequency of Academic Papers Based on Altermetrics Perspective and Prediction [J]. Libraly Journal, 2020, 39(4): 102-112.
[6]	Wang Shiwei. Ten characteristics of “Infodemic” [J]. Libraly Journal, 2020, 39(3): 19-23.
[7]	Yan Yana, Nie Lanbo, Wang Jing. A Comparative Analysis of the Citation Measurement and Altmetrics Measurement of the Literature: Taking Papers on Research Hotspots from ESI as an Example [J]. Libraly Journal, 2018, 37(3): 100-107.
[8]	Zhao Rongying, Wei Xuqiu. The Dynamic Evolution Recognition of Altmetrics Based on Associated Topics [J]. Libraly Journal, 2018, 37(3): 92-99.
[9]	Liu Chunli. The Origin, Questions, Improvement and Development of Altmetrics Tools [J]. Libraly Journal, 2018, 37(3): 84-91.
[10]	Zhao Jiejie, Zhan Huaqing, Jie Feng. Research on the Academic Evaluation Function of University Institutional Repository [J]. Libraly Journal, 2017, 36(9): 20-25.
[11]	Zhang Yongan, Wang Xuetao. Social Media Research Evolution and Visualization Analysis [J]. Libraly Journal, 2017, 36(7): 74-81.
[12]	Liu Chunli. Article-Level Metrics: Development Process, Characteristics,Indicators and Application [J]. LIBRARY JOURNAL, 2016, 35(2): 63-69.
[13]	Liu Entao, Li Guojun, Qiu Xiaohua,Ji Shujuan, Wang Yu, Xiao Ming. Comparative Study of Altmetrics Tools [J]. LIBRARY JOURNAL, 2015, 34(8): 85-92.
[14]	Hou Aihua. The Change of Role of Acquisition Librarians in the Social Media Age [J]. LIBRARY JOURNAL, 2015, 34(6): 48-52.
[15]	Wang Qiong, Chen Wei. Influence of Mobile Social Media on Library [J]. LIBRARY JOURNAL, 2015, 34(12): 69-76.

Research and Empirical Analysis of Social Impact Evaluation Framework for Scientific and Technological Projects Based on Altmetrics

PDF(CN)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments