大小数据集上的信息分析刍议

摘要/Abstract

摘要： 信息分析经历了从小数据到大数据的发展历程。具备4V特征的大数据正从各个方面重塑当代学术研究，并对信息分析构成挑战。如何快速、高效地处理海量数据正成为定量信息分析转型发展的关键所在。本文简要回顾数据分析的历史发展，从研究范式、研究方法、研究内容等角度对大小数据集上的信息分析差异进行评论，比较其不同特点并提供互鉴。

关键词: 大数据, 　小数据, 　数据分析, 　信息分析

Abstract: Information analysis underwent the development from small data to big data. The big data characterized by 4V are reforming contemporary academic research, and challenging information analysis. How to process huge data becomes the key to transform and develop quantitative information analysis. With retrospect of historical process on data analysis, we review the differences of information analysis in research paradigms, methods and contents based on small or big data, and then compare their characteristics within mutual references.

Key words: Big data, , Small data, Data analytics, Information analysis

王宜鸿　魏雪迎　叶　鹰. 大小数据集上的信息分析刍议[J]. 图书馆杂志, 2018, 37(12): 14-19.

Wang Yihong, Wei Xueying, Ye Fred Y.. A Brief Review of Information Analysis on the Small or Big Data[J]. Libraly Journal, 2018, 37(12): 14-19.

参考文献

[ 1 ] Fan J, Han F, Liu H. Challenges of Big DataAnalysis[J]. National Science Review, 2014, 1(2):293-314.
[ 2 ] 孟小峰, 慈祥. 大数据管理: 概念、技术与挑战[J].计算机研究与发展, 2013, 50(1): 146-169.
[ 3 ] Tumasjan A, Sprenger T O, Sandner P G, et al.Predicting Elections with Twitter: What 140Characters Reveal about Political Sentiment[C]//International Conference on Weblogs and SocialMedia, ICWSM 2010, Washington, DC, USA, May.DBLP, 2010: 178-185.
[ 4 ] Raghupathi W, Raghupathi V. Big data analyticsin healthcare: promise and potential[J]. HealthInformation Science & Systems, 2014, 2(1): 3.
[ 5 ] Manyika J, Chui M, Brown B, et al. Big data: Thenext frontier for innovation, competition, andproductivity[R]. McKinsey Global Institute, 2011.
[ 6 ] Bollen J, Mao H, Zeng X. Twitter mood predicts thestock market[J]. Journal of Computational Science,2010, 2(1): 1-8.
[ 7 ] Hey T. The Fourth Paradigm-Data-IntensiveScientific Discovery[J]. Proceedings of the IEEE,2011, 99(8): 1334-1337.
[ 8 ] Donoho D L. High-Dimensional Data Analysis:The Curses and Blessings of Dimensionality[C]//Lecture-Math Challenges of Century. 2000: 178-183.
[ 9 ] Miller H J. THE DATA AVALANCHE IS HERE.SHOULDN’T WE BE DIGGING? [J]. Journal ofRegional Science, 2010, 50(1): 181-201.
[10] Davis J, Goadrich M. The relationship betweenPrecision-Recall and ROC curves[C]// ICML ’06:Proceedings of the, International Conference onMachine Learning, New York, NY, USA. ACM Press,2006: 233-240.
[11] Leek J T, Peng R D. What is the question?[J].Science, 2015, 347(6228): 1314.
[12] Tuckey J W. Exploratory Data Analysis[M]//Exploratory data analysis. Addison-Wesley Pub. Co,1977: 163-182.
[13] Shmueli G, Koppius O. Predictive Analytics inInformation Systems Research[J]. Social ScienceElectronic Publishing, 2011, 35(3): 553-572.
[14] 朝乐门, 邢春晓, 张勇. 数据科学研究的现状与趋势[J]. 计算机科学, 2018, 45(1): 1-13.
[15] Mcafee A, Brynjolfsson E. Big data: the managementrevolution[J]. Harvard Business Review, 2012,90(10): 60-66.
[16] Holland P W. Statistics and Causal Inference[J].Journal of the American Statistical Association,1986, 81(396): 945-960.
[17] Konishi S, Kitagawa G. Information Criteria andStatistical Modeling[M]. Springer New York, 2008.
[18] Lin M, Lucas H C, Shmueli G. Too Big to Fail:Larger Samples and False Discoveries[J]. RobertH. Smith School Research Paper No. RHS 06-068,2011.
[19] Kitchin R. Big Data, new epistemologies and paradigmshifts[J]. Big Data & Society, 2014, 1(1): 1-12.
[20] Lazer D, Kennedy R, King G, et al. The Parable ofGoogle Flu: Traps in Big Data Analysis[J]. Science, 2014, 343(6176): 1203-1205.
[21] Borgman C L. Big Data, Little Data, No Data[M].Cambridge, MA: MIT Press, 2015.
[22] Cuzzocrea A, Song I Y, Davis K C. Analyticsover large-scale multidimensional data:the bigdata revolution![C]//Proceedings of the ACM 14thinternational workshop on Data Warehousing andOLAP-DOLAP’11. New York, USA: ACM Press,2011: 101-104.
[23] Ding Y, Stirling K. Data-driven Discovery: A NewEra of Exploiting the Literature and Data[J]. Journalof Data & Information Science, 2016, 1(4): 1-9.
[24] Zhuang Y T, Wu F, Chen C, et al. Challenges andopportunities: from big data to knowledge in AI 2.0[J].Frontiers of Information Technology & ElectronicEngineering, 2017, 18(1): 3-14.
[25] Jagadish H V. Big Data and Science: Myths andReality[J]. Big Data Research, 2015, 2(2): 49-52.
[26] 杨京, 王效岳, 白如江, 等. 大数据背景下数据科学分析工具现状及发展趋势[J]. 情报理论与实践, 2015, 38(3): 134-137, 144.
[27] 洪亮, 李雪思, 周莉娜. 领域跨越: 数据挖掘的应用和发展趋势[J]. 图书情报知识, 2017(4): 4, 22-32.
[28] Jagadish H V, Gehrke J, Labrinidis A, et al. Big Dataand Its Technical Challenges[J]. Communications ofthe Acm, 2014, 57(7): 86-94.
[29] F?llesdal D. Hermeneutics and the hypotheticodeductivemethod[J]. Dialectica, 1979, 33(3-4):319-336.

[1]	沈立力张宏玲韩春磊姚啸华张文棋（上海图书馆）. 图书馆数字人文工具建设实践与未来展望[J]. 图书馆杂志, 2023, 42(392): 45-57.
[2]	金佳丽卢盈蕾陈雪梅黄晨（ CADAL项目管理中心浙江大学图书馆）. 基于大数据的个性化推荐：思路与实践[J]. 图书馆杂志, 2023, 42(385): 63-70.
[3]	陈超（上海图书馆）. 大阅读时代智慧复合型图书馆发展战略思考[J]. 图书馆杂志, 2022, 41(6): 4-8.
[4]	刘静羽贾毓洁, 张婧睿, 冉从敬, 吴钢, 黄金霞. 大数据环境中的数字资源权益管理：关键问题与应对策略——2021年大数据环境中数字资源权益管理研讨会综述[J]. 图书馆杂志, 2022, 41(1): 29-36.
[5]	卢红杰. 读者参与图书资源建设的实践数据分析评价与应用研究[J]. 图书馆杂志, 2021, 40(8): 66-73.
[6]	钱爱娟董笑菊沈绮文李晨璐施晓华. “慧源共享”开放数据创新研究大赛优秀获奖论文选登高校图书馆用户画像与行为可视化分析[J]. 图书馆杂志, 2020, 39(10): 82-88.
[7]	吴佩林. 《梅石犬戏图》证伪[J]. 图书馆杂志, 2019, 38(9): 109-120.
[8]	党倩娜杨倩刘永千 . 基于大数据方法的新兴技术新颖性测度[J]. 图书馆杂志, 2019, 38(4): 91-101.
[9]	周耀林柴昊赵跃. 国际图情领域大数据研究现状与趋势探析[J]. 图书馆杂志, 2019, 38(12): 16-27.
[10]	陈明星钱鹏. 让数据使用有效：数据素养在教育者决策中的应用[J]. 图书馆杂志, 2018, 37(2): 33-38.
[11]	于倩倩　张建勇　黄永文. 大数据环境下的文献元数据标准设计特点分析[J]. 图书馆杂志, 2018, 37(11): 35-39.
[12]	欧阳剑. 大数据视域下人文学科的数字人文研究[J]. 图书馆杂志, 2018, 37(10): 61-70.
[13]	唐晓波朱娟. 大数据环境下知识融合的关键问题研究综述[J]. 图书馆杂志, 2017, 36(7): 10-16.
[14]	邵慧丽张帆郝哲梁玉琪侯菲菲. 基于知识图谱国际视野下大数据研究可视化分析[J]. 图书馆杂志, 2016, 35(5): 13-19.
[15]	谢友宁. 大数据时代反思“知识”——读《知识的边界》有感[J]. 图书馆杂志, 2016, 35(4): 109-112.