Libraly Journal

Libraly Journal ›› 2025, Vol. 44 ›› Issue (409): 20-32.

Previous Articles     Next Articles

Predicting User Cognitive Load in Public Digital CulturalServices Based on Multimodal Data

Lin Hui1, 2, Wu Dan1, 2(1 School of Information Management, Wuhan University; 2 Center for Studies of Human-ComputerInteraction and User Behavior, Wuhan University)   

  • Online:2025-05-15 Published:2025-05-28
  • About author:Lin Hui1, 2, Wu Dan1, 2(1 School of Information Management, Wuhan University; 2 Center for Studies of Human-ComputerInteraction and User Behavior, Wuhan University)

Abstract:

This paper focuses on the complex situation of public digital cultural multimedia resources.Aiming to optimize the construction of public digital cultural service, it studies the differences in cognitiveload when users engage with multimedia resources and explores how multimodal data can predict theload. The research designed an Electroencephalogram & Eye-tracking collaborative experiment toreconstruct the multimedia resources of Chinese National Public Culture Cloud Platform, collected datasuch as EEG, Eye-tracking, NASA_TLX scales, and interviews, and employed classic machine learningalgorithms to predict users’ cognitive load. Findings demonstrate that all four types of data reflect thedifferences existing in cognitive load during used multimedia resource usage. The prediction effect ofbinary-classification cognitive load by multimodal data was better than that of unimodal data, and themultimodal subjective-objective collaborative prediction of binary-classification cognitive load hadthe best effect. The research concludes that user-centered public digital cultural services should alignwith cognitive principles, focusing on understanding, memory, and attention, and leverage precise andpersonalized multimedia cultural resources.