Journal of the Korean Society for Library and Information Science
- P-ISSN1225-598X
- E-ISSN2982-6292
Exploring the Effect of Mental Demand in Web Searches: A Pilot Study
Abstract
This pilot study explored the effect of mental demand on a Web searcher’s thoughts, emotions, efforts, and performance in Web searches in order to address whether or not there is any difference between searchers exposed to mental demand manipulation and searchers not exposed. Research data were collected via think-aloud protocol (TAP) with a dual-task in experiments and interviews with 10 subjects who participated in this study. For the searcher’s thoughts, relevance judgment was found to be hindered by mental demand. For the searcher’s emotions, the experimental group was more frustrated than the control group. With respect to the searcher’s efforts, searchers for the experimental group with mental demand manipulation were more likely to spend more time, make fewer queries, and visit fewer pages but work harder to find more relevant information that they needed. Lastly, with regard to the searcher’s performance, it is likely that performance was highly dependent upon the completion of the search tasks for both groups. The NASA-TLX six components and cognitive load scores of searchers did not make a significant difference in the outcome. The findings support the use of a dual-task methodology as a promising approach for the assessment of cognitive load induced by complex Web searches.
- keywords
- Mental Demand, Cognitive Load, Web Search, NASA-TLX, Dual-Tasks, Think Aloud Protocol
Reference
Albers, M. J. 2006. “Measuring Cognitive Load to Test the Usability of Web Sites.” Usability and Information Design.
Bates, M. J. 1989. “The design of browsing and berrypicking techniques for the online search interface.” Online Review, 13(5): 407-424.
Bell, D. J. and Ruthven, I. 2004. “Searchers' assessments Of Task Complexity For Web Searching.”In Proceedings of the 26th European Conference on Information Retrieval, 26: 57-71.
Borgman, C. L. 1989. “All users of information systems are not created equal: An exploration into individual differences.” Information Processing & Management, 25: 237-252.
Byström, K. and Järvelin, K. 1995. “Task complexity affects information seeking and use.”Information Processing & Management, 31(2): 191-213.
Ericsson K. A. and Simon H. A. 1993. Protocol Analysis: Verbal Reports as Data. MIT Press, Cambridge, MA.
Ford, N., Miller, D. and Moss, N. 2001. “The role of individual differences in internet searching:An empirical study.” Journal of the American Society for Information Science & Technology, 52(12): 1049-1066.
Ford, N., Miller, D. and Moss, N. 2005. “Web search strategies and human individual differences:Cognitive and demographic factors, Internet attitudes, and approaches.” Journal of the American Society for Information Science & Technology, 56(5): 741-756.
Gwizdka, J. 2009. “Cognitive load and Web Search tasks.” In proceedings of the third Workshop on Human-Computer Interaction and Information Retrieval. Washington, DC: Catholic University of America. 54-57.
Gwizdka, J. 2010. “Distribution of Cognitive Load in Web Search.” Journal of the American Society for information Science & Technology, 1-23.
Gwizdka, J. 2010. “Using Stroop Task to Assess Cognitive Load.” In Proceeding of the 2010European Conference on Cognitive Ergonomics.
Gwizdka, J. 2013. “Effects of Working Memory Capacity on Users’ Search Effort.” MIDI 2013 Conference.
Hart, S. G. and Staveland, L. E. 1988. “Development of NASA-TLX (Task Load Index):Results of empirical and theoretical research.” In P. A. Hancock and N. Meshkati (Eds.)Human Mental Workload. Amsterdam: North Holland Press.
Ingwersen, P. 1996. “Cognitive perspectives of information retrieval interaction: Elements of a cognitive IR theory.” Journal of Documentation, 52(1): 3-50.
Isaac, S. and Michael, W. B. 1995. Handbook in research and evaluation. San Diego, CA:Educational and Industrial Testing Services.
Kim, Y. M. and Rieh, S. Y. 2006. “Task Performance as a Measure of Mental Effort in Searching a Library System and the Web.” In 68th Annual Meeting of the American Society for Information Science and Technology.
Kuhlthau, C. C. 1991. “Inside the search process: Information seeking from the user’s perspective.”Journal of the American Society of Information Science, 42(5): 361-371.
Kuhlthau, C. C. 1993. Seeking Meaning: A Process Approach to Library and Information Services. Norwood, N.J.: Alex Publishing Corp., 45-51.
Kuhlthau, C. C. 2008. “From Information to Meaning: Confronting Challenges of the Twenty-first Century. Libri: International.” Journal of Libraries & Information Services, 58(2): 66-73.
Kuhlthau, C. C., Heinström, J. and Todd, R. J. 2008. “The ‘information search process’ revisited:is the model still useful?” Information Research, 13(4): 45.
Li, Y. and Belkin, N. J. 2008. “A faceted approach to conceptualizing tasks in information seeking.” Information Processing & Management, 44(6): 1822-1837.
Rieh, S. Y. and Xie, H. 2006. “Analysis of multiple query reformulations on the web: The interactive information retrieval context.” Information Processing & Management, 42: 751-768.
Scherer, K. R. 2005. “What are emotions? And how can they be measured?” Social Science Information, 44: 693-727.
Vakkari P. 1999. “Task complexity, problem structure and information actions.” Information Processing & Management, 35(6): 819-837.
- Downloaded
- Viewed
- 0KCI Citations
- 0WOS Citations