System Evaluation and User Studies, Constituent elective module A
The module includes advanced studies of the theoretical and methodological aspects concerning evaluation of interactive information systems in context, the emphasis being on the correlation between information needs, situation and relevance as well as search behaviour seen in the light of dissemination processes and associated technologies. Taking its starting point in the research literature, the module introduces models for information behaviour and information interaction in order to identify approaches to evaluation of system performance and usability, and explicitly to discuss methods for evaluation of interactive information retrieval systems.
The module consists of the following three sub-courses and a project seminar:
- Basic information behaviour models and interactive information retrieval research approaches
- Types of information needs, including work task related information needs
- The concept of relevance
Data collection and analysis
- Research focus: behavioural studies vs. performance tests
- Research design – test variables
- Data collection methods: qualitative methods and statistical methods of analysis
Evaluation of interaction design
- System centric evaluation; Cranfield-TREC-INEX; Performance measures
- User centric evaluation; usability evaluation and analysis
- Validation of test results
Information Science and Cultural Communication, the 2019 Curriculum
At the exam, the student can demonstrate
Knowledge and understanding of:
- Different types of evaluation and evaluation approaches of relevance to information searching and assessment of the performance of infor-mation retrieval systems,
- Key concepts and models on information behaviour and search/re-trieval and the associated processes and functions as well as methods for studying these.
- Reflect on key models and methods for the study of information be-haviour and search/retrieval and the associated processes and func-tions,
- Assess relevant methods, and combinations of these, for the study/evaluation of system performance and information behaviour – including evaluation of interactive information retrieval systems,
- Identify and compare key evaluation concepts and methods for sys-tem evaluation and user studies, and to assess and validate evalua-tion results in relation to given circumstances.
- assess and validate evaluation results in relation to the given circumstances
- develop/design surveys for the evaluation of system performance and information behaviour
- conduct various types of system evaluations and user studies, including reflecting on methodological issues, such as validity
Class teaching, lectures, student presentations, workshops and project seminar.
- Ingwersen, P. & Järvelin, K. (2005). The Turn: Integration of Information Seeking and Retrieval in Context. Berlin/Heidelberg : Springer. 448 s.
- Kelly, D. (2009). Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends in Information Retrieval, 3(1-2), 1-224.
- Lazar, Feng & Hochheiser (2010): Research Methods in Human-Computer Interaction. Chichester, Wiley, 426 s.
- Saracevic, T. (2009). Information Science. In: Bates, M.J. & Maack, M.N. (eds.). Encyclopedia of Library and Information Science. New York : Taylor & Francis. 2570-2586.
- 15 ECTS
- Type of assessment
Oral examination, 30 minExam language: English
See Academic Regulations for the Masters program in Information Science and Cultural Communications http://hum.ku.dk/uddannelser/aktuelle_studieordninger/informationsvidenskab-og-kulturformidling/informationsvidenskab_og_kulturformidling_ma
- All aids allowed
- Marking scale
- 7-point grading scale
- Censorship form
- No external censorship
Single subject courses (day)
- Class Instruction
- Exam Preparation
- Course number
- 15 ECTS
- Programme level
- Full Degree Master
View schedule, October 2019
- 42 participants
- Department of information studies
- Department of Information Studies
- Faculty of Humanities
- Alesia Ann Zuccala (9-63307c776565636e63426a776f306d7730666d)
Alesia Ann Zuccala, Henriette Roued-Cunliffe, Haakon Lund
Are you BA- or KA-student?
Courseinformation of students