Comparison and evaluation of the user interfaces of e‐journals II: perceptions of the users

Abstract

Purpose

The paper aims to present a part of a wider study, performed at the Department of LIS&BS at the University of Ljubljana (UL). The study investigated the perceptions of user friendliness of information retrieval (IR) systems.

Design/methodology/approach

An expert study and a user study were performed. The user study was based on the results of the previous expert study, which surveyed the interfaces of four e‐journal IR systems (Science Direct, Proquest Direct, Ebsco Host and Emerald) and has been published separately. In the user study three of these interfaces were used: Science Direct, Proquest Direct, and Ebsco Host. A pilot study with ten subjects and a main study with 61 subjects, all postgraduate students of the UL, was performed. Questionnaires and observation were used for data collection. The users' perceptions of user interfaces were investigated and compared to the findings of the expert study.

Findings

It was found that users do not show high appreciation of auxiliary functions (such as search history, indexes, etc.) and do not use them to a great extent. They also do not prefer to have available different full‐text formats. Perceptions of user friendliness of elements and functions were different in each interface. For each interface it was also established that different functions and elements were influential in the overall perceptions of the interface friendliness. In comparison of the findings of the expert and user study it was found that the expert study was in some cases too detailed and investigated aspects not perceived by the users. For this reason, certain findings of both studies were not appropriate for comparison.

Research limitations/implications

The methodology of data collection was rather demanding and lengthy, and influenced the type and size of sample. Because of that it may not be possible to generalise the result to all users of e‐journals. Also, large quantities of data were collected which could be studied further.

Practical implications

The results of the study are relevant for the design of the user interfaces of IR systems. They also have implications for other areas, e.g. user education and training.

Originality/value

The study investigates the users' own perceptions of user friendliness of the e‐journal interfaces and also compares them to the findings of the expert study. This gives a valuable insight and provides many different viewpoints in regard to user friendliness, which in itself is a demanding concept.

Citation

Vilar, P. and Žumer, M. (2008), "Comparison and evaluation of the user interfaces of e‐journals II: perceptions of the users", Journal of Documentation, Vol. 64 No. 6, pp. 816-841. https://doi.org/10.1108/00220410810912415