Usability Evaluation of Journal Websites in the Field of Knowledge and Information Science based on the Nielsen Model

Document Type : Original Article

Author

• Hedayat Behroozfar

Assistant Proffesor, University Of Zabol , Zabol, Iran

10.22067/infosci.2023.79151.1141

Abstract

Introduction: Websites are platforms through which authors and publishers provide scientific and non-scientific information sources to readers and customers. Therefore, in the digital age and in the world of electronic information, the place and point of connection between creators and readers are most often websites. Scientific journals, as one of the most important sources of reliable scientific information, are available to researchers and enthusiasts through websites, so that the higher the usage and applicability of a scientific journal's website is, the higher the usage and visibility of that publication will be. The purpose of the current research is to investigate and evaluate the usability of the websites of Persian-language scientific journals in the field of knowledge and information science, based on the ten principles of Nielsen, which have obtained A grade in the ranking results of 2021. The review of the background of the research showed that a lot of research has been done in Iran and the world in the field of evaluating the usability of different websites over the past years, so that since the year 2000, many researches have been published, of which a very small part was mentioned. This point can indicate the importance and many applications of the results of this type of research. Another important point is that evaluating the usability of websites can be done in different ways, among which exploratory evaluation has been used in the majority of researches due to its cost-effectiveness and ease and feasibility. As can be seen in the mentioned researches, in order to carry out an exploratory evaluation, evaluators need a checklist, which is generally based on the identified criteria of past research and is presented by researchers in a researcher-made form, among which the ten principles or the Nielsen model are the most used. It has been assigned in the research that this is the proof that Nielsen's ten classic principles are still relevant and applicable, and their universality and comprehensiveness have been proven.
Methodology: The present study is qualitative and applied, which was carried out using the exploratory evaluation method. The data collection tool was a researcher-made questionnaire prepared according to Nielsen's ten principles. The content validity method was used to measure the content validity of the checklist. For this purpose, the list was given to four experts in knowledge and information science and their correction comments were used to edit the final checklist. The community of this research was the websites of journals of the first rank in the field of knowledge and information science of Iran. To identify the research community, the portal of scientific and research publications of the country was referred to https://journals.msrt.ir and from the "group" menu, humanities and from the "subgroup" menu, knowledge and information science was selected and then searched. The search result was 7 publications. In order to carry out the evaluation, four experts of knowledge and information science who had the necessary experience and knowledge in this field were used.
Findings: The findings showed that in the components of "compatibility between the website and the real world" (average above 4), "stability and uniformity" (average around 4), "aesthetic aspects and minimal design" (average above 3.66) the status of websites was desirable, and in the components of "website visibility" (numbers between 3 and 3.66), "status of database control by the user and his freedom of action" (average numbers in the range between 2.33 and 3.66), "status of identification and recovery of information" and "flexibility and efficiency" (all average numbers above 2.50) the status of these websites is relatively favorable and in the components of "error prevention/correction status" (average numbers below 2) and "assistance and guidance possibilities" (average numbers lower than 2.33), the status of these websites is unfavorable. Regarding the severity of the problems, the findings indicate that in most of the components and among all the websites, the level of the severity of the problem is minor. In other words, all the numbers are around 2.5 and less than that, and therefore the severity of the problems have been evaluated as a minor problem at most. Meanwhile, the severity of the problems in the "flexibility and efficiency" component in the websites of the library and information publication has been evaluated as a fundamental problem.
Conclusion: The usability of all the websites investigated in the current research were evaluated very close to each other and relatively favorable. As the findings showed, in terms of compliance with Nielsen's ten components in these websites, the differences are very small and insignificant, and all of them are more or less in the same rank. It seems that many of these websites use a common and similar platform, and because of this, the observed differences were very small. It is suggested to take detailed measures to add help and guidance facilities in different parts of the websites to prevent the possibility of errors. Considering that according to the evaluation made in this research, the websites under the research were evaluated as favorable and relatively favorable in many components by expert evaluators, it is necessary to be informed about the opinions of a large number of normal and daily users of these websites and the amount It examined the usability of these websites from this point of view. It is also necessary to consider similar foreign websites for comparison with these websites and evaluate them as well.
 

Keywords

• Usability
• Nielsen model
• Heuristic evaluations
• Scientific journal websites

20.1001.1.22516344.1402.13.1.3.5

Main Subjects

• Services evaluation

---

References

Abbaspour, J. (2009). Heuristic evaluation: a qualitative method for evaluating the user interface of websites and databases. Library and Information Sciences, 12(3), 265-279. [In Persian] Retrieved on 21 September 2022 from: http://lis.aqr-libjournal.ir/article_43604_c9303cadbcd86765703fe7bfeb7feb25.pdf

Alfayez, Z.A., Altawriy, H.M. (2020). Usability Evaluation of Educational Websites: A case Study of University of Basrah Website. Solid State Technology, 63(5), 9865-9886. Retrieved on 22 September 2022 from: https://faculty.uobasrah.edu.iq/uploads/publications/1613173851.pdf

Aggarwal, I., Ahmad, S., Singari, R. M. (2022). Usability of travel website: A study using heuristic evaluation, eye-tracking, usability questionnaire and card sorting. Retrieved on 20 September 2022 from: http://dx.doi.org/10.2139/ssrn.4098529

Changiz, N. (2008). Automatic web site quality evaluation tools: Emphasis upon Usability. Academic Librarianship and Information Research, 40(45), 147-161. [In Persian] Retrieved on 24 September 2022 from: http://ensani.ir/file/download/article/20120326114923-1142-171.pdf

Dillon, A. (2001). The evaluation of software usability. In: W. Karwowski (ed). Encyclopedia of Human Factors and Ergonomics. London: Taylor and Francis Retrieved on 5 September 2022 from: https://repository.arizona.edu/handle/10150/105344

Doroudi, F., Salajegheh, M., Soleimani Nejad, A., Ghaderi Nikoo, N. (2019). Evaluation of user website interface of National Library of Iran. Journal of Studies in Library and Information Science, 11(2), 179-196. [In Persian] doi: 10.22055/slis.2017.15837.1154

Entezarian, N. , Fattahi, R. (2009). Examining users' understanding of the user interface of databases based on the Nielsen model (comparing the database of electronic articles of the Regional Science and Technology Information Center with the database of articles of the Research Institute of Information and Scientific Documents of Iran). Library and Information Sciences, 12(3), 43-64. [In Persian] Retrieved on 27 September 2022 from: http://lis.aqr-libjournal.ir/article_43594_49a782f312ef2e6306ae9666dc0819e7.pdf

Etemadinezhad, S., Amouzadeh, E., Yazdani Charati, J. (2022). Investigating the Usability of the Integrated Research Automation System (SYAT): A Heuristic Evaluation. Iran J Ergon, 10 (1), 46-55. [In Persian] Retrieved on 5 September 2022 from: http://journal.iehfs.ir/article-1-889-fa.html

Hasan, L. (2013). Determining the Importance of Design Features on Usable Educational Websites. In: Yang GC, Ao S, Gelman L. (eds) IAENG Transactions on Engineering Technologies. Lecture Notes in Electrical Engineering, vol 229, Springer: Dordrecht.10.1007/978-94-007-6190-2_42

Hasan, L. (2014). The Website of the University of Jordan: Usability Evaluation. Int. Arab J. e-Technol., 3(4), 258–269. Retrieved on 20 September 2022 from: https://www.researchgate.net/publication/281904070_The_Website_of_the_University_of_Jordan_Usability_Evaluation

Hassan, L. (2014). Evaluating the usability of educational websites based on students' preferences of design characteristics. International Arab Journal of e-Technology, 3 (3), 179-193. Retrieved on 18 September 2022 from: https://www.academia.edu/5255687/Evaluating_the_Usability_of_Educational_Websites_Based_on_Students_Preferences_of_Design_Characteristics

ISO 9241-11. (1998). Ergonomics Requirements for Office Work with Visual Display Terminals (VDTs) – Part 11: Guidance on Usability. Retrieved on 1 September 2022 from: https://www.iso.org/standard/63500.html

Hedjazi, Y., Bazargan, A., Eshaghi, F. (2009). Guide to quality internal evaluation in university system. Tehran: University of Tehran.

Krawiec, L., Dudycz, H. (2020). A comparison of heuristics applied for studying the usability of websites, Procedia Computer Science, 176, 3571-3580. 10.1016/j.procs.2020.09.029. Epub 2020 Oct 2

Mansouri, M., Norouzi, Y. (2015). Examining the status of the user interface of Persian databases (Magiran and Academic Jihad Scientific Information database). Journal of knowledge studies, 8 (28), 75-86. [In Persian] Retrieved on 23 September 2022 from: https://journals.iau.ir/article_516871_4b46697c31050e828ba5b804879b6d31.pdf

Mohajery, F., Mohammadsalehi, R. (2009). Evaluation of the characteristics of RASA user interface. Journal of knowledge studies, 2(6), 75-87. [In Persian] Retrieved on 2 October 2022 from: http://ensani.ir/file/download/article/20120426170633-5183-47.pdf

Momenipour, A., Rojas-Murillo, S., Murphy, B., Pennathur, P., Pennathur, A. (2021). Usability of state public health department websites for communication during a pandemic: A heuristic evaluation. International Journal of Industrial Ergonomics, 86. 10.1016/j.ergon.2021.103216. Epub 2021 Sep 20.

Muhammad, A.H., Siddique, A., Naveed, Q.N., Khaliq, U., Aseere, A.M., Hasan, M.A., Qureshi, M.R.N., Shehzad, B. (2021). Evaluating usability of academic websites through a fuzzy analytical hierarchical process. Sustainability, 13, 2040. https://doi.org/10.3390/su13042040

Narmenji, M. (2017). User Interface capabilities of SAMAN Library System of Iran Public Libraries Foundation based on Nielsen’s principles. RISPL, 23 (2), 199-217. [In Persian] 20.1001.1.26455730.1396.23.2.8.8

Nielsen, J. (1995). Technology transfer of heuristic evaluation and usability inspection. In International Conference on Human-Computer Interaction. Retrieved on 1 September 2022 from: https://www.nngroup.com/articles/technology-transfer-of-heuristic-evaluation/

Nielsen, J., Mack, R. L. (1994). Usability Inspection Methods. New York: JohnWiley & Sons.

Nielsen, J. (2005). Characteristics of the usability problems found by heuristic evaluation. Retrieved on 7 September 2022 from: https://www.nngroup.com/articles/usability-problems-found-by-heuristic-evaluation/

Nowkarzi, M., Fanoodi, N. (2014). Heuristic evaluation of the user interface of the islamic world science citation database. Library and information science research, 3(1), 151-166. [In Persian] doi: 10.22067/riis.v3i1.15071

Papadopoulos, T., Xenos, M. (2008). Quality Evaluation of Educational Websites Using Heuristic and Laboratory Methods. In: 2nd Panhellenic Scientific Student Conference on Informatics, Related Technologies and Applications, 43–54. Retrieved on 8 September 2022 from: Downloads\Documents\C056.pdf

Ranking System of Scientific Publications (n.d.). Retrieved on 7 October 2022 from: https://irisweb.ir/page/76/%D9%85%D8%B9%D8%B1%D9%81%DB%8C-%D8%B7%D8%B1%D8%AD-%D8%B1%D8%AA%D8%A8%D9%87-%D8%A8%D9%86%D8%AF%DB%8C-%D9%86%D8%B4%D8%B1%DB%8C%D8%A7%D8%AA

Samrgandi, N. (2021). Usability Evaluation of Research Database Websites. Life Science Journal, 18(2), 39-49. doi:10.7537/marslsj180221.07.

Son, J. B. (2005). Exploring and Evaluating Language Learning Web Sites. Enhancing Learning and Teaching: Pedagogy, Technology and Language, Post Pressed: Flaxton, 215–227. Retrieved on 10 September 2022 from: Downloads\Documents\Son_ch13_2005.pdf