Evaluating the quality of Isfahan ACECR e-learning system services using the WebQual method and based on the integrated approach of the Kano model and the importance-performance analysis matrix

Articles in Press

Document Type : Original Article

Authors

• Mitra Pashootanizadeh ¹
• Elahe Reisi ²
• ali mansoori ¹

¹ Associated Professor, Department of Knowledge and Information Science, University of Isfahan, Isfahan, Iran

² MA., Department of Knowledge and Information Science, University of Isfahan, Isfahan, Iran.

10.22067/infosci.2024.83678.1172

Abstract

Introduction: The Present research has been conducted with the aim of evaluating the quality of Academic Center for Education, Culture and Research (ACECR) of Isfahan e-learning platform using the WebQual instrument and the integrated approach of the Kano model and the Matrix of importance-performance analysis.

Methods: This research was practical in terms of purpose and descriptive – survey type in terms of the execution method. The statistical population of the research included 231 students over 18 years of ACECR of Isfahan e-learning platform in the educational groups of medicine, humanities, English language and non-English language. Cochran's formula was used to determine the sample size, and the sample size was estimated to be 144 people.

The data collection tool was the WebQual questionnaire which has 4 dimensions of usability, information quality, interaction quality, and overall impact in 23 items based on the WebQual4 questionnaire of Barnes and Vidgen (2002). In order to take advantage of the Kano model and the importance-performance analysis matrix, the items of the WebQual tool are repeated in 2 separate questionnaires to check the importance-performance and determine the items that are effective on the satisfaction of the learners. The validity and reliability of the questionnaire were confirmed and the statistical method such as mean, frequency percentage and geometric mean were used to describe and analyze the data.Findings: The results showed that in addition to the high importance of the two dimensions "usability" and "interaction quality" from the learners’ point of view, Academic Center for Education, Culture and Research (ACECR) of Isfahan e-learning system also had a high performance regarding these WebQual dimensions. In contrast, the "quality of information" dimension, which was raised as a necessary and important requirement by users, does not match their expectations. The dimension "overall effect" was also placed in the group of attractive needs of the Kano model and the third quadrant of the importance-performance matrix and was not very important according to the learners.

Conclusion: Examining the Kano model based on the WebQual items showed that most of the items related to the features of the "Zomorod" system were placed in the category of one-dimensional needs. In the analysis of the importance-performance Matrix, 7 items out of 23 WebQual items were placed in the first quarter, 7 items in the second quarter, 4 items in the third quarter, and 5 items in the fourth quarter.

Keywords

• Quality of Services
• Electronic Learning
• WebQual
• Kano model
• Matrix Performance - importance analysis
• Academic Center for Education
• Culture and Research (ACECR)

Main Subjects

• Services evaluation

---

References

Academic Center for Education, C. a. R. I. b. (2021). ACECR: about us. http://acecr.ir/en/page/1830/about-acecr

Al-Fraihat, D., Joy, M., & Sinclair, J. (2020). Evaluating E-learning systems success: An empirical study. Computers in human behavior, 102, 67-86.

Arnes, F., & Hanum, Y. (2019). Website Quality Evaluation of Visitor Satisfaction (Case Study: SBMPTN website). International Research Journal of Advanced Engineering and Science, 4(3), 241-245. https://doi.org/10.5281/zenodo.3365595

Barnes, S. J., & Vidgen, R. T. (2001). Assessing the quality of auction web sites. Proceedings of the 34th annual Hawaii international conference on system sciences,

Esmaeili Givi, M., Keshavarz, H., & Kargar Azad, Z. (2023). Quality assessment of E-learning website using asymmetric impact–performance analysis and Kano’s customer satisfaction model: a case study based on WebQual 4.0. Information Discovery and Delivery, 51(1), 35-46. https://doi.org/10.1108/IDD-08-2021-0083.

Fiena Rindani, F. R., & Sulistyo Puspitodjati, S. P. (2020). Integration of Webqual Method to Importance Performance Analysis and Kano Model to Analyze System Quality of E-Government: Case Study LAPOR! Jurnal Sistem Informasi (Journal of Information System), 16(2), 1-17. https://doi.org/10.21609/jsi.v16i2.937

Forghani, M. A., Rashidinezhad, M., Gholshan, S., & Darbandi, S. (2020). Evaluating the Quality of Educational Services of Bahonar University of Kerman Using the Combined Approach of Kano Model and QFD. Higher Education Letter, 13(49), 37-64.

Ghasemi, A., & Shahriarifard, A. (2016). Identifying & ranking of effecting factors on E-learning qualities. Technology of Education Journal (TEJ), 10(3), 207-218. https://doi.org/10.22061/tej.2016.539. [In Persian]

Ghasemi, M., Fardanesh, H., Hatani, J., & Ahmady, S. (2018). Evaluation of the electronic learning system of medical education (Case study of Shahid Beheshti Medical School). Education Strategies in Medical Sciences, 11(4). https://doi.org/10.29252/edcbmj.11.04.06. [In Persian]

Jundillah, M. L., Suseno, J. E., & Surarso, B. (2019). Evaluation of e-learning websites using the Webqual method and importance performance analysis. E3S Web of Conferences,

Kano, N. (1984). Attractive quality and must-be quality. Journal of the Japanese society for quality control, 31(4), 147-156.

Kazemi, M., & Ebadi Koohsare, F. (2020). New methods of education. Behvarz, 31(106), 60-65. https://doi.org/10.22038/BEHV.2020.50046.1139. [In Persian]

Lestarini, D., & Surendro, K. (2017). Designing kano-based e-service quality model to improve user satisfaction. 2017 2nd International conferences on Information Technology, Information Systems and Electrical Engineering (ICITISEE),

Lu, D.-N., Le, H.-Q., & Vu, T.-H. (2020). The factors affecting acceptance of e-learning: A machine learning algorithm approach. Education Sciences, 10(10), 270. https://doi.org/10.3390/educsci10100270

Madanian, M., & Shekarchizadeh, A. (2019). Reviewing and analyzing the concepts and dimensions of service quality management. Standard management and Quality, 9(2), 90-109.

Martilla, J. A., & James, J. C. (1977). Importance-performance analysis. Journal of marketing, 41(1), 77-79. https://doi.org/10.2307/1250495

Naghizade, H. (2015). Investigating the impact of electronic service quality on customer satisfaction in Tehran Municipality (case study of Hadian Shahr Institute) Islamic Azad university

Padlee, S. F., Reimers, V., Mokhlis, S., Anuar, M. M., & Ahmad, A. (2020). Keep up the good work in research universities: An importance-performance analysis. Australasian marketing journal, 28(2), 128-138.

Phadermrod, B., Crowder, R. M., & Wills, G. B. (2019). Importance-performance analysis based SWOT analysis. International journal of information management, 44, 194-203. https://doi.org/10.1016/j.ijinfomgt.2016.03.009

Rupere, T., & Jakovljevic, M. (2021). Usability and User Evaluation of an Integrated Multimedia E-Learning Management System. Knowledge Management & E-Learning, 13(3), 334-366. https://doi.org/10.34105/j.kmel.2021.13.018

Shia, B. C., Chen, M., & Ramdansyah, A. D. (2016). Measuring customer satisfaction toward localization website by WebQual and importance performance analysis (case study on AliexPress Site in Indonesia). American Journal of Industrial and Business Management, 6(2), 117-128. https://doi.org/10.4236/ajibm.2016.62012