1. Home
  2. Vol 13, No 1 (2025)
  3. Sucipto

User Satisfaction of the UBSI Online Exam System Based on End User Computing Satisfaction (EUCS)

Rakhmat Hadi Sucipto(1), Wahyu Indrarti(2), Rahayu Swastika(3), Helmy Ivan Taruna(4),
(1) Universitas Bina Sarana Informatika  Indonesia
(2) Universitas Bina Sarana Informatika  Indonesia
(3) Universitas Bina Sarana Informatika  Indonesia
(4) Universitas Bina Sarana Informatika  Indonesia

Corresponding Author


DOI : https://doi.org/10.24036/voteteknika.v13i1.133078

Full Text:    Language : en    Language : en

Abstract


Universitas Bina Sarana Informatika (UBSI) implements an online exam system to evaluate learning during one semester and the end of the semester. However, the online exam system still raises weaknesses and shortcomings that are felt by users. Therefore, it is necessary to conduct research related to end-user satisfaction because this system is important for universities and user satisfaction is an important factor in the successful implementation of the online exam system. This study aims to analyze the level of user satisfaction of the online exam system of UBSI using the End User Computing Satisfaction (EUCS) method. The research involved 396 samples of UBSI active students who routinely use the online exam system. This study collected primary data by creating and distributing questionnaires through Google Forms. The collected data was analyzed with SmartPLS 4.0 software to test the validity, reliability, and hypothesis of the research. The results of the study show that there are three variables that have a significant effect on user satisfaction of the UBSI online exam system, namely 1) accuracy, 2) ease of use, and 3) timeliness. The other two, namely content and format, do not have a significant effect on user satisfaction of the online exam system. Based on the value of the determination coefficient, exogenous variables are able to influence endogenous variables by 59.8%. All independent variables were able to predict the results well because they had a Q-square (Q²) value of 0.577. The measure of effect (f²) of each independent variable that was proven to have a significant effect on user satisfaction of the online exam system was in the low category because the value was below 0.02.


References


A. W. Muzaffar, M. Tahir, M. W. Anwar, Q. Chaudry, S. R. Mir, and Y. Rasheed, “A systematic review of online exams solutions in e-learning: Techniques, tools, and global adoption,” IEEE Access, vol. 9, pp. 32689–32712, 2021, doi: 10.1109/ACCESS.2021.3060192.

M. M. Islam et al., “The Development and Deployment of an Online Exam System: A Web Application,” Asian J. Res. Comput. Sci., vol. 16, no. 2, pp. 1–11, Jun. 2023, doi: 10.9734/ajrcos/2023/v16i2335.

Uday Kumar, CH. Rekha, K. Annie Siri, G. Lokesh, and A. Keerthan, “Online Exam Portal,” Int. J. Adv. Res. Sci. Commun. Technol., pp. 554–562, May 2024, doi: 10.48175/IJARSCT-18183.

M. Aristeidou, S. Cross, K. Rossade, C. Wood, T. Rees, and P. Paci, “Online exams in higher education: Exploring distance learning students’ acceptance and satisfaction,” J. Comput. Assist. Learn., vol. 40, no. 1, pp. 342–359, Feb. 2024, doi: 10.1111/jcal.12888.

S. R. Bhude, “An Online Assessment : Survey Panel,” Gurukul Int. Multidiscip. Res. J., pp. 193–202, Jun. 2024, doi: 10.69758/GIMRJ2406I8V12P024.

A. Patil, Y. Raipure, and S. Barde, “A New Approach for Organizing Online Examination,” Int. J. Sci. Res. Eng. Manag., vol. 08, no. 05, pp. 1–5, May 2024, doi: 10.55041/IJSREM31816.

Universitas Bina Sarana Informatika, “Portal Ujian Online Bina Sarana Informatika, Info: Sistem Informasi ujian Online Universitas Bina Sarana Informatika,” 2023. http://www.bsi.ac.id/ujian/index.html (accessed Dec. 05, 2024).

T. Chen, L. Peng, B. Jing, C. Wu, J. Yang, and G. Cong, “The Impact of the COVID-19 Pandemic on User Experience with Online Education Platforms in China,” Sustainability, vol. 12, no. 18, p. 7329, Sep. 2020, doi: 10.3390/su12187329.

A. R. Darwi and Efrizon, “Analisis Kepuasan Pengguna E-Learning sebagai Pendukung Aktivitas Pembelajaran Menggunakan Metode EUCS,” J. Vokasional Tek. Elektron. dan Inform., vol. Vol 7, no. 1, pp. 25–31, 2019.

N. P. Setiawan, M. Anwar, and T. Sriwahyuni, “Analisis Kepuasan Pengguna Sistem Informasi Terpadu (Sister) Menggunakan Metode End User Computing Satisfaction Di Smk N 2 Kecamatan Guguak,” Voteteknika (Vocational Tek. Elektron. dan Inform., vol. 5, no. 2, 2017, doi: 10.24036/voteteknika.v5i2.8492.

W. V. Sari and A. Hadi, “Analisis tingkat kepuasan mahasiswa terhadap pelayanan E-Office BAK di portal unp.ac.id menggunakan EUCS,” Voteteknika (Vocational Tek. Elektron. dan Inform., vol. 9, no. 2, p. 29, 2021, doi: 10.24036/voteteknika.v9i2.111449.

R. Vaezi, A. Mills, W. Chin, and H. Zafar, “User Satisfaction Research in Information Systems: Historical Roots and Approaches,” Commun. Assoc. Inf. Syst., vol. 38, pp. 501–532, 2016, doi: 10.17705/1CAIS.03827.

V. McKinney, K. Yoon, and F. “Mariam” Zahedi, “The Measurement of Web-Customer Satisfaction: An Expectation and Disconfirmation Approach,” Inf. Syst. Res., vol. 13, no. 3, pp. 296–315, Sep. 2002, doi: 10.1287/isre.13.3.296.76.

W. J. Doll and G. Torkzadeh, “The measurement of end-user computing satisfaction,” MIS Q. Manag. Inf. Syst., vol. 12, no. 2, pp. 259–273, 1988, doi: 10.2307/248851.

K. N. Rachmah, A. N. Haq, N. H. Assobarry, F. N. Sabila, and T. L. M. Suryanto, “Edmodo E-Learning Analysis using End-User Computing Satisfaction Method (Case Study: Senior High School 1 Sampang),” IJCONSIST (International J. Comput. Netw. Secur. Inf. Syst., vol. 3, no. 1, pp. 1–6, 2021, doi: 10.33005/ijconsist.v3i1.58.

W. A. Putera and I. M. Candiasa, “Analysis of e-learning user satisfaction itb stikom bali using end user computing satisfaction (eucs) method,” J. Phys. Conf. Ser., vol. 1810, no. 1, p. 012017, Mar. 2021, doi: 10.1088/1742-6596/1810/1/012017.

T. A. Prasetya, C. T. Harjanto, and A. Setiyawan, “Analysis of student satisfaction of e-learning using the end-user computing satisfaction method during the Covid-19 pandemic,” J. Phys. Conf. Ser., 2020, doi: 10.1088/1742-6596/1700/1/012012.

M. R. Arijuanda, “Pengukuran Ulang Kepuasan Pengguna E-Learning UNSRI Menggunakan Metode End User Computing Satisfaction (EUCS),” J. Teknol. Pendidik., vol. 12, no. 3, pp. 89–102, 2023.

M. Marlindawati and P. Indriani, “Pengukuran tingkat kepuasan pengguna e-learning dengan penerapan model end using computing satisfaction (eucs)(studi kasus: Universitas bina darma dan stmik mdp),” J. Ilm. Matrik, vol. 18, no. 1, pp. 55–66, 2016.

I. Muhammad and J. Utomo, “E-Learning Research Trends in Education in Indonesia,” J. Educ. Glob., vol. 1, no. 2, pp. 122–129, 2024.

I. P. Y. Agus Ariwanta, I. G. T. Eka Saputra, N. P. E. Apriyanthi, I. M. A. O. Gunawan, and G. Indrawan, “Analisis Kepuasan Pengguna Menggunakan Metode EUCS Pada Sistem Computer Based Test di Institusi Pendidikan,” J. Comput. Syst. Informatics, vol. 4, no. 4, pp. 942–951, 2023, doi: 10.47065/josyc.v4i4.3752.

Y. Sutanto, “Analisis Kepuasan Pengguna Website Manajemen Informatika dengan Metode EUCS Berbasis CMS,” None, 2015, doi: None.

T. Husain and A. Budiyantara, “Analisis End-User Computing Satisfaction (EUCS) Dan WebQual 4.0 Terhadap Kepuasan Pengguna,” J. Tek. Inform. Dan Sist. Inf., vol. 4, no. 2, pp. 164–176, 2018, doi: 10.35957/JATISI.V4I2.99.

S. Nurhalimah, A. Ratnasari, T. Rochmadi, and Y. Wicaksono, “Analyzing User Satisfaction of the SMP Negeri 1 Sungai Lilin Website Using the End User Computing Satisfaction (EUCS) Method,” Int. J. Softw. Eng. Comput. Sci., vol. 4, no. 2, pp. 850–859, 2024.

D. Trianisfi, N. Nurfaizah, and E. Tripustikasari, “User Satisfaction Analysis of Online Public Access Catalog Using End User Computing Satisfaction Method,” PIKSEL Penelit. Ilmu Komput. Sist. Embed. Log., vol. 9, no. 1, 2021, doi: 10.33558/PIKSEL.V9I1.2493.

A. A. Anggara, R. Nurpriyanti, V. S. Mujahida, K. M. Ryan, and S. Hamidah, “Analisis Efektivitas E-Learning dalam Meningkatkan Kualitas Pengajaran di Institusi Pendidikan,” Kohesi J. Sains dan Teknol., vol. 1, no. 7, pp. 32–42, 2023.

P. Parwadi and M. Sofa, “Analysis of Shopee Driver Partner Satisfaction Service on the Shopeefood Driver Application with the End User Computing Satisfaction Method (EUCS),” Inf. Technol. Syst., vol. 1, no. 2, pp. 73–81, May 2024, doi: 10.58777/its.v1i2.199.

S. Sakinah and N. R. Oktadini, “Analisis Kepuasan Pengguna Terhadap Aplikasi Dana Menggunakan Metode End User Computing Satisfaction (EUCS),” J. Teknol. Komput. dan Sist. Inf., vol. 6, no. 2, 2023, doi: 10.56327/jtksi.v6i2.1487.

F. Pradana, P. Setyosari, S. Ulfa, T. Hirashima, and M. C. Saputra, “Measurement of User Satisfaction for Gamification-based Programming E-Learning Platform using End-user Computing Satisfaction Method,” J. Inf. Technol. Comput. Sci., vol. 9, no. 2, pp. 108–118, 2024, doi: 10.25126/jitecs.92572.

D. Wahyudi, M. Andayani Komara, and I. Kaniawulan, “Analisis Kepuasan Pengguna Sistem Ujian Online di SMK Tri Mitra Menggunakan Metode End User Computing Satisfaction (EUCS),” JATI (Jurnal Mhs. Tek. Inform., vol. 7, no. 3, pp. 1896–1900, 2023, doi: 10.36040/jati.v7i3.7017.

Biro Teknologi Informasi UBSI, “Intuitive Research & Development Knowledge Base,” 2024. https://saysv2.bsi.ac.id/beranda (accessed Dec. 01, 2024).

T. Yamane, Statistics: An Introductory Analysis, Third Edit. New York: Harper & Row, 1973.

R. V Krejcie and D. W. Morgan, “Determining sample size for research activities,” Educ. Psychol. Meas., vol. 30, no. 3, pp. 607–610, 1970.

W. B. Cochran, Sampling Techniques. John Wiley and Sons, 1977.

J. F. Hair, G. T. M. Hult, C. M. Ringle, and M. Sarstedt, A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). California: SAGE Publications, Inc, 2022.

C. Fornell and D. F. Larcker, “Evaluating Structural Equation Models with Unobservable Variables and Measurement Error,” J. Mark. Res., vol. 18, no. 1, pp. 39–50, Feb. 1981, doi: 10.1177/002224378101800104.

J. Henseler, C. M. Ringle, and M. Sarstedt, “A new criterion for assessing discriminant validity in variance-based structural equation modeling,” J. Acad. Mark. Sci., vol. 43, no. 1, pp. 115–135, Jan. 2015, doi: 10.1007/s11747-014-0403-8.

J. Cohen, Statistical Power Analysis for the Behavioral Sciences. Routledge, 2013.

J. F. Hair, J. J. Risher, M. Sarstedt, and C. M. Ringle, “When to use and how to report the results of PLS-SEM,” Eur. Bus. Rev., vol. 31, no. 1, pp. 2–24, 2019, doi: 10.1108/EBR-11-2018-0203.

O. J. Aburumman, K. Omar, M. Al Shbail, and M. Aldoghan, “How to deal with the results of PLS-SEM?,” in International conference on business and technology, 2022, pp. 1196–1206.

V. Samartha and R. Kodikal, “Measuring the Effect Size of Coefficient of Determination and Predictive Relevance of Exogenous Latent Variables on Endogenous Latent Variables through PLS-SEM,” 2018, [Online]. Available: https://api.semanticscholar.org/CorpusID:220933458.

B. E. Hayes, Measuring Customer Satisfaction and Loyalty: Survey Design, Use, and Statistical Analysis Methods. ASQ Quality Press, 2008.

Y. A. Takke, L. F. Marini, and L. Y. Baisa, “Analisis Kepuasan Pengguna Aplikasi PELNI Mobile Menggunakan Metode Technology Acceptance Model (TAM) dan End User Computing Satisfaction (EUCS),” G-Tech J. Teknol. Terap., vol. 8, no. 3, pp. 1921–1930, 2024, doi: 10.33379/gtech.v8i3.4700.

S. Vairamuthu and S. Margret Anouncia, “Reconnoitering Students’ Satisfaction of an Online Based Assessment System to Improve Usability using PSO: An Examination into a Problem Solving and Programming Course,” Eng. Technol. Appl. Sci. Res., vol. 6, no. 5, pp. 1207–1211, 2016, doi: 10.48084/etasr.800.

B. Suzanto and I. Sidharta, “Pengukuran End-User Computing Satisfaction Atas Penggunaan Sistem Informasi Akademik,” J. Ekon. Bisnis Entrep., vol. 9, no. 1, pp. 16–28, 2015.

A. A. Perdana, M. C. Utami, and Q. Aini, “End User Computing Satisfaction : Model Analisis Kepuasan Pengguna Aplikasi Menggunakan Partial Least Square Structural Equation Modeling (Studi Kasus),” J. Teknol. Inf. dan Ilmu Komput., vol. 8, no. 6, pp. 1237–1246, 2021, doi: 10.25126/jtiik.2021863586.

M. J. Fitriantoro and N. Husnah, “The Implementation of the End-User Computing Satisfaction Model into SCeLE: A Study of the Undergraduate Program of the Accounting Department in Universitas Indonesia,” vol. 55, no. Iac 2017, pp. 151–155, 2018, doi: 10.2991/iac-17.2018.27.

N. Wanma, D. I. Inan, and L. Y. Baisa, “Evaluasi User Experience Dan User Interface Aplikasi Laporkitong Dengan End User Computing Satisfaction,” Jutisi J. Ilm. Tek. Inform. dan Sist. Inf., vol. 13, no. 1, p. 304, 2024, doi: 10.35889/jutisi.v13i1.1789.

K. N. R. Al Habsyi, B. M. Izzati, and M. Saputra, “Analisis Tingkat Kepuasan Pengguna E-Learning Universitas Telkom Menggunakan Metode End-User Computing Satisfaction,” JATISI (Jurnal Tek. Inform. dan Sist. Informasi), vol. 8, no. 2, pp. 623–635, 2021, doi: 10.35957/jatisi.v8i2.765.

A. Y. AL-Sabawy, “Measuring e-learning systems success. PhD Thesis Doctor of Philosophy,” University of Southern Queensland, 2013.


Article Metrics

 Abstract Views : 129 times
 PDF Downloaded : 36 times  PDF Downloaded : 42 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.