Integrasi Heuristic Evaluation dan Cognitive Walkthrough sebagai Instrumen Penjaminan Mutu Desain User-Centered pada Sistem Informasi

Authors

DOI:

https://doi.org/10.31294/justian.v7i1.12380

Keywords:

Heuristic Evaluation, Cognitive Walkthrough, User Centered Design, Quality Assurance, UI/UX Evaluation, Software Requirement

Abstract

User-centered design (UCD) has become essential in enterprise information system development. However, systematic and quantitatively validated usability assurance methods during the design phase remain underutilized. This study proposes and empirically validates a quantitative integration framework combining Heuristic Evaluation (HE) and Cognitive Walkthrough (CW) for enterprise usability assurance. A high-fidelity interactive enterprise dashboard prototype developed in Figma was evaluated by five expert reviewers using Nielsen’s ten heuristics and seven task-based walkthrough scenarios. After normalization and deduplication, the integrated approach identified 68 unique usability issues. HE contributed 42 issues, while CW identified 31 issues, with 39.7% overlapping findings. The proposed integration achieved a 61.9% coverage improvement compared to the best single method. Severity analysis revealed a Mean Severity Index of 2.24 and a Weighted Severity Score of 94 (HE) and 70 (CW), indicating moderate-to-high usability risk. Inter-rater reliability measured using Fleiss’ Kappa yielded κ = 0.78, demonstrating substantial agreement among evaluators. Additionally, the detection efficiency reached 2.47 issues per person-hour, supporting the framework’s practical feasibility. The findings demonstrate that the proposed integration framework enhances usability detection coverage, maintains high evaluation consistency, and provides a cost-effective approach for early-stage enterprise system design assurance.

References

[1] Development of Hybrid Mobile Applications for Enterprise Systems. n.d.

[2] Buana W, Nurina Sari B. Analisis User Interface Meningkatkan Pengalaman Pengguna Menggunakan Usability Testing pada Aplikasi Android Course 2022;5:91–7.

[3] Jatmiko A, Legong GM. Analisis Kualitas Pelayanan Akses Informasi E-Health Menggunakan Metode E-GovQual. Jurnal Informatika Polinema 2023;10:69–76. https://doi.org/10.33795/jip.v10i1.1478.

[4] Goel G, Tanwar P, Sharma S. UI-UX Design Using User Centred Design (UCD) Method. 2022 International Conference on Computer Communication and Informatics (ICCCI), 2022, p. 1–8. https://doi.org/10.1109/ICCCI54379.2022.9740997.

[5] Syarif M. Desain Mockup Sistem Informasi Simpanan Pelajar (SIMPEL) dengan Pendekatan User-Centered Design. vol. 6. 2025.

[6] Fleury S, Chaniaud N. Multi-user centered design: acceptance, user experience, user research and user testing. Theor Issues Ergon Sci 2024;25:209–24. https://doi.org/10.1080/1463922X.2023.2166623.

[7] Wira M, Dananjaya P, Humaswara Prathama G, Darmaastawan K. User-Centered Design Approach in Developing User Interface and User Experience of Sculptify Mobile Application. Architecture and High Performance Computing 2024;6. https://doi.org/10.47709/cnapc.v6i3.4206.

[8] Langevin R, Lordon R, Avrahami T. Heuristic evaluation of conversational agents. Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery; 2021. https://doi.org/10.1145/3411764.3445312.

[9] Usability evaluation of a nursing information system by applying cognitive walkthrough method n.d.

[10] Fernández J, Mac’{i}as JA. Heuristic-Based Usability Evaluation Support: A Systematic Literature Review and Comparative Study. Proceedings of the XXI International Conference on Human Computer Interaction, New York, NY, USA: Association for Computing Machinery; 2021. https://doi.org/10.1145/3471391.3471395.

[11] Shintia S, Gito Resmi M, Hafid MT, Tinggi Teknologi Wastukancana S. PENGUJIAN USABILITY DENGAN MENGGUNAKAN METODE COGNITIVE WALKTHROUGH (CW) DAN SYSTEM USABILITY SCALE (SUS) TERHADAP APLIKASI MyYOGYA 2023;8.

[12] Pritalia GL, Cristian AA, Nastiti P. Assessing User Experience in Academic Information Systems: Insights from Heuristic Evaluation and UEQ. 2025 5th International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET), 2025, p. 1–6. https://doi.org/10.1109/IRASET64571.2025.11008331.

[13] Cho H, Keenan G, Madandola OO, Dos Santos FC, Macieira TGR, Bjarnadottir RI, Priola KJB, Lopez KD. Assessing the Usability of a Clinical Decision Support System: Heuristic Evaluation. JMIR Hum Factors 2022;9. https://doi.org/10.2196/31758.

[14] Ihsan N, Okilanda A, Farell G, bin Zakaria J, Nizam Mohamed Shapie M. Heuristic Evaluation of the Sport Analysis Application Interface Evaluación heurística de la interfaz de la aplicación de análisis deportivo. n.d.

[15] Gonzalez Capdevila M, Pistili Rodrigues KA, Sartório Furlan TA, Granollers T. Quantifying heuristic evaluation. Comput Stand Interfaces 2025;92:103891. https://doi.org/https://doi.org/10.1016/j.csi.2024.103891.

[16] Lazar Jonathan, Feng JHeidi, Hochheiser Harry. Research methods in human-computer interaction. Morgan Kaufmann Publishers, an imprint of Elsevier; 2017.

[17] Talero-Sarmiento L, Gonzalez-Capdevila M, Granollers A, Lamos-Diaz H, Pistili-Rodrigues K. Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment. Big Data and Cognitive Computing 2024;8. https://doi.org/10.3390/bdcc8060069.

Downloads

Published

2026-03-30

How to Cite

Integrasi Heuristic Evaluation dan Cognitive Walkthrough sebagai Instrumen Penjaminan Mutu Desain User-Centered pada Sistem Informasi. (2026). Jurnal Sistem Informasi Akuntansi, 7(1), 41-49. https://doi.org/10.31294/justian.v7i1.12380