Comparing the Acceptance of Key Performance Indicators Management Systems on Perceived Usefulness and Perceived Ease of Use in a Higher Education Institution in Malaysia

Full Text (PDF, 624KB), PP.9-16

Views: 0 Downloads: 0

Author(s)

Mei Yean ONG 1,* Balakrishnan Muniandy 1 Saw Lan ONG 2 Keow Ngang TANG 2 Kia Kien PHUA 3

1. Centre of Instructional Technology & Multimedia, Universiti Sains Malaysia, 11800 Minden, Penang, Malaysia

2. School of Educational Studies, Universiti Sains Malaysia, 11800 Minden, Penang, Malaysia

3. Institute for Research in Molecular Medicine, Universiti Sains Malaysia, 11800 Minden, Penang, Malaysia

* Corresponding author.

DOI: https://doi.org/10.5815/ijmecs.2012.10.02

Received: 14 Jun. 2012 / Revised: 2 Jul. 2012 / Accepted: 15 Aug. 2012 / Published: 8 Oct. 2012

Index Terms

Key Performance Indicators, Key Performance Indicator Monitoring System, Excel Spreadsheet System, Technology Acceptance Model

Abstract

This article discusses the findings of a study that elucidated users’ acceptance of two management systems for key performance indicators (KPIs) in terms of their usefulness and ease of use scores at a higher education institution in Malaysia. The two management systems were Key Performance Indicators Monitoring System (KPI-MS) and Excel Spreadsheet System (ESS). ESS is a system developed using Microsoft Excel and has been in used since the year 2008 in the institution to calculate KPIs marks. The ESS system, however, has several shortcomings, and the KPI-MS system was developed with the intention to replace ESS. KPI-MS is an online KPI performance monitoring system which allows users to access the system wherever and whenever they want using a web browser. In addition, KPI-MS is designed as an intelligent system that is able to process raw data automatically to produce results that can be easily visualized in a graphical manner. A survey questionnaire was used to collect data on the acceptance of both systems. A total of 78 participants who were involved in KPI data processing from all 42 schools and centres in the higher education institution in Malaysia participated in this study. The instrument of this study was adapted and modified from Davis’ Technology Acceptance Model (TAM). This instrument was content-validated by three experts in the related field and the reliability index computed with Cronbach alpha was 0.955. A descriptive analysis was conducted to compare the mean scores of both KPI-MS and ESS rated by the users. The results showed that the users rated KPI-MS as a very useful system in monitoring KPI performance of their schools or centres compared to ESS. Also, users rated the KPI-MS to be significantly easier (p≤0.01) and more enjoyable to use. In conclusion, it is recommended that KPI-MS should replace the ESS system in managing KPIs data.

Cite This Paper

Mei Yean ONG, Balakrishnan Muniandy, Saw Lan ONG, Keow Ngang TANG, Kia Kien PHUA, "Comparing the Acceptance of Key Performance Indicators Management Systems on Perceived Usefulness and Perceived Ease of Use in a Higher Education Institution in Malaysia", International Journal of Modern Education and Computer Science(IJMECS), vol.4, no.10, pp.9-16, 2012. DOI:10.5815/ijmecs.2012.10.02

Reference

[1]Xiong, G., Qin, T., Wang, F., Hu, L., & Shi, Q. (2010). Design and improvement of KPI system for materials management in Power Group Enterprise. IEEE, 171-176.
[2]Arash, S., & Mahbod, M. A. (2007). Prioritization of key performance indicators: An integration of analytical hierarchy process and goal setting. [Article]. International Journal of Productivity & Performance Management, 56(3), 226-240.
[3]Chan A. P. C., & L., C. A. P. (Apr 2004). Key performance indicators for measuring construction success. Benchmarking: An International Journal, 11(2), 203-216 (214 pages). doi: 10.1108/14635770410532624
[4]Breakwell, G. M., & Tytherleigh, M. Y. (2010). University leaders and university performance in the United Kingdom: is it 'who' leads, or 'where' they lead that matter most? Science+Business Media 60, 491-506. doi: 10.1007/s10734-010-9311-0
[5]Davis, F. D. (1986). A technology acceptance model for empirically testing new end-user information systems: theory and results. Doctorial Doctorial Dissertation, Massachusetts Institute of Technology.
[6]Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. Management Information Systems Research Center, University of Minnesota, 13(3), 319-340. doi: 10.2307/249008
[7]Davis, F. D. (1993). User accceptance of information technology: system characteristics, user perceptions, and behavioural impacts. Int. J. Man-Machine Studies, 38, 475-487.
[8]Ramayah, T., & Ignatius, J. (2005). Impact of perceived usefulness, perceived ease of use and perceived enjoyment on intention to shop online. ICFAI Journal of Systems Management (IJSM, III(3), 36 – 51.
[9]Parka, N., Roman, R., Lee, S., & Chung, J. E. (2009). User acceptance of a digital library system in developing countries: An application of the Technology Acceptance Model. International Journal of Information Management, 29, 196–209.
[10]Ong, M. Y., Muniandy, B., Ong, S. L., Tang, K. N., & Phua, K. K. (2011). User acceptance of a key performance indicators monitoring system (KPI-MS) in a higher education institution in Malaysia: A pilot study. Paper presented at the 5th International Malaysian Educational Technology Convention, Kuantan, Pahang, Malaysia.
[11]Muniandy, B., Ong, M. Y., Phua, K. K., & Ong, S. L. (2011a). Assessing Key Performance Indicators Monitoring System (KPI-MS) of a university using Technology Acceptance Model. International Journal of Social Science and Humanity, 1(3), 171-176.
[12]Muniandy, B., Ong, M. Y., Phua, K. K., & Ong, S. L. (2011b). User Acceptance of a Key Performance Indicators Monitoring System (KPI-MS) in Higher Education: An Application of the Technology Acceptance Model. Paper presented at the 2nd International Conference on Education and Management Technology, Shanghai, China.