Analyzing Student Evaluations of Teaching in a Completely Online Environment

Full Text (PDF, 616KB), PP.13-24

Views: 0 Downloads: 0

Author(s)

Nyme Ahmed 1,* Dip Nandi 1 A. G. M. Zaman 1

1. Department of Computer Science, American International University-Bangladesh, Dhaka, 1219, Bangladesh

* Corresponding author.

DOI: https://doi.org/10.5815/ijmecs.2022.06.02

Received: 7 Aug. 2022 / Revised: 16 Sep. 2022 / Accepted: 15 Nov. 2022 / Published: 8 Dec. 2022

Index Terms

Decision Tree, Educational Data Mining, Faculty performance evaluation, Online educational environment, Sentimental analysis, Teaching quality, Word cloud

Abstract

Almost all educational institutions have shifted their academic activities to digital platforms due to the recent COVID-19 epidemic. Because of this, it is very important to assess how well teachers are performing with this new way of online teaching. Educational Data Mining (EDM) is a new field that emerged from using data mining techniques to analyze educational data and making decision based on findings. EDM can be utilized to gain better understanding about students and their learning processes, assist teachers do their academic tasks, and make judgments about how to manage educational system. The primary objective of this study is to uncover the key factors that influence the quality of teaching in a virtual classroom environment. Data is gathered from the students’ evaluation of teaching from computer science students of three online semesters at X University. In total, 27622 students participated in these survey. Weka, sentimental analysis, and word cloud generator are applied in the process of carrying out the research. The decision tree classifies the factors affecting the performance of the teachers, and we find that student-faculty relation is the most prominent factor for improving the teaching quality. The sentimental analysis reveals that around 78% of opinions are positive and “good” is the most frequently used word in the opinions. If the education system is moved online in the future, this research will help figure out what needs to be changed to improve teachers’ overall performance and the quality of their teaching.

Cite This Paper

Nyme Ahmed, Dip Nandi, A. G. M. Zaman, "Analyzing Student Evaluations of Teaching in a Completely Online Environment", International Journal of Modern Education and Computer Science(IJMECS), Vol.14, No.6, pp. 13-24, 2022. DOI:10.5815/ijmecs.2022.06.02

Reference

[1]Ahmed, N., Rifat-Ibn-Alam, M., Akib, G.A., Shefat, S.N. and Nandi, D., 2022. An Extensive Analysis on Computing Students' Academic Performance in Online Environment using Decision Tree. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 13(1), pp.149-163.
[2]Shefat, S.N., Akib, M.G.A., Ahmed, N. and Nandi, D., 2022. Investigation of Computing Students’ Performances in a Fully Online Environment During COVID-19 Pandemic. Malaysian Journal of Science and Advanced Technology, pp.23-30.
[3]Akib, M.G.A., Ahmed, N., Shefat, S.N. and Nandi, D., 2022. A Comparative Analysis among Online and On-Campus Students Using Decision Tree.
[4]Ali, M.T., Rahman, M.A. and Lamagna, C.Z., 2021. Comparative analysis of program outcomes achievement between face-to-face and virtual classes during COVID-19 pandemic. AIUB Journal of Science and Engineering (AJSE), 20(1), pp.1-7.
[5]Nandi, D., Hamilton, M., Harland, J. and Mahmood, S., 2015. Investigation of participation and quality of online interaction. International Journal of Modern Education and Computer Science, 7(8), p.25.
[6]Spooren, P. and Christiaens, W., 2017. I liked your course because I believe in (the power of) student evaluations of teaching (SET). Students’ perceptions of a teaching evaluation process and their relationships with SET scores. Studies in educational evaluation, 54, pp.43-49.
[7]Park, E. and Dooris, J., 2020. Predicting student evaluations of teaching using decision tree analysis. Assessment & Evaluation in Higher Education, 45(5), pp.776-793.
[8]Li, A., Liu, K. and Ge, Z., 2015. Application of Data Mining in the Colleges' in-Class Teaching Quality Evaluation System. J. Comput., 10(3), pp.166-175.
[9]Moreno-Murcia, J., Torregrosa, Y.S. and Pedreo, N.B., 2015. Questionnaire evaluating teaching competencies in the university environment. Evaluation of teaching competencies in the university. Journal of New Approaches in Educational Research (NAER Journal), 4(1), pp.54-61.
[10]Mohammed, T.A. and Pandhiani, S.M., 2017. Analysis of factors affecting student evaluation of teaching effectiveness in Saudi higher education: the case of Jubail University college. American Journal of Educational Research, 5(5), pp.464-475.
[11]Estelami, H., 2016. An Exploratory Study of the Effects of Online Course Efficiency Perceptions on Student Evaluation of Teaching (SET) Measures. American Journal of Business Education, 9(2), pp.67-82.
[12]Lim, S.D., Lee, J., ParK, H.S., Yu, J.R., Lee, K.Y., Sohn, I.S. and Lee, R., 2008. Experience and consideration on online course evaluation by medical students. Korean Journal of Medical Education, 20(4), pp.367-371.
[13]Lin, Q., Zhu, Y., Zhang, S., Shi, P., Guo, Q. and Niu, Z., 2019. Lexical based automated teaching evaluation via students’ short reviews. Computer Applications in Engineering Education, 27(1), pp.194-205.
[14]El-Halees, A., 2011, June. Mining opinions in user-generated contents to improve course evaluation. In International conference on software engineering and computer systems (pp. 107-115). Springer, Berlin, Heidelberg.
[15]Newman, H. and Joyner, D., 2018, June. Sentiment analysis of student evaluations of teaching. In International conference on artificial intelligence in education (pp. 246-250). Springer, Cham.
[16]Hasan, M.R., Maliha, M. and Arifuzzaman, M., 2019, July. Sentiment analysis with NLP on Twitter data. In 2019 International Conference on Computer, Communication, Chemical, Materials and Electronic Engineering (IC4ME2) (pp. 1-4). IEEE.
[17]Kanakaraj, M. and Guddeti, R.M.R., 2015, March. NLP based sentiment analysis on Twitter data using ensemble classifiers. In 2015 3Rd international conference on signal processing, communication and networking (ICSCN) (pp. 1-5). IEEE.
[18]Chong, W.Y., Selvaretnam, B. and Soon, L.K., 2014, December. Natural language processing for sentiment analysis: an exploratory analysis on tweets. In 2014 4th international conference on artificial intelligence with applications in engineering and technology (pp. 212-217). IEEE.
[19]Shelar, A. and Huang, C.Y., 2018, December. Sentiment analysis of twitter data. In 2018 International Conference on Computational Science and Computational Intelligence (CSCI) (pp. 1301-1302). IEEE.
[20]Agarwal, A., Xie, B., Vovsha, I., Rambow, O. and Passonneau, R.J., 2011, June. Sentiment analysis of twitter data. In Proceedings of the workshop on language in social media (LSM 2011) (pp. 30-38).
[21]Sahayak, V., Shete, V. and Pathan, A., 2015. Sentiment analysis on twitter data. International Journal of Innovative Research in Advanced Engineering (IJIRAE), 2(1), pp.178-183.
[22]El Rahman, S.A., AlOtaibi, F.A. and AlShehri, W.A., 2019, April. Sentiment analysis of twitter data. In 2019 international conference on computer and information sciences (ICCIS) (pp. 1-4). IEEE.
[23]Spencer, J. and Uchyigit, G., 2012, September. Sentimentor: Sentiment analysis of twitter data. In SDAD@ ECML/PKDD (pp. 56-66).
[24]Shamrat, F.M.J.M., Chakraborty, S., Imran, M.M., Muna, J.N., Billah, M.M., Das, P. and Rahman, O.M., 2021. Sentiment analysis on twitter tweets about COVID-19 vaccines using NLP and supervised KNN classification algorithm. Indonesian Journal of Electrical Engineering and Computer Science, 23(1), pp.463-470.
[25]Nemes, L. and Kiss, A., 2021. Social media sentiment analysis based on COVID-19. Journal of Information and Telecommunication, 5(1), pp.1-15.
[26]Tusar, M.T.H.K. and Islam, M.T., 2021, September. A comparative study of sentiment analysis using NLP and different machine learning techniques on US airline Twitter data. In 2021 International Conference on Electronics, Communications and Information Technology (ICECIT) (pp. 1-4). IEEE.
[27]Abualigah, L., Alfar, H.E., Shehab, M. and Hussein, A.M.A., 2020. Sentiment analysis in healthcare: a brief review. Recent Advances in NLP: The Case of Arabic Language, pp.129-141.
[28]Mitra, A., 2020. Sentiment analysis using machine learning approaches (Lexicon based on movie review dataset). Journal of Ubiquitous Computing and Communication Technologies (UCCT), 2(03), pp.145-152.
[29]Shivaprasad, T.K. and Shetty, J., 2017, March. Sentiment analysis of product reviews: a review. In 2017 International conference on inventive communication and computational technologies (ICICCT) (pp. 298-301). IEEE.
[30]Shafin, M.A., Hasan, M.M., Alam, M.R., Mithu, M.A., Nur, A.U. and Faruk, M.O., 2020, December. Product review sentiment analysis by using NLP and machine learning in Bangla language. In 2020 23rd International Conference on Computer and Information Technology (ICCIT) (pp. 1-5). IEEE.
[31]Chitra, P., Karthik, T.S., Nithya, S., Poornima, J.J., Rao, J.S., Upadhyaya, M., Kumar, K.J., Geethamani, R. and Manjunath, T.C., 2021. Sentiment analysis of product feedback using natural language processing. Materials Today: Proceedings.
[32]Eibe Frank, Mark A. Hall, and Ian H. Witten (2016). The WEKA Workbench. Online Appendix for "Data Mining: Practical Machine Learning Tools and Techniques", Morgan Kaufmann, Fourth Edition, 2016.