Development on Online Learning Analysis System of University of Phayao
Keywords:
Online learning, Online learning analytics systemAbstract
This research aimed to (1) design and develop an online learning analytics system, (2) evaluate the efficiency and satisfaction of the online learning analytics system, and (3) assess the innovation quality of the online learning analytics system. The researcher applied the System Development Life Cycle (SDLC) approach to develop the online learning analytics system. The sample group consisted of 34 faculty members and administrators from the University of Phayao who utilized the UP e-Learning system, selected through purposive sampling to collect system requirements data. The research instruments included (1) the online learning analytics system, (2) an evaluation form for system efficiency assessment, (3) an evaluation form for system usage satisfaction assessment, and (4) an evaluation form for innovation quality assessment of the online learning analytics system. Statistical analyses employed percentage, mean, and standard deviation.
The research findings revealed: (1) The results of designing and developing the online learning analytics system showed that users had the highest requirement for login frequency data with an IOC value of 1.0, and content view data also had the highest requirement with an IOC value of 1.0. (2) The results of evaluating efficiency and satisfaction of the online learning analytics system showed that system efficiency was at the highest level (x̄=4.63, S.D.=0.27), administrator satisfaction was at the highest level (x̄=4.53, S.D.=0.19), and faculty satisfaction was at the highest level (x̄=4.65, S.D.=0.47). (3) The results of innovation quality assessment of the online learning analytics system at the University of Phayao indicated high quality, appropriateness, and practical applicability (IOC=0.97).
References
Baker, R. S., & Inventado, P. S. (2014). Educational data mining and learning analytics. In Learning analytics, 61–75. Springer. Form https://doi.org/10.1007/978-1-4614-3305-7_4.
Center for Information Technology and Communication Services. (2023, August 31–September 1). Information technology skills development project: Data analysis with Power BI [Training session]. Smart Training Room, Center for Information Technology and Communication Services, University of Phayao. (in Thai)
Clow, D. (2012). The learning analytics cycle: Closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 134–138). ACM. Form https://doi.org/10.1145/2330601.2330636.
Digital Tips. (2022, February 5). Data analytics คืออะไร พร้อมตัวอย่างการใช้ big data เพื่อต่อยอดธุรกิจ [What is data analytics, with examples of using big data to grow your business]. The Digital Tips. Form https://thedigitaltips.com/blog/data-for-business/data-analytic/ .
Farouk, M. (2023). Course and activity completion reports (all users) [Moodle plugin]. Moodle.org. Form https://moodle.org/plugins/report_completionall.
Fowler, J. (2022). Completion progress [Moodle plugin]. Moodle.org. Form https://moodle.org/plugins/block_completion_progress.
Institute for Innovative Learning. (2023). Strategic plan for the development of the Institute for Innovative Learning, fiscal years 2023–2027. Form https://upili.up.ac.th/ebook_plan/. (in Thai)
Jadhav, A. S., & Sonar, R. M. (2011). Framework for evaluation and selection of the software packages: A hybrid knowledge based system approach. Journal of Systems and Software, 84(8), 1394–1407. Form https://doi.org/10.1016/j.jss.2011.03.034.
Jinpon, P., Jaroensutasinee, M., & Jaroensutasinee, K. (2019). Integrated information visualization to support decision making for health promotion in Chonburi, Thailand. Walailak Journal of Science and Technology, 16(12), 999–1008. Form https://doi.org/10.48048/wjst.2019.2181.
Koedsri, A. (2021). Analysis of learning behaviors in massive open online courses: An application of machine learning and deep learning. Journal of Measurement, Evaluation, Statistics, and Social Science Research, 2(2), 14–28. Form https://so03.tci-thaijo.org/index.php/mesr/article/view/256973/171598. (in Thai)
Krutkham, B. (2015). Evaluation criteria for the information system efficiency of the teacher professional experience training center [Unpublished manuscript]. Faculty of Education, Sakon Nakhon Rajabhat University. (in Thai)
Liebowitz, J. (2020). Online learning analytics. Auerbach Publications.
Long, P., & Siemens, G. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE Review, 46(5), 30–32.
Microsoft Training. (2024). Overview of data analysis. Microsoft Learn. Form https://learn.microsoft.com/en-us/training/modules/get-started-with-power-bi/2-using-power-bi?ns-enrollment-type=learningpath&ns-enrollment-id=learn-bizapps.get-started-data-analytics.
Niall, S., Alice, P., & Joel, M. (2016). Learning analytics in higher education. Academia.edu Journals. Form https://www.academia.edu/41021774/Learning_Analytics_in_Higher_Education_A_review_of_UK_and_international_practice_Full_report.
Pholmat, P., & Silpasuwanchai, C. (2019). Learning analytics: The relationship between cultural differences and online behaviors. Journal of Education Studies, 47(3), 257–268. Form https://doi.org/10.58837/CHULA.EDUCU.47.3.14.
Prakobpon, S. (2020). Evaluating educational innovation in the Education 4.0 era. Journal of Education, Bansomdejchaopraya Rajabhat University, 12(2), 295–311. Form https://edujournal.bsru.ac.th/download-file/media/1334. (in Thai)
Romero, C., & Ventura, S. (2020). Educational data mining and learning analytics: An updated survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(3), Article e1355. Form https://doi.org/10.1002/widm.1355.
Rovinelli, R. J., & Hambleton, R. K. (1977). On the use of content specialists in the assessment of criterion-referenced test item validity. Tijdschrift Voor Onderwijs Research, 2(2), 49–60.
Saising, J. (2023). Development of a teaching management evaluation system for academic personnel via web application: A case study of North-Eastern University. Journal of Academic and Research, North-Eastern University, 13(4), 236–251. Form https://so04.tci-thaijo.org/index.php/neuarj/
article/download/266977/182008. (in Thai)
SCB TechX. (2023, February 11). ไขข้อสงสัย data analytics คืออะไร และ data analytics มีกี่ประเภท? [Answering the question: What is data analytics and what are its types?]. SCB TechX. Form https://scbtechx.io/th/blogs/definition-and-types-of-data-analytics/.
Suwattipong, C. (2024). Evaluation of innovation, media, and technology for early childhood education [Unpublished manuscript]. School of Educational Technology, Sukhothai Thammathirat Open University. (in Thai)
Thamrongrattanarit, A. (2021, September 10). A short, concise, and easy-to-understand summary of data analytics [Video]. YouTube. Form https://x.com/suslibrary/status/1666459901307019268. (in Thai)
Udomthanatheera, K. (2019). System Development Life Cycle (SDLC). Logistics.
Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist, 57(10), 1500–1509. Form https://doi.org/10.1177/0002764213479363.
Wongkhan, K. (2018). Research and development (R&D) models and participatory action research (PAR) models. Department of Chemistry, Faculty of Science, Ubon Ratchathani University. (in Thai)
Yu, T., & Jo, I. H. (2014). Educational technology approach toward learning analytics: Relationship between student online behavior and learning performance in higher education. In Proceedings of the Fourth International Conference on Learning Analytics And Knowledge (pp. 269–270). ACM. Form https://doi.org/10.1145/2567574.2567594.
