Effectiveness analysis of e-learning implementation models and resource support in higher education institutions: case studies and insights amidst the COVID-19 pandemic CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 Effectiveness analysis of e-learning implementation models and resource support in higher education institutions: case studies and insights amidst the COVID-19 pandemic Olena G. Glazunova1, Maksym V. Mokriiev1, Olena H. Kuzminska1, Valentyna I. Korolchuk1, Nataliia V. Morze2, Liliia O. Varchenko-Trotsenko2 and Roman A. Zolotukha1 1National University of Life and Environmental Sciences of Ukraine, 15 Heroyiv Oborony Str., Kyiv, 03041, Ukraine 2Borys Grinchenko Kyiv University, 18/2 Bulvarno-Kudryavska Str., Kyiv, 04053, Ukraine Abstract. The COVID-19 pandemic has accentuated the need for comprehensive analysis of the effective- ness of e-learning implementation models and the supporting resources in higher education institutions. This article provides an overview of solutions and case studies, focusing on the selection and evaluation of individual services and learning management platforms. To gauge the effectiveness of electronic resources in meeting students’ educational needs, the study recommends employing quantitative indi- cators in conjunction with students’ performance descriptions. This includes leveraging educational analytics to gather data on students’ frequency and duration of engagement with specific e-resources. The functionality modules “Course Comparison” of the Moodle Learning Management System (LMS) and “Statistics”, along with the optional Analytics module, are reviewed. The article presents the results of applying these modules to analyze e-learning courses at the National University of Life and Environ- mental Sciences of Ukraine and Boris Grinchenko Kyiv University. Furthermore, the study investigates the factors contributing to students’ limited usage of individual e-courses. By examining these case studies and shedding light on the reasons behind students’ reduced engagement, this article contributes valuable insights to enhance the efficacy of e-learning implementation and resource support in higher education institutions. Keywords: e-learning effectiveness, higher education institutions, resource support, COVID-19 pan- demic, learning management platforms, educational analytics, student engagement " o-glazunova@nubip.edu.ua (O. G. Glazunova); m.mokriiev@nubip.edu.ua (M. V. Mokriiev); o.kuzminska@nubip.edu.ua (O. H. Kuzminska); korolchuk@nubip.edu.ua (V. I. Korolchuk); n.morze@kubg.edu.ua (N. V. Morze); l.varchenko@kubg.edu.ua (L. O. Varchenko-Trotsenko); remko740@gmail.com (R. A. Zolotukha) ~ https://nubip.edu.ua/node/14512 (O. G. Glazunova); https://nubip.edu.ua/node/11668 (M. V. Mokriiev); https://nubip.edu.ua/node/3983 (O. H. Kuzminska); https://nubip.edu.ua/node/73759 (V. I. Korolchuk); https://fitm.kubg.edu.ua/struktura1/kafedry/kafedra-kompiuternykh-nauk/sklad/824-1.html (N. V. Morze); https://fitm.kubg.edu.ua/struktura1/kafedry/kafedra-kompiuternykh-nauk/sklad/841-1.html (L. O. Varchenko-Trotsenko); https://docs.google.com/document/d/ 1NYhzzlTjechtsrxzloxcFuYQF9ckzd6K3gAK2QuPW5s/edit#heading=h.9maqfqc3fyjx (R. A. Zolotukha) � 0000-0002-0136-4936 (O. G. Glazunova); 0000-0002-6717-3884 (M. V. Mokriiev); 0000-0002-8849-9648 (O. H. Kuzminska); 0000-0002-3145-8802 (V. I. Korolchuk); 0000-0002-0136-4936 (N. V. Morze); 0000-0003-0723-4195 (L. O. Varchenko-Trotsenko); 0000-0003-3099-722X (R. A. Zolotukha) CTE Workshop Proceedings © Copyright for this paper by its authors, published by Academy of Cognitive and Natural Sciences (ACNS). This is an Open Access article distributed under the terms of the Creative Commons License Attribution 4.0 International (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 225 https://doi.org/10.55056/cte.558 mailto:o-glazunova@nubip.edu.ua mailto:m.mokriiev@nubip.edu.ua mailto:o.kuzminska@nubip.edu.ua mailto:korolchuk@nubip.edu.ua mailto:n.morze@kubg.edu.ua mailto:l.varchenko@kubg.edu.ua mailto:remko740@gmail.com https://nubip.edu.ua/node/14512 https://nubip.edu.ua/node/11668 https://nubip.edu.ua/node/3983 https://nubip.edu.ua/node/73759 https://fitm.kubg.edu.ua/struktura1/kafedry/kafedra-kompiuternykh-nauk/sklad/824-1.html https://fitm.kubg.edu.ua/struktura1/kafedry/kafedra-kompiuternykh-nauk/sklad/841-1.html https://docs.google.com/document/d/1NYhzzlTjechtsrxzloxcFuYQF9ckzd6K3gAK2QuPW5s/edit##heading=h.9maqfqc3fyjx https://docs.google.com/document/d/1NYhzzlTjechtsrxzloxcFuYQF9ckzd6K3gAK2QuPW5s/edit##heading=h.9maqfqc3fyjx https://orcid.org/0000-0002-0136-4936 https://orcid.org/0000-0002-6717-3884 https://orcid.org/0000-0002-8849-9648 https://orcid.org/0000-0002-3145-8802 https://orcid.org/0000-0002-0136-4936 https://orcid.org/0000-0003-0723-4195 https://orcid.org/0000-0003-3099-722X https://acnsci.org/cte https://creativecommons.org/licenses/by/4.0 https://acnsci.org CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 1. Introduction The issue of the quality of e-learning resources in a distance learning environment is extremely relevant during the quarantine period associated with COVID-19 [8, 15]. Despite the various quality assurance procedures for e-learning resources for students, especially in forced distance learning settings, it is often very difficult to assess the quality of the resources used relying on these procedures, which mainly include student surveys and peer review. However, due to the transition of higher education institutions to distance learning and in the context of the pandemic generated by COVID-19, the problem of analyzing the quality and adapting the design models of educational environments [7, 12], according to the types of institutions, educational program, available resources, has become more relevant and other [5]. Looking at e-learning quality indicators from 2000 to 2017, Silva et al. [16], based on an analysis of scientific publications, identifies that indicators that have the greatest weight can be grouped into three categories: e-resources, data, processes. In the context of this study, we can look at the same resource provision with a focus on practical cases and a combination of quantitative and qualitative assessment. For example, in distance learning for future health professionals, digital imaging should be used extremely closely to real-life practice. Educational institutions use specialized software, e.g. Clinical Study Export (TCE) as a platform for extending the PACS infrastructure by connecting educational functions [11]. Understanding the importance of communication and cooperation in the implementation of distance learning, the effectiveness of the use of different services is the subject of analysis. For example, Biasutti [2] presents the results of a comparative analysis of forums and wikis as tools for online collaborative learning. However, as each service has to be seen in the context of student training requirements and educational goals, more and more researchers are looking at integrated solutions to support self-regulated educational strategies [10]. In this context, among the various learning Management Systems (LMS) on the market [1], LMS Moodle is the most popular in the implementation of distance and blended learning in higher education [14]. According to research by scientists from different countries, technological satisfaction about Moodle in higher education is quite high – the effect is equal to 0.78 with a 95% confidence interval from 0.72 to 0.84 [6]. The transition to distance learning and increasing the frequency of interaction between teachers and students through LMS has necessitated the search for resources to bring online communication closer to offline. One such solution is Moodle LMS integration with Amazon Alexa for creating voice content [13]. On the other hand, the success of a distance education program can be assessed, in addition to academic performance, by the level of student satisfaction. However, there is a correlation between student satisfaction with e-courses (e-resources and content) and readiness for online learning [4]. The latter is usually determined by surveying students, and is checked – by data of educational analytics which allow to analyze behavior of students in LMS [9]. Since the use of educational analytics or analytics for student success, according to Brown et al. [3] is identified as one of the areas of educational technology, we consider it appropriate to use educational analytics to determine the causes of student satisfaction / dissatisfaction, followed by recommendations for improving resources and methodological support its application in higher education institutions. To do this, it is necessary to explore the tools that can be used to 226 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 quickly analyze the effectiveness of resource use, in particular, e-learning courses in disciplines, and relevant indicators. Such analysis will allow a rapid response to the problems that users of e-courses are experiencing, allow for quick resolution of these problems and make student learning more productive. Research goal: justify the choice of tools for educational analytics on the use of e-learning courses, in particular to determine user activity, frequency and duration of use of course resources in order to recommend to teachers to improve the quality of both course materials and methods of using relevant resources during distance learning. 2. Methods and study materials The study was conducted using data from the training portal of National University of Life and Environmental Sciences of Ukraine (NULES) and Borys Grinchenko Kyiv University (BGKU). Methods and technologies of statistical analysis were used for the research. The university’s learning portal usually operates on the basis of CLMS (Content Learning Management System) platforms and is designed to support the learning process with e-resources in the format of e-books, web pages, lessons and video lessons, test tasks, laboratory and practical, independent work. For each discipline in the e-learning course can be placed the above and other resources. It should be noted that the use of e-learning courses in the educational process should correspond to the working curriculum of the discipline, and the resources should contain relevant, popular information. The procedure for attestation of electronic courses in universities involves the implementation of a number of criteria, which are usually spelled out in the relevant regulations. In particular, in NULES, these criteria are divided into structural- functional, scientific-substantive and methodological. But the use of certified courses is not uniform throughout the semester. At the same time, students actively use part of the resources in the courses, and some resources are not used at all. In order to identify the reasons for this and to select tools for quick analysis of course performance data and its resources, it is necessary to analyze the relevant tools, which are built-in or complementary. Let us focus on the statistical and analytical tools of CLMS Moodle. Course resource efficiency indicators can be obtained through the use of the embedded modules: “Course Comparison” and “Statistics” modules, as well as the optional “Analytics” module. 2.1. Features of the module “Comparison of courses” The analysis modules in the base Moodle distribution are not very powerful, but they are present too. One of the first modules that is appropriate to use when analyzing courses is Course Comparison. This can be found under Manage – Site Management – Reports. This module allows you to view four reports: 1. The most active courses (ranks courses by the number of actions taken by their participants as a whole). 2. Most active courses (weighted) (calculates the average performance per user in the course). 3. Participation rate (shows courses in descending order of user participation rate). 227 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 4. Activity ratio (determined by the ratio of involvement and participation of users in the course). Some of these concepts need clarification. The first analytical report gives us the opportunity to see on which course there is active activity. Activity on a course is the total number of all views and publications on the course during the period under study. However, this is of little use as a large number of enrolled users will visually create more activity compared to courses with a relatively small number of participants. Consequently, a weighted average of each user’s activity on the course is already more informative and will show everyone’s participation. Here you can see how truly active courses with a small number of users come to the fore. However, if there are few active users on the course, the mass of enrolled but inactive users will drag the course down in the rankings. The following report can clarify this nuance. It shows how many real active students are on the course. The participation rate of active users is calculated as the share of active users to the total enrolment in the course. Active users are defined as those who had had activity during the period under study. But here again the question arises, what are these users doing on the course? Are they just reading (receiving information) or are they active? The fourth report gives us the answer to this question. The publication and views activity ratio is calculated as the share of publications in relation to views. Where views refer to any user going to another page and “reading” it or downloading a file resource from the course to their computer. Publications are defined as any activity the user performs on a course, for example, completing a quiz, completing a task (downloading a file or writing a text response), replying to a forum post, and so on. That is publishing is not just a forum post. 2.2. Features of the “Statistics” module Another auxiliary module for analyzing course performance is the Statistics module, which operates at the site level, providing some statistics on the activity on courses as a whole, as well as in each individual course. At the site level, the results of this module are available to administrators and site managers. At the level of each course, teachers can use it to generate statistics within that course. About the Course Comparison module analyzing activities without dividing into teachers and students, it is important to say exactly who generates such activities – the actual training of students or the active creation of a teaching course by teachers. The Statistics module brings clarification. Using this module, we can see the activities of each individual role. It is also possible to look separately at views, only publications, or only introductions. At a site-wide level, these metrics plot all roles, while at a course level we can get a separate graph for each role. 2.3. Possibilities of the “Analytics” module Additional analytical reports can be obtained using third-party modules. One such powerful addition is the Analytics module. With its help it is possible to analyze activity of each student 228 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 both as a whole on a course, and in each concrete resource of a course. We are provided with such reports: • Valuation chart (shows the distribution of valuations using a stock chart) • Work with content (shows the activities of students with each resource separately – how much they worked and how much they ignored) • Student activity (shows a consolidated distribution of student activities on the course in terms of hours per day) • Execution of tasks (shows a diagram for all Tasks, which demonstrates compliance with the deadlines) • Passing tests (shows a diagram for all tests, which demonstrates compliance with the deadlines) • Distribution of views (shows the schedule of personal activities on the course of each student) Figure 1: Moodle e-course comparison module data model. 3. Main findings Only certified electronic learning courses (ELC) were chosen for the study, i.e. courses in which the structure and set of resources are correctly selected for the implementation of the 229 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 educational process. Thus in NULES the certified courses operate within 5 years, and in BGKU – within 1 year. The number of certified courses at the end of 2020 in NULES was 1644 courses, in BGKU – 768 courses. The first hundred most active courses (with high average activity per user) can be obtained by using the Course Comparison module and its “active courses (weighted)” report (figure 2). Figure 2: Courses usage statistics. Based on the results (figure 2) it is possible to identify courses with low user activity. The following analysis of the content of such courses, didactic features of the use of course resources will make it possible to identify relevant problems with their use. Usage statistics courses and the way they use within the categories are also using the module “Statistics”. For example, in BGKU such statistics can be obtained by categories of departments (figure 3), and in NULES – by categories of specialties. A direct query to the database of courses makes it possible to obtain such data for all certified courses. As a result, all courses can be divided into 3 categories: courses with low efficiency, sufficient and high in terms of “activity per user”. For example, NULES with a high degree of use has 12% of certified ELC, with sufficient – 57%, with low – 31%. Analyzing ELCs with high efficiency, a number of studies have been conducted on the use of resources of these ELCs using an analytical module built into Moodle. For example, figure 4 reflects the students’ activity in the course “Computer Technologies and Programming” during the last semester. The activity of students in revising resources and publishing completed tasks or passing tests is uneven. The peak falls towards the mid-term examinations and the end of the semester, which may explain the need to complete the quizzes. But we can conclude that the use of the course at the beginning of the module is not active 230 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 Figure 3: Courses usage statistics by category. enough and indicates that the laboratory and self-study assignments are not completed on time and, consequently, students are not working with the resources. To find out with which resources in e-courses, students work actively, the function “Working with content” of the module “Analytics” is used. For example, figure 5 shows the activity of using theoretical resources of the course “Information Technology”. From this diagram we can conclude about the extremely low activity of students in the use of theoretical resources, in contrast to laboratory work. Often students actively use electronic learning resources in a discipline only because they have to take a test every day and hand in work to be tested, but they do not use theoretical resources because they are not very informative. Another option is for students to actively use 231 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 Figure 4: Analysis of electronic courses on the subject of general activity of students. methodological materials in the discipline, watching video tutorials, and to a lesser extent use resources designed to monitor learning achievements. An important task for universities is to obtain tools to quickly assess the quality of electronic resources by further using their content and methodology in the teaching process. Next, you need to analyze the content of educational material set out in theoretical resources, in terms of structure, accessibility, relevance, practical orientation. These are all tasks of scientific and substantive examination. Such an electronic course can be reconsidered by the educational and methodical commissions of the faculties regarding the possibility of its use in the educational process. As a result of using such tools, we have the opportunity to determine which e-courses contain: • an excessive number of tasks (exceeding the number of laboratory, modular and indepen- dent tasks) that required the work of students with the course; • little informative, unstructured training materials • qualitatively presented theoretical materials and methodical recommendations, which were actively used by students; • educational resources that were systematically used during the semester. To increase the efficiency of the use of ELC in higher education, a number of steps can be taken to use statistical and analytical tools Moodle (figure 6). The first step should be to rank the courses by activity per 1 user (weighted indicator). For all courses that are actively used, the second step is performed – statistics of general activity in e-courses and analytics of resource use in e-courses. The third step is to form conclusions and recommendations. 232 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 Figure 5: Analysis of e-courses on the use of resources. Figure 6: Scheme of using statistical and analytical tools Moodle to increase the efficiency of ELC. Identifying e-courses that are insufficiently used in the educational process, provides an opportunity to intensify work with teachers to improve their skills with information support, to create e-courses, the use of e-resources in the educational process. The e-resources found not to be used by students in the learning process should be reviewed according to scientific peer review criteria. Built-in and additional CLMS Moodle tools allow you to analyze the effectiveness of e-courses in general and in terms of different types of resources and, based on this analysis, to form general recommendations for course teachers to improve the use of e-courses in education. 233 https://doi.org/10.55056/cte.558 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 4. Conclusions and the research perspective The use of statistical and analytical tools in CLMS Moodle to determine the effectiveness of the use of e-courses contributes to the quality of the educational process, in particular blended and distance learning. By measuring weighted course user activity, overall activity within the course and analyzing the use of course resources, it is possible to identify the reasons for the inefficient use of e-courses in the educational process. Since the study was carried out on the basis of two higher education institutions, we can assert general trends on the problems of using e-courses in blended and distance learning. In the future, we see the need to develop a model that provides automated determination of levels of effectiveness of e-courses, e-course resources, identification of factors that affect the effectiveness of the use of courses, and specific resources. References [1] Basaran, S. and Mohammed, R.K.H., 2020. Usability Evaluation of Open Source Learning Management Systems. International Journal of Advanced Computer Science and Applications, 11(6), pp.400–410. Available from: https://doi.org/10.14569/IJACSA.2020.0110652. [2] Biasutti, M., 2017. A comparative analysis of forums and wikis as tools for online col- laborative learning. Computers & Education, 111, pp.158–171. Available from: https: //doi.org/10.1016/j.compedu.2017.04.006. [3] Brown, M., McCormack, M., Reeves, J., Brooks, D.C., , Grajek, S., Alexander, B., Bali, M., Bulger, S., Dark, S., Engelbert, N., Gannon, K., Gauthier, A., Gibson, D., Gibson, R., Lundin, B., Veletsianos, G. and Weber, N., 2020. The 2020 EDUCAUSE Horizon Report: Teaching and Learning Edition. Louisville, CO: EDUCAUSE. Available from: https://library.educause. edu/-/media/files/library/2020/3/2020_horizon_report_pdf.pdf. [4] Deveci Topal, A., 2016. Examination of University Students’ Level of Satisfaction and Readi- ness for E-Courses and the Relationship between Them. European Journal of Contemporary Education, 15(1), pp.7–23. Available from: https://doi.org/10.13187/ejced.2016.15.7. [5] Edelhauser, E. and Lupu-Dima, L., 2020. Is Romania Prepared for eLearning during the COVID-19 Pandemic? Sustainability, 12(13). Available from: https://doi.org/10.3390/ su12135438. [6] García-Murillo, G., Novoa-Hernández, P. and Rodríguez, R.S., 2020. Technological Satisfac- tion About Moodle in Higher Education—A Meta-Analysis. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, 15(4), pp.281–290. Available from: https://doi.org/10.1109/ RITA.2020.3033201. [7] Glazunova, O.G. and Shyshkina, M., 2018. The Concept, Principles of Design and Im- plementation of the University Cloud-based Learning and Research Environment. In: V. Ermolayev, M.C. Suárez-Figueroa, V. Yakovyna, V.S. Kharchenko, V. Kobets, H. Kravtsov, V.S. Peschanenko, Y. Prytula, M.S. Nikitchenko and A. Spivakovsky, eds. Proceedings of the 14th International Conference on ICT in Education, Research and Industrial Applications. Inte- gration, Harmonization and Knowledge Transfer. Volume II: Workshops, Kyiv, Ukraine, May 234 https://doi.org/10.55056/cte.558 https://doi.org/10.14569/IJACSA.2020.0110652 https://doi.org/10.1016/j.compedu.2017.04.006 https://doi.org/10.1016/j.compedu.2017.04.006 https://library.educause.edu/-/media/files/library/2020/3/2020_horizon_report_pdf.pdf https://library.educause.edu/-/media/files/library/2020/3/2020_horizon_report_pdf.pdf https://doi.org/10.13187/ejced.2016.15.7 https://doi.org/10.3390/su12135438 https://doi.org/10.3390/su12135438 https://doi.org/10.1109/RITA.2020.3033201 https://doi.org/10.1109/RITA.2020.3033201 CTE Workshop Proceedings, 2023, Vol. 10: CITEd-2022, pp. 225-235 https://doi.org/10.55056/cte.558 14-17, 2018. CEUR-WS.org, CEUR Workshop Proceedings, vol. 2104, pp.332–347. Available from: https://ceur-ws.org/Vol-2104/paper_158.pdf. [8] Iyer, S.S., Gernal, L., Subramanian, R. and Mehrotra, A., 2023. Impact of digital disruption influencing business continuity in UAE higher education. Educational Technology Quarterly, 2023(1), p.18–57. Available from: https://doi.org/10.55056/etq.29. [9] Kadoić, N. and Oreški, D., 2018. Analysis of student behavior and success based on logs in Moodle. 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). pp.0654–0659. Available from: https: //doi.org/10.23919/MIPRO.2018.8400123. [10] Kraleva, R., Sabani, M. and Kralev, V., 2019. An Analysis of Some Learning Management Systems. International Journal on Advanced Science, Engineering and Information Technology, 9(4), pp.1190–1198. Available from: https://doi.org/10.18517/ijaseit.9.4.9437. [11] Mildenberger, P., Brüggemann, K., Rösner, F., Koch, K. and Ahlers, C., 2011. PACS infras- tructure supporting e-learning. European Journal of Radiology, 78(2), pp.234–238. From PACS to the clouds. Available from: https://doi.org/10.1016/j.ejrad.2010.05.006. [12] Morze, N.V., Kuzminska, O. and Protsenko, G., 2013. Public Information Environment of a Modern University. In: V. Ermolayev, H.C. Mayr, M.S. Nikitchenko, A. Spivakovsky, G. Zholtkevych, M. Zavileysky, H. Kravtsov, V. Kobets and V.S. Peschanenko, eds. Pro- ceedings of the 9th International Conference on ICT in Education, Research and Industrial Applications: Integration, Harmonization and Knowledge Transfer, Kherson, Ukraine, June 19-22, 2013. CEUR-WS.org, CEUR Workshop Proceedings, vol. 1000, pp.264–272. Available from: https://ceur-ws.org/Vol-1000/ICTERI-2013-p-264-272.pdf. [13] Ochoa-Orihuel, J., Marticorena-Sánchez, R. and Sáiz-Manzanares, M.C., 2020. Moodle LMS Integration with Amazon Alexa: A Practical Experience. Applied Sciences, 10(19). Available from: https://doi.org/10.3390/app10196859. [14] Oguguo, B.C.E., Nannim, F.A., Agah, J.J., Ugwuanyi, C.S., Ene, C.U. and Nzeadibe, A.C., 2021. Effect of learning management system on student’s performance in educational measurement and evaluation. Education and Information Technologies, 26(2), pp.1471–1483. Available from: https://doi.org/10.1007/s10639-020-10318-w. [15] Pinchuk, N., Pinchuk, O., Bondarchuk, O., Balakhtar, V., Balakhtar, K., Onopriienko- Kapustina, N., Shyshkina, M. and Kuzminska, O., 2022. Personal indicators of occupational stress of employees working remotely in a pandemic quarantine. Educational Technology Quarterly, 2022(2), p.129–142. Available from: https://doi.org/10.55056/etq.8. [16] Silva, J.C.S., Zambom, E., Rodrigues, R.L., Ramos, J.L.C. and Fonseca de Souza, F. da, 2018. Effects of Learning Analytics on Students’ Self-Regulated Learning in Flipped Classroom. International Journal of Information and Communication Technology Education, 14(3). Available from: https://doi.org/10.4018/IJICTE.2018070108. 235 https://doi.org/10.55056/cte.558 https://ceur-ws.org/Vol-2104/paper_158.pdf https://doi.org/10.55056/etq.29 https://doi.org/10.23919/MIPRO.2018.8400123 https://doi.org/10.23919/MIPRO.2018.8400123 https://doi.org/10.18517/ijaseit.9.4.9437 https://doi.org/10.1016/j.ejrad.2010.05.006 https://ceur-ws.org/Vol-1000/ICTERI-2013-p-264-272.pdf https://doi.org/10.3390/app10196859 https://doi.org/10.1007/s10639-020-10318-w https://doi.org/10.55056/etq.8 https://doi.org/10.4018/IJICTE.2018070108 1 Introduction 2 Methods and study materials 2.1 Features of the module ``Comparison of courses'' 2.2 Features of the “Statistics” module 2.3 Possibilities of the ``Analytics'' module 3 Main findings 4 Conclusions and the research perspective