Designing a rating system based on competencies for the analysis of the university teachers' research activities CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 Designing a rating system based on competencies for the analysis of the university teachers’ research activities Nataliia V. Morze, Oksana P. Buinytska and Valeriia A. Smirnova Borys Grinchenko Kyiv University, 18/2 Bulvarno-Kudriavska Str., Kyiv, 04053, Ukraine Abstract. One of the indicators of the influence and competitiveness of university is participation in international and local rankings. In the methodologies of the most authoritative rankings, the quality and transparency of Universities is assessed by indicators of the university teachers’ publishing activity. The article analyzes the experience of designing systems that analyses university teachers research activities, tools and components of evaluating the effectiveness of research, designed a structural and functional model of rating system for the analysis the university teachers’ research activities taking into account research and digital competencies. The developed model provides performance of the basic functions and allows for systematic monitoring of openness, transparency, efficiency of the research component of university teachers’ professional activity. The model was based on key indicators for evaluating the effectiveness of research – citation indicators of the three most important scientometric databases – Scopus, Web of Science, Google Scholar. The connection between the indicators presented in the model forms a portrait of the university teachers’ scientific activity, gives an overall assessment of productivity, influence and contribution to the research direction of the university as a whole. The article describes 1 stage of implementation of the presented model by developing a “Rating of Transparency of Structural Units”, the effectiveness of experimental ranking. The study has established the positive impact of the implementation of the rating system, identified the main activities to increase the visibility, presence, dissemination of research results, the systematic implementation of which contributes to the optimal representation of the scientist in the rating evaluation of the research component of the university teachers professional activities, improving the digital competence of teachers and positively affects the quality indicators of the university scientific work in local and international rankings, as the existence of the system and the formation of ratings is an incentive for university teachers to present and disseminate their own publishing activities in the international online scientific community. Keywords: publication activity, scientist profile, scientometric databases, rating system, research activity, research competence, digital competence 1. Introduction The main priority of each university is to provide quality educational services, increase compet- itiveness in the educational market and to attract the most promising students. Participation in international and domestic rankings is an important tool for measuring the competitive- " n.morze@kubg.edu.ua (N. V. Morze); o.buinytska@kubg.edu.ua (O. P. Buinytska); v.smirnova@kubg.edu.ua (V. A. Smirnova) ~ http://eportfolio.kubg.edu.ua/teacher/152 (N. V. Morze); http://eportfolio.kubg.edu.ua/teacher/21 (O. P. Buinytska); http://eportfolio.kubg.edu.ua/teacher/222 (V. A. Smirnova) � 0000-0003-3477-9254 (N. V. Morze); 0000-0002-3611-2114 (O. P. Buinytska); 0000-0001-9965-6373 (V. A. Smirnova) CTE Workshop Proceedings © Copyright for this paper by its authors, published by Academy of Cognitive and Natural Sciences (ACNS). This is an Open Access article distributed under the terms of the Creative Commons License Attribution 4.0 International (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 139 mailto:n.morze@kubg.edu.ua mailto:o.buinytska@kubg.edu.ua mailto:v.smirnova@kubg.edu.ua http://eportfolio.kubg.edu.ua/teacher/152 http://eportfolio.kubg.edu.ua/teacher/21 http://eportfolio.kubg.edu.ua/teacher/222 https://orcid.org/0000-0003-3477-9254 https://orcid.org/0000-0002-3611-2114 https://orcid.org/0000-0001-9965-6373 https://acnsci.org/cte https://creativecommons.org/licenses/by/4.0 https://acnsci.org CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 ness of Universities. In the methodologies of the most authoritative rankings, the quality and transparency of Universities are assessed by indicators of publishing activity of researchers. Indicators of the scientific citations’ quality according to Google Scholar Citations and citations in influential scientific journals are taken into account in international rankings – “Academic ranking of world universities” (ARWU), “QS Top University Ranking”, webometric ranking of world universities “Webometrics”, “Transparent ranking: Top Universities by Google Scholar Citations” and Ukrainian – “University ranking by Scopus indicators”, “Top-200 Ukraine”, “Con- solidated rating of higher education institutions of Ukraine”, “Bibliometrics of Ukrainian science” [2]. To ensure optimal representation of the university in international and Ukrainian rankings, it is necessary to develop and implement a rating system for the analysis the research activi- ties of university teachers to monitor and qualitatively analyze the effectiveness of research activities of university teachers and timely develop systemic measures to increase openness, transparency results of research activities, wide dissemination in the international scientific network communities for popularization and collaboration. The purpose of the study is to build a structural and functional model of a rating system for the analysis the research component of university teachers’ activities based on key indicators of research and digital competencies. 2. Research of the experience of the analysis of research activity of the university teachers in the European space of higher education Bykov and Spirin [3], Bykov et al. [4], Delgado López-Cózar, Orduña-Malea and Martín-Martín [7], Martín-Martín et al. [14], Semerikov et al. [20], Vakarenko [24] studied the features of the analysis of research results using open scientometric and bibliometric systems. Theoretical bases of rating assessment of teachers’ activity of the Ukrainian Universities were studied by Dzoba [8], Reheilo [19], Yaroshenko [25]. Yaroshenko [25] emphasized the need to modernize indicators of the teachers’ research activities, in accordance with the modern realities of university education, summarizes the main characteristics of the rating assessment of the teachers: purpose, objectives, functions and ranking principles. Reheilo [19] considered the main conceptual principles of evaluating the effectiveness of the teachers’ research activities, analyzed the principles, structural components and indicators of evaluation of the teachers’ scientific activities in the European higher education area. Issues of assessing the quality of research results were studied by Gasparyan et al. [9], Kostenko, Symonenko and Zhabin [11], Shynenko, Kilchenko and Tukalo [21]. Hohunskyi et al. [10] determined that the use of profiles by scientists in Google Scholar, ORCID, Mendeley, Academia, ResearchGate increases the visibility of publications in the infor- mation space and has a positive effect on increasing citation rates. In [11] the information-analytical system “Bibliometrics of the Ukrainian Science”, developed by Social communication research center, which is the register of bibliometric profiles of researchers and research teams in the most authoritative scientometric databases, as Scopus, Web of Science and Google Scholar. The system allows to analyze the local scientific potential, to carry out a comparative analysis of the effectiveness of Ukrainian scientists in the fields of 140 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 science, cities, affiliation, agencies, etc. by constructing rating tables on the value of h-indices in Scopus, Web of Science or Google Scholar databases [1]. Open profiles of a scientist in scientometric databases are a passport of a scientist in the European space of higher education, which reflects his authority and influence on the development of a particular field. Spivakovsky et al. [23] describes the experience of designing an information system to analyze the research activities of university teachers, tested on the basis of Kherson State University and Kherson State Maritime Academy. The system implements tools for constructing teachers’ ratings by the main indicators of scientific citation in the databases Scopus, Web of Science, Google Scholar, Semantic Scholar, Tutor Network. Ratings are built in the context of structural units, departments and scientific journals. The rating of departments is based on the maximum value of citation profiles of all employees in the department in these databases [18]. The project Open Ukrainian Citation Index (OUCI), developed by the State Scientific and Technical Library of Ukraine, was studied by Nazarovets [16]. OUCI is a search engine and database of scientific citations that contains meta-data of all publications that use Cited-by service from Crossref and support the Initiative for Open Citations. The OUCI database con- tains metadata of scientific publications that receive DOI from Crossref and takes into account citations between publications. OUCI is designed to simplify the search and analysis of research results and expand the presentation and visibility of Ukrainian scientific publications in inter- national search engines, such as Dimensions, Lens.org, 1findr, Scilit, etc [17]. The implemented analytical tool allows to assess the state and dynamics of the development of scientific potential in terms of fields of knowledge, years, to select the appropriate scientific journal for publication. A common practice among universities is the implementation of rating systems to assess the professional activity of university teachers, as part of the system of quality assurance in education, one of the areas of which is research. Borys Grinchenko Kyiv University has introduced the “E-portfolio” system, which reflects the detailed picture of the teacher’s activity with certain quantitative and qualitative indicators of activity. The system allows not only to create an e-portfolio of the teacher, but also to form rating tables of indicators for assessing the main activities of each university teacher [15]. Borys Grinchenko Kyiv University has introduced the Corporate Standard of Research Activity of Employees and the Corporate Standard of Digital Competence of Teachers, which present and correlate the performance indicators of university teachers’ research activity and their corresponding indicators of the levels of formation of teachers’ digital competence (figure 1). One of the indicators of university teacher’s compliance with the Corporate Standard of Research Activities of the staff of Borys Grinchenko Kyiv University [6] is the indicator of scientific recognition, which is determined by the values of citation indices in the scientometric databases Scopus, Web of Science, Google Scholar. The key to optimal presentation of research results in scientometric databases is a sufficient level of digital competence, which lies in the ability to effectively use open digital systems in own research, create, update, supplement the articles of the scientist profile in scientometric databases, distribute research results in scientific web-communities and social networks [5] (table 1). Analyzing the experience of developing rating systems for the analysis the activities of uni- versity teachers, it was determined that the most common quantitative indicators of evaluation of research activities are publications in journals included in influential scientometric databases; values of citation indices in scientometric databases – Scopus, Web of Science, Google Scholar, 141 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 Figure 1: Correlation of indicators of the Corporate Standard of Research Activity and the Corporate Standard of Digital Competence of the staff of Borys Grinchenko Kyiv University. Table 1 Comparative table of indicators of the Corporate Standard of Research Activity and the Corporate Standard of Digital Competence of the staff of Borys Grinchenko Kyiv University. Corporate Standard of Research Activity Corporate Standard of Digital Competence Scientific recognition: Scientometric indicators from databases Scopus, Web of Science and Google Scholar • h-index • i10-index • Number of citations • Number of publications • Actualization of scientist profiles in scien- tometric databases; • Dissemination of research results; • Systematic use of digital tools in conduct- ing and disseminating research results. etc. [15]. 3. Tools for determining the publishing activity of the university teachers The most common tools for assessing the publishing activity of the university teachers are the determination of citation indices in scientometric databases. Scopus and Web of Science databases allow scientometric analysis of a scientist’s productivity by analyzing the dynamics of 142 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 the number of publications in influential international publications, the influence and demand of scientific work, analyzing the dynamics of bibliographic references and citation indices by years [22]. Scopus and Web of Science have powerful analytical tools SciVal and InCites. The tools allow for a comprehensive analysis of the effectiveness of research on a wide range of indicators: impact, productivity, collaboration, open access, the impact of journals, etc. in a visualized form; identify promising areas of research, expand the range of scientific collaboration and cooperation. An alternative to commercial systems is the free Google Scholar system, which indexes full-text scientific publications from many disciplines in various databases. The main advantage of Google Scholar is its freeness and the fact that its index is not limited to a certain list of journals, unlike commercial scientometric databases like Scopus, Web of Science, but more broadly covers the web space, it indexes publications on sites electronic journals, repositories, electronic conferences, personal blogs of scientists, etc. For efficient indexing, web resources must be based on platforms with special meta tags (EPrints, DSpace, Open Conference System) [12], from which the Google Scholar system receives basic publication metadata or publication files designed according to certain requirements for document formatting, design of titles, personal data of the authors, the main content of the article, the list of sources used, etc [3]. The Google Scholar system allows researcher to create a personal profile and add system-indexed publications to it. The Google Scholar researcher’s profile has tools for analyzing statistics on citations of publications by year, allows you to track the total number of citations, h-index and i10-index, which are calculated based on the total number of publications and the number citations of individual indicators for the entire period of scientific work and for the last 5 years in digital form and in the form of a comparative histogram [22]. A comparison of the available indicators for evaluating the effectiveness of the researcher’s research activities in the profiles of the most common scientometric databases is given in table 2. Table 2 Comparative table of scientometric indicators in the scientists’ profiles. Scopus Scival Web of Science Publons InCites Google Scholar ResearchGate Number of publications + + + + + - + Citation + + + + + + + h-index + + + + + + + i10-index - - - - - + - Average citation value - - + - + - - Altmetric indicators (recommenda- tions, readings) + - + - - - + Without self-citation + + + - + - + Visualization + + + + + + - Analysis of indicators + + + + + + + Reports + + + - + - - Making connections + + + + + + + 143 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 The analysis of indicators confirms that for a full-fledged comprehensive assessment of the effectiveness of research in various areas it is necessary to use a set of indicators of important scientometric databases. 4. Research results 4.1. Structural and functional model of the rating system for the analysis the research activity of the university teachers The most important scientometric databases that demonstrate the effectiveness of the university teachers’ research activity are Scopus, Web of Science and Google Scholar, in which the values of bibliographic citation are used as quantitative indicators of evaluation and analysis. At the same time, it is important for university teachers to comply with the Corporate Standard of Research Activity and the Corporate Standard of Digital Competence, as the level of research and digital competence directly affects the quality of research and therefore the university’s ranking in international and local rankings. That is why the basis of the model of the rating system for the analysis the research activity of the university teachers are these three scientometric databases. The main principles in developing the methodology of the rating system for the analysis the research activity of the university teachers were objectivity, measurability and transparency. That is why as indicators of the effectiveness of university teachers’ research activities were selected indicators of citing scientific publications in open teachers’ profiles in Scopus, Web of Science and Google Scholar that is easy to get and check – the number of bibliographic references, the h-index and i10-index. The rating system for the analysis the research activity of the university teachers performs the following functions: • informational – the formation of a single information base of indicators of research effectiveness of university teachers for quality assessment; • visualization – presentation of information in a visualized form to improve perception, reporting; • motivational – the formation of an atmosphere of healthy competition, activation of the scientific potential of the university; • competence – encouraging teachers to create, update, actualization information in their own profiles in scientometric databases; • analytical – analysis of the current state of the research component of the departments and the university as a whole, identification of factors influencing the effectiveness of teachers’ research activities, identification and analysis of relationships; • prognostic – forecasting of perspective trajectories of the university development, system measures development for increasing the indicators of efficiency of the university teachers’ research activity; • managerial – information basis for making managerial decisions. The implementation of certain functions is possible in the presence of the following structural components of the rating system for the analysis the research activity of the university teachers. 144 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 The administrative component provides for the delimitation of access rights to the rating system – administrator, teacher, guest. Administrator rights include the start of rating formation, marking of incorrectly filled profiles, export of reports. The rating is available to university teachers and unauthorized users only for review and analysis. Organizational component. For each lecturer of the Borys Grinchenko Kyiv University, a profile in the “E-portfolio” system is automatically generated, from which data on affiliation and scientific citation are obtained. The technological component (figure 2) includes obtaining scientometric indicators from Scopus databases, Web of Science and the Google Scholar system and teachers’ personal data. The “E-portfolio” system of the Borys Grinchenko Kyiv University automatically synchronizes the values of bibliographic references, h-index and i10-index for the last 5 years from the bibliographic profile of the scientist in the Google Scholar system, a link to which the teacher can add to his portfolio. Scientometric indicators from the Scopus and Web of Science profiles are entered the “Database of activity registers”, the data from which are automatically synchronized in the teachers’ profile in the “E-portfolio” system. The relationship between the systems is imple- mented through APIs. The values of scientometric indicators from the Scopus, Web of Science and Google Scholar databases available in the profile are obtained during the formation of the “Rating of Transparency of Structural Units”, which is one of the results of the designed model. Effective component – based on the collected data on the affiliation and scientometric indica- tors of teachers are formed rating tables of research effectiveness of the university as a whole and in terms of departments and departments, based on which the ability to export reports. Communication of all components is provided in the Borys Grinchenko Kyiv University Digital Campus. Thus, the structural and functional model of the rating system system based on competencies for the analysis the research activity of the University teachers will have the following form (figure 3): 4.2. Development of a transparency rating and methodology for its construction Based on the presented model, a rating was developed, which is one of the indicators of system performance. As a result of experimental implementation, a “Rating of Transparency of Structural Units” by citation indicators in Google Scholar was developed, which ranks teachers according to their indicators of publishing activity (figure 4). The proposed model of the rating system was implemented as a web-oriented client-server architecture. PHP programming language using the MVC architectural model was used in the development of the server software. The web user interface is implemented using HTML, CSS and JavaScript. The average citation rate per university teacher was determined in order to build the ranking of the structural units, as this approach reflects the contribution of each individual teacher to the scientific achievement of the structural unit and the performance of the research team as a whole. The ranking of structural units and chairs in the “Rating of Transparency of Structural Units” is carried out in descending order of the value of the average citation rate per 1 university 145 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 Figure 2: Technological component of the structural-functional model of the rating system for the analysis the research activity of the university teachers. teacher. In the case of the same average citation rates, the structural units and chairs are sorted in descending order of the total number of citations of teacher profiles. The choice of the Google Scholar system is due to the fact that, unlike the scientometric databases Scopus and Web of Science, it has a wider coverage and includes publications from these databases and has a high level of correlation in citation values with Scopus, Web of Science, which confirmed by the results of research [13, 14], which provides a greater presence of University teachers in the ranking. In the context of chairs, a list of teachers is displayed, ranked in descending order of the value of the total number of bibliographic references according to the Google Scholar (figure 5). The detailed table of research performance indicators contains the values of the total number of bibliographic references, h-index, i10-index and the link to the profile in the Google Scholar. Creating a database of scientific profiles of researchers in Google Scholar allowed to implement 146 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 Figure 3: Structural and functional model of the rating system based on competencies for the analysis the research activity of the university teachers. the designation of incorrectly configured profiles in one place. For further analysis of rating positions and indicators of the university teachers’ research activities, construction of visualized reports on the effectiveness of research activities, it is planned to implement the 2nd stage of research – expanding the rating for other indicators presented in the model – the number of publications and citation indices in Scopus and Web of Science databases, establishing relationships to increase the university teachers’ publishing activity. 147 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 Figure 4: “Rating of Transparency of Structural Units” by citation indicators in Google Scholar. Figure 5: Ranking of the university teachers by citation indicators in Google Scholar. 4.3. Influence of the rating indicators on the improvement of the university teachers’ research activity The research took place in several stages: preparatory, design, experimental (implementation). At the preparatory level, the theoretical foundations of rating of evaluation the university teachers’ activity were investigated. At the design stage, a structural and functional model of the rating system for the analysis the research activity of the university teachers was designed, “Rating of Transparency of Structural Units” by citation indicators in Google Scholar was developed and a preliminary rating was built. For two months, the administration and university 148 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 teachers had the opportunity to review and analyze the data of the previous rating, after which an experimental rating was built. The analysis of preliminary and experimental ratings (figures 6, 7), built with an interval of 2 months, confirmed the positive dynamics of research performance. The availability of the sys- tem and the formation of ratings is an incentive for teachers to update their e-portfolio profiles, create profiles in scientometric databases, in the absence, update information in scientometric profiles, including Google Scholar, supplement indexed publications, dissemination of research results, their discussion in the international online scientific community, thus developing skills in using digital technologies in organizing research and disseminating results. Figure 6: Google Scholar citation rates in preliminary and experimental ratings. According to the results of the study, it was found that the optimal presentation of the results of university teachers’ research activities in ranking is facilitated by: • implementation of open access, transparency, openness of research results; • preference for publications, assigning articles a unique DOI identifier, which facilitates publication identification and provides a permanent publication link, regardless of changes in the publication web address; • creating profiles and periodically adding new scientific developments to scientometric and bibliometric databases such as Google Scholar, ResearchGate, Mendeley, and the like; • use of ORCID scientist identifier to correctly identify the affiliation of the article to the author’s profile; • implementation of dissemination activities to increase visibility and presence in the international online scientific community. Currently, work is underway to refine and expand the rating for other indicators of Scopus, Web of Science, presented in the model to obtain a full rating system; systems of analytics and statistics with the formation of dynamic visualization of the effectiveness of the scientific potential of the university. 149 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 Figure 7: Diagram of indicators of preliminary and experimental ratings. 5. Conclusions For optimal presentation of the university’s activity in international and Ukrainian rankings, ensuring the competitiveness of the university, it is important to systematically monitor the openness, transparency of the effectiveness of the university teachers’ research activities. An effective tool for monitoring is the development and implementation of a rating system for research analysis. The system is based on the three most important scientometric databases – Scopus, Web of Science, Google Scholar and provides the main functions – information, visualization, motivation, competence, analytical, prognostic and managerial. The rating system is implemented as a web-oriented client-server architecture. One of the components implemented in the system at the 1st stage of the study is “Rating of Transparency of Structural Units” by citation indicators in Google Scholar. According to the results of the study, recommendations were developed to improve the quality of research activities. The formation of the ranking has confirmed the importance of designing a system to analyze research activities, improve the quality of scientific research, disseminate research results in the international educational space, to analyze teachers’ own professional development, monitor the scientific growth of university teaching staff and obtain visualized analyses in real time. The prospects for further research is considered in the adding other research activity indicators to the ranking, realisation of real-time updates to the rating system, integration of modern business intelligence systems to build visualised statistics to analyse the effectiveness of the research component of the university’s activities. The systematic implementation of measures to ensure open access to own research results, to increase the visibility, transparency and dissemination of the results of research activities in the Internet space contributes to the optimal representation of the scientist’s activities in the 150 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 rating evaluation of the research component of the professional activities of university teachers, improving the professional competence of teachers and positively influencing on the indicators of quality of university’s scientific work in local and international rankings. References [1] Bibliometrics of Ukrainian science, 2022. Available from: http://nbuviap.gov.ua/bpnu/. [2] Buinytska, O., Hrytseliak, B. and Smirnova, V., 2018. Rating as assessment tool of quality and competitiveness of university. Open educational e-environment of modern university, 4, pp.16–32. Available from: https://doi.org/10.28925/2414-0325.2018.1632. [3] Bykov, V. and Spirin, O., 2016. Information and analytical support of scientific and pedagogical research based on electronic bibliometric systems. Reporting scientific-practical conference of the institute of information technologies and learning tools of the national academy of pedagogical sciences of ukraine. pp.1–3. Available from: https://lib.iitta.gov.ua/ 106914/. [4] Bykov, V., Spirin, O., Biloshchytskyi, A., Kuchansky, O., Dikhtiarenko, O. and Novytskyi, O., 2020. Open digital systems for assessment of pedagogical research results. Information technologies and learning tools, 75(1), p.294–315. Available from: https://doi.org/10.33407/ itlt.v75i1.3589. [5] Corporate Standard of Digital Competence of Teachers of Borys Grinchenko Kyiv Univer- sity, 2021. Available from: https://kubg.edu.ua/images/stories/Departaments/vdd/nakaz_ _421_11.06.21.pdf. [6] Corporate Standard of Research Activity of the staff of Borys Grinchenko Kyiv University, 2018. Available from: https://kubg.edu.ua/images/stories/Departaments/vdd/documenty/ rozdil_8/nakaz_212_02.04.2018.pdf. [7] Delgado López-Cózar, E., Orduña-Malea, E. and Martín-Martín, A., 2019. Google scholar as a data source for research assessment. In: W. Glänzel, H.F. Moed, U. Schmoch and M. Thel- wall, eds. Springer handbook of science and technology indicators. Cham: Springer Interna- tional Publishing, pp.95–127. Available from: https://doi.org/10.1007/978-3-030-02511-3_4. [8] Dzoba, O.H., 2019. Rating assessment of scientific and pedagogical workers: theoretical and methodical aspects within a market approach. Scientific bulletin of ivano-frankivsk national technical university of oil and gas (series: Economics and management in the oil and gas industry), 1(19), p.84–95. Available from: https://doi.org/10.31471/2409-0948-2019-1(19) -84-95. [9] Gasparyan, A.Y., Yessirkepov, M., Duisenova, A., Trukhachev, V.I., Kostyukova, E.I. and Kitas, G.D., 2018. Researcher and author impact metrics: Variety, value, and context. Journal of korean medical science, 33, p.e139. Available from: https://doi.org/10.3346/jkms. 2018.33.e139. [10] Hohunskyi, V.D., Yakovenko, V.O., Liashchenko, T.O. and Otradska, T.V., 2016. General mechanisms of citation system of scientific articles. Bulletin of ntu "khpi, 1173, p.14–18. Available from: http://dspace.opu.ua/jspui/handle/123456789/1774. [11] Kostenko, L., Symonenko, T. and Zhabin, O., 2019. Project "Bibliometrics of Ukrainian science": idea, realization, plans. Bulletin of the book chamber, 5, pp.30–33. 151 http://nbuviap.gov.ua/bpnu/ https://doi.org/10.28925/2414-0325.2018.1632 https://lib.iitta.gov.ua/106914/ https://lib.iitta.gov.ua/106914/ https://doi.org/10.33407/itlt.v75i1.3589 https://doi.org/10.33407/itlt.v75i1.3589 https://kubg.edu.ua/images/stories/Departaments/vdd/nakaz__421_11.06.21.pdf https://kubg.edu.ua/images/stories/Departaments/vdd/nakaz__421_11.06.21.pdf https://kubg.edu.ua/images/stories/Departaments/vdd/documenty/rozdil_8/nakaz_212_02.04.2018.pdf https://kubg.edu.ua/images/stories/Departaments/vdd/documenty/rozdil_8/nakaz_212_02.04.2018.pdf https://doi.org/10.1007/978-3-030-02511-3_4 https://doi.org/10.31471/2409-0948-2019-1(19)-84-95 https://doi.org/10.31471/2409-0948-2019-1(19)-84-95 https://doi.org/10.3346/jkms.2018.33.e139 https://doi.org/10.3346/jkms.2018.33.e139 http://dspace.opu.ua/jspui/handle/123456789/1774 CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 [12] Luparenko, L., 2020. The use of electronic open journal systems in scientific and pedagogic research: Results of experiment. Ceur workshop proceedings, 2732, pp.1113–1128. Available from: http://ceur-ws.org/Vol-2732/20201113.pdf. [13] Martín-Martín, A., Orduna-Malea, E. and Delgado López-Cózar, E., 2018. Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison. Scientometrics, 116(3), pp.2175–2188. Available from: https://doi.org/10.1007/ s11192-018-2820-9. [14] Martín-Martín, A., Orduna-Malea, E., Thelwall, M. and Delgado López-Cózar, E., 2018. Google scholar, web of science, and scopus: A systematic comparison of citations in 252 subject categories. Journal of informetrics, 12(4), pp.1160–1177. Available from: https://doi.org/10.1016/j.joi.2018.09.002. [15] Morze, N. and Buinytska, O., 2017. Rating indicators system of evaluation teacher’s activities in modern universities. Scientific journal of national pedagogical dragomanov university, 26(19), pp.34–44. Available from: http://enpuir.npu.edu.ua/handle/123456789/ 19082. [16] Nazarovets, S., 2019. Open Ukrainian Citation Index (OUCI) project: idea, working principle and development prospects. Intellectual property in ukraine, 3, pp.10–13. Available from: http://eprints.rclis.org/34365/. [17] Open Ukrainian Citation Index, 2022. Available from: https://ouci.dntb.gov.ua/. [18] Rating of departments of Kherson State University, 2021. Available from: http://publication. kspu.edu/rating/departments/. [19] Reheilo, I., 2020. Theoretical bases of estimation and development of scientific and ped- agogical workers of universities in the context of realization of scientific activity. In: Y. Skyba, ed. Theoretical bases of development of scientific and pedagogical potential of universities of ukraine in the context of expansion of institutional autonomy: preprint (an- alytical materials) (part i). Kyiv: IVO NAPS of Ukraine, pp.72–103. Available from: https://doi.org/10.31874/978-617-7486-40-3-2020. [20] Semerikov, S.O., Pototskyi, V.S., Slovak, K.I., Hryshchenko, S.M. and Kiv, A.E., 2018. Automation of the export data from Open Journal Systems to the Russian Science Citation Index. Ceur workshop proceedings, 2257, pp.215–226. Available from: http://ceur-ws.org/ Vol-2257/paper21.pdf. [21] Shynenko, M.A., Kilchenko, A.V. and Tukalo, S.M., 2021. Application of scientific metric indicators to evaluate the performance of scientific and pedagogical research. Reporting scientific-practical conference of the institute of information technologies and learning tools of the national academy of pedagogical sciences of ukraine. Kyiv, Ukraine, pp.89–93. [22] Smirnova, V., 2020. Research on open digital information systems for analysis of re- search activity results of higher education institutions academic staff. Open educational e-environment of modern university, 9, pp.134–144. Available from: https://doi.org/10. 28925/2414-0325.2020.9.11. [23] Spivakovsky, A., Vinnyk, M., Poltoratskiy, M., Tarasich, Y., Spivakovska, Y., Gardner, G. and Panova, K., 2019. Information system of scientific activity indicators of scientific organizations: Development status and prospects. Ceur workshop proceedings, 2393, pp.220– 228. Available from: http://ceur-ws.org/Vol-2393/paper_260.pdf. [24] Vakarenko, O., 2018. Scientometric databases: from system of obtaining information to 152 http://ceur-ws.org/Vol-2732/20201113.pdf https://doi.org/10.1007/s11192-018-2820-9 https://doi.org/10.1007/s11192-018-2820-9 https://doi.org/10.1016/j.joi.2018.09.002 http://enpuir.npu.edu.ua/handle/123456789/19082 http://enpuir.npu.edu.ua/handle/123456789/19082 http://eprints.rclis.org/34365/ https://ouci.dntb.gov.ua/ http://publication.kspu.edu/rating/departments/ http://publication.kspu.edu/rating/departments/ https://doi.org/10.31874/978-617-7486-40-3-2020 http://ceur-ws.org/Vol-2257/paper21.pdf http://ceur-ws.org/Vol-2257/paper21.pdf https://doi.org/10.28925/2414-0325.2020.9.11 https://doi.org/10.28925/2414-0325.2020.9.11 http://ceur-ws.org/Vol-2393/paper_260.pdf CTE Workshop Proceedings, 2022, Vol. 9: CTE-2021, pp. 139-153 instrument for evaluating scientific research. Science of ukraine in the world information space, 15, pp.9–15. Available from: https://doi.org/10.15407/akademperiodyka.372.009. [25] Yaroshenko, O., 2020. Theoretical bases of rating as a tool for evaluating the activities of scientific and pedagogical staff of ukrainian universities. In: Y. Skyba, ed. Theoretical bases of development of scientific and pedagogical potential of universities of ukraine in the context of expansion of institutional autonomy: preprint (analytical materials) (part i). Kyiv: IVO NAPS of Ukraine, pp.57—-71. Available from: https://doi.org/10.31874/978-617-7486-40-3-2020. 153 https://doi.org/10.15407/akademperiodyka.372.009 https://doi.org/10.31874/978-617-7486-40-3-2020 1 Introduction 2 Research of the experience of the analysis of research activity of the university teachers in the European space of higher education 3 Tools for determining the publishing activity of the university teachers 4 Research results 4.1 Structural and functional model of the rating system for the analysis the research activity of the university teachers 4.2 Development of a transparency rating and methodology for its construction 4.3 Influence of the rating indicators on the improvement of the university teachers’ research activity 5 Conclusions