Global Research in Higher Education ISSN 2576-196X (Print) ISSN 2576-1951 (Online) Vol. 3, No. 3, 2020 www.scholink.org/ojs/index.php/grhe 42 Original Paper Numeracy and Environmental Skills with Indicators: Educational Micro-Assessment in University Students Conrado Ruiz-Hernández 1* , Alma Delia Lupercio-Lozano 1 , Thalía Ameyatzin Bernal-González 1 , Francisco José Torner-Morales 1 & José Luis Muñoz-López 1 1 National Autonomous University of Mexico: Iztacala Campus (UNAM-IZTACALA), State of Mexico, Mexico * Conrado Ruiz-Hernández, educa.ambiente.cyma18@gmail.com Received: August 9, 2020 Accepted: August 19, 2020 Online Published: September 7, 2020 doi:10.22158/grhe.v3n3p42 URL: http://dx.doi.org/10.22158/grhe.v3n3p42 Abstract This study is an extension of a micro-assessment on educational advances that has developed in 2010, for valuate numerical and environmental skills. After ten years, it observe, in terminal biology students of UNAM-Iztacala, a very notable change in the recognition of terms in the sum of a polynomial, but for the fine skills -of the same students- in separation of two assembled materials present in the common waste, we don’t observe a change or an improvement. This comparative study was carried out with forty participants. The effectiveness of formal and informal educational interventions, in the quest to seek a learning improvement, is evident. Keywords docimology, educational micro-assessment, numeracy, environmental education, and problem solving 1. Introduction In April 2010, we carried out a comparative study with numerical and environmental skills, with terminal biology students from UNAM-Iztacala. For this purpose, we chose the use of two numerical and two environmental problems, of high, medium and high difficulty (Ruiz & Lupercio, 2011). These problems are described in the next section. In February 2020, after ten years had passed, we found it interesting to repeat the same observation with biology students similar to those of the previously described experience, with the purpose of observing, if with respect to the original results, it was possible to show a change in the last observation. www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 43 Published by SCHOLINK INC. In the educational research setting, the application of extensive questionnaires is common (OECD, 2018), which include a large number of questions or problems to be solved (Bomboir, 1971; Bomboir, 1974; Flavell, 1976), however, an alternative modality is beginning to develop an educational evaluation (Díaz-Barriga & Hernández, 2002), based on reactive or problems with the character of indicators (Katic, Hmelo-Silver, & Weber, 2009; Tavernal & Peralta, 2009; Ruiz, Lupercio, & Bernal, 2015). These indicators should represent a high or medium difficulty in the initial observation (pre-test) with respect to the final observation (post-test), in order to obtain clear results (Ruiz, Lupercio, & Bernal, 2017; Ruiz, Lupercio, & Bernal, 2020). This leads us to suggest the opening of a debate about the scope and limitations of the educational macro-evaluation and micro-evaluation models, where the former point towards a general and standardized measurement of educational progress and, the latter, more properly, to a more particular and detailed corroboration of educational topics of strategic value (INEE, 2016). In our opinion, both types of approach can and should be complementary. This comparison at two different moments and after ten years, forced us to make a recognition of the curricular and institutional changes that occurred in the studied university, in order to find the possible causes of differences or not observable, in the results we obtained when examine biology students and the problems to be solved that we apply. 2. Curricular and Institutional Framework A review of the curricular and institutional changes that had taken place both in the curriculum of the bachelor’s degree in biology and in the institutional environmental performance was carried out, especially considering that the replication of the study carried out in 2010 included the evaluation in particular to two numerical and two environmental problems (differentiated dumping of waste). During this ten-year period, the bachelor’s degree in biology restructured its curriculum, having a new curriculum that began in August 2016. In this, considering the mathematical deficiencies that students historically showed, a compulsory course was incorporated, which is called “Algebra workshop”, with the same hours as a normal course, but without credit allocation, although it must be approved for the purposes of the degree, which is taught in the first semester. The objectives of this course is that students amicably review their essential mathematical knowledge, correct poor basic learning, as well as learning to make intelligent use of algorithms and mathematical procedures frequently used in biology (biology descriptive letter, 2016). Also, since 2014, an institutional program called PROMIR was reconsidered, aimed at promoting good practices in the comprehensive management of urban solid waste generated at UNAM-Iztacala. The latter is based on giving some talks to new students, with the support of brochures and posters, to motivate them to participate in the responsible management of common waste generated on campus, inviting them to respect the nomenclature for the landfill of the waste indicated in the garbage containers (Ruiz, Lupercio, Muñoz, Torner, & Bernal, 2015). Both types of intervention did not exist in www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 44 Published by SCHOLINK INC. their current version, ten years ago. Although at UNAM-Iztacala, for 25 years there has been a more or less structured program, which has been promoting the recycling of waste materials and other pro-environmental actions (Ruiz & Lupercio, 2015). We point out this background, because it can be useful in explaining the results. 3. Description of the Problems The four problems, described below, have been tested and applied in various background reports, which have allowed us to verify their usefulness as effective indicators of performance, in numerical and environmental skills (Ruiz & Lupercio, 2011; Ruiz, Torner, Lupercio, & Bernal, 2015; Ruiz, 2015). This indication is particularly applicable, for rapid evaluations and with the items or problems that represent the greatest difficulty, in the initial observation (Ruiz, Lupercio, & Bernal, 2018). Problems: P (1): sum of a polynomial, which includes the help of a parenthesis, to make it easier for the performer to identify the terms of the sum. It should be noted that, in this operation, 3.2 + (4.4 x 2) + 8, the parentheses are mathematically unnecessary. The correct answer is 20. This problem, applied to university students, represents a minimal difficulty, mainly due to the help provided by the parentheses. P (2): sum of a polynomial, which does not include the previous help, 2 + 3 x 4 + 5. The correct answer is 19. This problem, based on our historical references, represents a high difficulty in university students, which is explained by the general mistake of not identifying the terms in the sum of a polynomial. What is a remnant effect, due to their neglect, in the learning of elementary mathematics and that leads to making many more serious mistakes in other operations, such as, for example, in geometry, algebra and calculus (Alatorre, 2002; Alatorre, 2009). As a mere reminder, we refer that the “term”, represents in all serial or polynomial operations (a + b + c + ...) the independent computations or values, in numerical or algebraic connotation, that are separated by sum or subtraction. It is a fundamental concept (Larousse mathematics dictionary, 2018; Miles, 1999) for the correct execution of algorithms and in advanced mathematical reasoning (Matheracy). C: differentiated discharge of an aluminum can with a plastic straw, inserted inside, which constitutes an occasional assembly with two pieces of different material, present in the common garbage. The success is only granted by placing the aluminum can, separated from the plastic straw, in an exclusive container for “metal”. In the case of an occasional assembly, this problem represents a medium difficulty in university students. The mistakes are generally due to the inadvertence on the part of the participant in the separation of the second object, by not attending to the indications for the differentiated discharge requested. The failure is due to neglect and not ignorance of the materials. B: differentiated discharge of a glass bottle with a plastic screw cap, which constitutes a structural assembly, with two different material wastes, present in the common garbage. The success is only granted by placing the glass bottle, separated from the plastic screw cap, in an exclusive container for “glass”. Being a structural assembly, where both components of different material are part of the same www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 45 Published by SCHOLINK INC. container, it represents a high difficulty with university students. As in what was stated in the previous problem, the failure is due to neglect and not ignorance of the materials. 4. Method in a Comparative Study 4.1 Objectives 1) Replicate a comparative study published in 2011, with numerical and environmental examples, with a similar sample of the same students, in order to observe if there are differences. 2) Finding the possible causes that explain the significant and insignificant differences, both numerically and environmentally. 4.2 Hypothesis “A noticeable change in the frequency of successes observed in solving a problem can only be attributed to a specific and systematic educational intervention”. 4.3 Subjects and Procedure Both the historical reference and the replica made were carried out with forty terminal biology students from UNAM-Iztacala, where they were informed of the intention of this exercise and, where their consent was requested, to participate voluntarily. The numerical problems were applied in a group session and the environmental problems in a cabinet (simulator for the differentiated discharge of waste) arranged for individualized observation, without communication between the participants. In the latter case, the response options are exclusive containers for: metal, plastic, glass, writing paper/cardboard and everything else. Both the numerical and environmental problems are accompanied by another ten contextual questions related to the respective themes. 5. Results Figure 1 shows the results observed in 2010 and 2020, with the four aforementioned problems, where the successes are presented separately, as well as the coincidence between them, separating the numerical and the environmental. www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 46 Published by SCHOLINK INC. Figure 1. Results of the Problems Applied In these results, an extremely notable change can only be observed in the span of ten years, in the successes obtained by the participants of this replicated study, in the resolution of the sum of a polynomial without the help of a parenthesis (Note 1) and, consequently, also in the respective coincidence between the two sums (where the first one represents practically no difficulty, both in 2010 and 2020). Regarding the environmental ability evaluated, no change was registered, which generally occurs in the measurement of fine ability in the dumping of wastes, even in higher education institutions that have well-structured programs for the management of urban solid waste, but without attending to the acquisition of environmental knowledge and skills in the student community (Ruiz & Lupercio, 2013; Ruiz, Lupercio, & Bernal, 2018). 6. Discussion Here it is worth analyzing and looking for an explanation to two aspects that are observed in our results, the reason for the remarkable change -with the incidence of successes- in one of the numerical problems and, also, the null improvement in the problems of differentiated waste disposal that we examine, taking into consideration the span of ten years, elapsed from the previous observation (2010) and the current one (2020). It seems to be clear that the “Algebra Workshop” (a formal curricular course), has had a relevant role in the remedial improvement of basic mathematical knowledge, where the sum of a polynomial, without any help or clue given to the participant, it is an effective indicator. In the case of the PROMIR program, which constitutes the institutional policy for the management of urban solid waste, with informal interventions and without any curricular involvement, based on the www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 47 Published by SCHOLINK INC. measurement of fine ability for the differentiated dumping of waste, with waste presented in assembly, no change was observed. This leads us to propose considering the advisability that in the same institution, the tasks of pro-environmental promotion, begin to be treated in a similar way, to what has been done with the “Algebra Workshop”, or in other words, a kind of “Workshop on good pro-environmental practices” can be structured, which is more or less formal in nature and with a well-organized pedagogical approach, which could be taught in the first semester, not only of a degree in biology, but of all the degrees and postgraduate courses taught at UNAM-Iztacala. Although the referred “Algebra Workshop” does not solve all the learning of basic mathematical knowledge (where we detect that the term concept, most terminal biology students, although they intuitively understand it functionally, do not understand it in its definition or formal characterization), this course does contribute in a substantive way to improve the essential mathematical skills -beyond just the numerical one- of biology students, since we found in a complementary investigation (carried out in 2019), in which we evaluated the items contextual numerically and we compare it with a group of first-year students, where in a battery with ten items such as hand-operations, mental calculation, valuation of decimal numbers, roots and powers, among other problems (Ruiz & Lupercio, 2013; Ruiz, Lupercio, & Bernal, 2020), both groups of students (initial and terminal), obtained on average grades higher than 9. We infer, that this “Algebra Workshop”, is more involved in the development of intermediate mathematical skills (Matheracy), which will be studied in other new research. It seems to us that something very similar could be expected if, with pro-environmental tasks, such a workshop could be structured. It is time to recognize that the pro-environmental promotion tasks -given how difficult, complicated and complex they are in practice- demand a more serious and demanding educational treatment. Alone talks and voluntary altruism (basically supported by publicity interventions or institutional propaganda) do not seem to generate significant learning with community significance. 7. Conclusions The problems used as indicators of educational progress did prove to be effective and reliable, including in the recognition of fine differences. Likewise, the comparison of formal and informal intervention strategies, commonly used in higher education institutions, allowed visualizing the relative results of both intervention models, in the recording of results in the four problems that we examined, with the improvement in the numerical ability of high difficulty and, likewise, the stagnation or absence of improvement in the fine ability to separate wastes, in this case presented in assemblies, from wastes present in common garbage. This type of rapid evaluations, systematically applied, can help to identify both good educational practices, as well as less successful ones, to provide better and meaningful learning, at all school levels. www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 48 Published by SCHOLINK INC. It was shown that this rapid modality of the evaluation of educational progress, supported by the resolution of problems that serve as effective indicators, constitutes an extremely useful resource for the measurement of learning, without the need to apply a battery of reagents extensive and strenuous. The key to this is having a collection of reagents -really appropriate- to carry out an exploration of this nature, both for its application in the field of natural, social, humanities and civic knowledge, among other topics. The cost involved, in terms of time, money and effort, can be considerably reduced, obtaining a well-weighted and reliable result. Acknowledgments This research was carried out with the financing of the Program of Support for Research Projects and Technological Innovation of UNAM, PAPIIT: IN310719. Thanks to the other members of the project: Carlos Enrique Palacios (biologist), Eduardo Rodríguez Sierra (pedagogue) and José Antonio Melo (psychologist) who actively participated in carrying out of this research. Likewise, the editorial support given by Michelle Ruiz Valdes (Master in International Cooperation) and Adriana Hernández García (grant holder of the PAPIIT project) is recognized. References Alatorre, S. (2002). Efectos temáticos del efecto remanente de las matemáticas escolares, en Algunos problemas matemáticos en México, A. de la Peña (Compilador) Siglo XXI Editores (pp. 51-112). México. Alatorre, S. (2011). Numeralismo: Un asunto que incumbe a todo el mundo (Sí, también a usted a quien las matemáticas lo aturden). Revista Mexicana de investigación Educativa, 16(50), 961-986. Bomboir, A. (1971). Pedagogía correctiva. Ediciones Morata, Madrid. Bomboir, A. (1974). La docimología problemática de la evaluación. Morata, Madrid. Carta descriptiva de la materia: Taller de álgebra. (2016). Licenciatura en biología, Facultad de Estudios Superiores Iztacala, UNAM. Retrieved from https://biologia.iztacala.unam.mx/plan2034/obligatorias/1112_algebra.pdf Díaz-Barriga, F., & Hernández, R. G. (2002). Constructivismo y evaluación psicoeducativa. Cap. 8 en Estrategias docentes para un aprendizaje significativo. In Una interpretación constructivista. McGraw-Hill, México. Flavell, J. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence (pp. 231-235). Hillsdale, Nueva Jersey: Lawrence Erlbarum Associates. INEE. (2016). Consideraciones conceptuales y metodológicas para la elaboración de indicadores de proceso y resultado. Cuarta Etapa. México: Autor. Retrieved from https://www.inee.edu.mx/wp-content/uploads/2019/04/5.-Gu%C3%ADa-para-el-desarrollo-PEEM E_cuarta-etapa.pdf https://www.inee.edu.mx/wp-content/uploads/2019/04/5.-Gu%C3%ADa-para-el-desarrollo-PEEME_cuarta-etapa.pdf https://www.inee.edu.mx/wp-content/uploads/2019/04/5.-Gu%C3%ADa-para-el-desarrollo-PEEME_cuarta-etapa.pdf www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 49 Published by SCHOLINK INC. Katic, E. K., Hmelo-Silver, C. E., & Weber, K. H. (2009). Material mediation: Tools and representations supporting collaborative problem-solving discourse. International Journal of Teaching and Learning in Higher Education, 21(1), 13-24. Larousse: Diccionario esencial de matemáticas (pp. 361-362). (2018). CDMX, México. Miles, D. (1999). Algebra vocabulary as an important factor in Algebra achievement. Focus on Learning Problems in Mathematics, 21(2), 37-47. OECD (Organisation for Economic Co-operation and Development). (2018). Programme for International Student Assesement (PISA) Results from PISA 2018 for Mexico. Retrieved from https://files.eric.ed.gov/fulltext/EJ1183972.pdf Ruiz, C. (2012). Pocos más muchos. Contexto sociocultural al hacer cuentas en Ciencia y Desarrollo, 38(257), 30-31. Ruiz, C. (2015). Hacia una comprobación experimental de la zona de desarrollo próximo de Vigotsky. CIENCIA ergo-sum, [S.l.], 22(2), 167-171. Ruiz, C. Y., & Lupercio, A. (2011). Separar para reciclar: ¿sabemos hacerlo? Revista Ciencia y Desarrollo, 237(251), 20-27. Ruiz, C. Y., & Lupercio, A. (2013). La utilidad de los paréntesis en la enseñanza de las matemáticas, en Ciencias (No. 107-108, julio 2012-febrero 2013, pp. 148-153). Ruiz, C. Y., & Lupercio, A. (2015). Auditoría ambiental participativa sobre manejo de RSU en dos universidades mexicanas: Prospección preliminar. Memoria del primer encuentro académico sobre manejo de residuos en universidades. México: UAM Azcapotzalco. Ruiz, C., & Lupercio, A. (2013). Habilidad fina para el vertido detallista de desechos con y sin intervención propedéutica en universitarios: Microevaluación en educación ambiental Revista. Intercontinental de Psicología y Educación, 15(2), 155-170. Ruiz, C., Lupercio, A., & Bernal, T. (2018). Evaluación diagnóstica para el análisis de programas de manejo integral de residuos sólidos urbanos en dos universidades mexicanas. CIENCIA Ergo-Sum, 25(3). https://doi.org/10.30878/ces.v25n3a12 Ruiz, C., Lupercio, A., Muñoz, J., Torner, F., & Bernal, T. (2015). Residuos sólidos urbanos: Normatividad y cumplimiento de metas. Derecho Ambiental y Ecología, 68(12), 92-96. Ruiz, C., Torner, F., Lupercio, A. Y., & Bernal, T. (2015). Auditoría ambiental participativa. Cartilla de RSU, Ciencia y Desarrollo, 41(275), 34-35. Ruiz-Hernández, C., Lupercio, A., & Bernal, T. (2020). A Zone of Proximal Development Process in the Selective Disposal of Urban Solid Waste: Problem Solving with Two Assembled Materials. Education Journal, 9(2), 48-51. https://doi.org/10.11648/j.edu.20200902.13 Ruiz-Hernández, C., Lupercio-Lozano, A. D., & Bernal-Gonzalez, T. A. (2015). The Scope and Limitations of Brief Interventions for Remedial Education: An Experimental Approach in a Numeracy Case. International Journal of Secondary Education, 3(4), 32-36. https://doi.org/10.11648/j.ijsedu.20150304.12 https://files.eric.ed.gov/fulltext/EJ1183972.pdf https://doi.org/10.30878/ces.v25n3a12 https://doi.org/10.11648/j.edu.20200902.13 https://doi.org/10.11648/j.ijsedu.20150304.12 www.scholink.org/ojs/index.php/grhe Global Research in Higher Education Vol. 3, No. 3, 2020 50 Published by SCHOLINK INC. Ruiz-Hernández, C., Lupercio-Lozano, A. D., & Bernal-Gonzalez, T. A. (2017). Towards an Experimental Verification of Vygotsky’s Zone of Proximal Development: A Docimological Approach. Education Journal, 6(1), 47-50. https://doi.org/10.11648/j.edu.20170601.16 Ruiz-Hernández, C., Lupercio-Lozano, A. D., Bernal-Gonzalez, T. A., & Torner-Morales, F. J. (2017). Basis for the Analysis of Plans for the Comprehensive Management of Municipal Solid Waste: A Collaborative Assessment in Two Mexican Universities. Environment and Sustainability, 1(3), 85-89. Tavernal, A. Y., & Peralta, O. (2009). Dificultades de aprendizaje. Evaluación dinámica como herramienta diagnóstica. Revista Intercontinental de Psicología y Educación, 11(2), 113-139. Note Note 1. This difference reaches a statistical confidence level of 99.9% in a two-tailed Student’s t-test (40 + 40 - 2 = 78 degrees of freedom); this same significant difference is also present in the coincidences for this same problem. https://doi.org/10.11648/j.edu.20170601.16