logo logo European Journal of Educational Research

EU-JER is is a, peer reviewed, online academic research journal.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.


Publisher (HQ)

Eurasian Society of Educational Research
Eurasian Society of Educational Research
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
Eurasian Society of Educational Research
Christiaan Huygensstraat 44, Zipcode:7533XB, Enschede, THE NETHERLANDS
environmental learning higher order thinking skills hots aep students

HOTS-AEP: Higher Order Thinking Skills from Elementary to Master Students in Environmental Learning

Ilmi Zajuli Ichsan , Diana Vivanti Sigit , Mieke Miarsyah , Ahmad Ali , Wiwin Pramita Arif , Trio Ageng Prayitno

Environmental learning in the 21st century requires students to have Higher Order Thinking Skills (HOTS). The purpose of this study was to measure HOT.


Environmental learning in the 21st century requires students to have Higher Order Thinking Skills (HOTS). The purpose of this study was to measure HOTS students using Higher Order Thinking Skills Assessment based on Environmental Problem (HOTS-AEP). The research method used in this study was descriptive method with a total sample of 248 students consisting of Elementary School (ES), Junior High School (JHS), Bachelor Program (BP), and Master Program (MP). The results showed that students overall have a very low HOTS category. HOTS scores scale of 0-100 on ES (22.3) are still higher than JHS (20.2). Whereas at the university level, BP scores (19.9) are lower than MP (21.4). This showed that learning must be oriented towards increasing HOTS through various media development learning, learning materials, learning models, and strategies. This study concludes that the HOTS score of students was still very low and needs to be improved.

Keywords: Environmental learning, higher order thinking skills, HOTS-AEP, students.

cloud_download PDF
Article Metrics



Afflerbach, P., Cho, B. Y., & Kim, J. Y. (2015). Conceptualizing and assessing higher-order thinking in reading. Theory into Practice, 54(3), 203–212. https://doi.org/10.1080/00405841.2015.1044367

Aisyah, A., Salehuddin, K., Aman, I., Yasin, R. ., & Mimiko, N. (2018). Eliciting elements of higher order thinking skills in the higher secondary examination question structure in japan and malaysia aznur. In M. Y. M. Noor, B. E. Ahmad, M. R. Ismail, H. Hashim & M. A. A. Baharum (Eds.), Proceedings of the Regional Conference on Science, Technology and Social Sciences (RCSTSS 2016) (pp. 455–464). Singapore, Singapore: Springer. https://doi.org/10.1007/978-981-13-0074-5

Anderson, L. W., Krathwohl, D. R., Airiasian, W., Cruikshank, K. A., Mayer, R. E., & Pintrich, P. R. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s Taxonomy of educational outcomes: Complete edition. New York, NY: Longman.

Bahtiar, B., & Dukomalamo, N. (2019). Basic science process skills of biology laboratory practice: improving through discovery learning. Biosfer: Jurnal Pendidikan Biologi / Biosphere: Journal of Biology Education, 12(1), 83–93. https://doi.org/10.21009/biosferjpb.v12n1.83-93

Baris, M. F. (2015). European teachers’ technological pedagogical content knowledge (TPCK) and educational use of web technologies. European Journal of Educational Research, 4(4), 149–155. https://doi.org/10.12973/eu-jer.4.4.149

Blanco, E., & Lozano, J. (2015). Ecolabels, uncertified abatement, and the sustainability of natural resources: An evolutionary approach. Journal of Evolutionary Economics, 25(3), 623–647. https://doi.org/10.1007/s00191-015-0403-y

Chalkiadaki, A. (2018). A systematic literature review of 21st century skills and competencies in primary education. International Journal of Instruction, 11(3), 1–16. https://doi.org/10.12973/iji.2018.1131a

Copley, P. (2013). The need to deliver higher-order skills in the context of marketing in SMEs. Industry and Higher Education, 27(6), 465–476. https://doi.org/10.5367/ihe.2013.0181

Ertz, M., Karakas, F., & Sarigollu, E. (2016). Exploring pro-environmental behaviors of consumers: An analysis of contextual factors, attitude, and behaviors. Journal of Business Research, 69(10), 3971–3980. https://doi.org/10.1016/j.jbusres.2016.06.010

Fajarianingtyas, D. A., Akbar, N. A., & Herowati, H. (2019). Developing students’ worksheet based on scientific approach in cell as the system of life. Biosfer: Jurnal Pendidikan Biologi / Biosphere: Journal of Biology Education, 12(1), 109–121. https://doi.org/10.21009/biosferjpb.v12n1.109-121

Fauzi, A., & Fariantika, A. (2018). Courses perceived difficult by undergraduate students majoring in biology. Biosfer: Jurnal Pendidikan Biologi / Biosphere: Journal of Biology Education, 11(2), 78–89. https://doi.org/10.21009/biosferjpb.v11n2.78-89

Fitriani, U., Adisyahputra, A., & Komala, R. (2018). Eco-friendly website development in biology learning based on project activities on environmental pollution. Biosfer: Jurnal Pendidikan Biologi / Biosphere: Journal of Biology Education, 11(1), 32–46. https://doi.org/10.21009/biosferjpb.11-1.4

Garcia, L. C. (2015). Environmental science issues for Higher- Order Thinking Skills (HOTS) development: A case study in the Philippines. In E. G. S. Daniel (Ed.), Biology Education and Research in a Changing Planet (pp. 45–54). Singapore, Singapore: Springer.  https://doi.org/10.1007/978-981-287-524-2

Genc, M., Genc, T., & Rasgele, P. G. (2018). Effects of nature-based environmental education on the attitudes of 7th grade students towards the environment and living organisms and affective tendency. International Research in Geographical and Environmental Education, 27(4), 326–340. https://doi.org/10.1080/10382046.2017.1382211

Goldman, D., Yavetz, B., & Pe’er, S. (2014). Student teachers’ attainment of environmental literacy in relation to their disciplinary major during undergraduate studies. International Journal of Environmental and Science Education, 9(4), 369–383. https://doi.org/10.12973/ijese.2014.222a

Gu, W., Chhajed, D., Petruzzi, N. C., & Yalabik, B. (2015). Quality design and environmental implications of green consumerism in remanufacturing. International Journal of Production Economics, 162, 55–69. https://doi.org/10.1016/j.ijpe.2014.12.040

Gunduz, A. Y., Alemdag, E., Yasar, S., & Erdem, M. (2016). Design of a problem-based online learning environment and evaluation of its effectiveness. The Turkish Online Journal of Educational Technology, 15(3), 49–57. https://doi.org/10.1017/CBO9781107415324.004

Heong, Y. M., Yunos, J., Othman, W., Hassan, R., Kiong, T. T., & Mohamad, M. M. (2012). The needs analysis of learning higher order thinking skills for generating ideas. Procedia - Social and Behavioral Sciences, 59, 197–203. https://doi.org/10.1016/j.sbspro.2012.09.265

Hidayat, W., Wahyudin, W., & Prabawanto, S. (2018). Improving students ’ creative mathematical reasoning ability students through adversity quotient and argument driven inquiry learning. Journal of Physics: Conference Series, 948(2018), 012005 .

Husamah, H., Fatmawati, D., & Setyawan, D. (2018). OIDDE learning model: Improving higher order thinking skills of biology teacher candidates. Interntaional Journal of Instruction, 11(2), 249–264.

Ichsan, I. Z., Hasanah, R., Aini, S., Ristanto, R. H., & Miarsyah, M. (2019). Higher Order Thinking Skills Assessment based on Environmental Problem (HOTS-AEP): Mendesain Evaluasi Pembelajaran Abad 21 [Higher Order Thinking Skills Assessment based on Environmental Problem (HOTS-AEP): Designing Evaluation for 21st Century Learning]. Jurnal Biotek / Biotek Journal, 7(1), 14–26.

Istiana, R., & Awaludin, M. T. (2018). Enhancing biology education students ability to solve problems in environmental science material through inquiri model-based lesson study. Biosfer: Jurnal Pendidikan Biologi / Biosphere: Journal of Biology Education, 11(1), 57–66. https://doi.org/10.21009/biosferjpb.11-1.6

Karpudewan, M., Roth, W. M., & Abdullah, M. N. S. Bin. (2015). Enhancing primary school students’ knowledge about global warming and environmental attitude using climate change activities. International Journal of Science Education, 37(1), 31–54. https://doi.org/10.1080/09500693.2014.958600

Khan, A., Khan, S., Zia-Ul-Islam, S., & Khan, M. (2017). Communication skills of a teacher and its role in the development of the students’ academic success. Journal of Education and Practice, 8(1), 18–21.

Kinay, I., & Bagceci, B. (2016). The investigation of the effects of authentic assessment approach on prospective teachers’ problem-solving skills. International Education Studies, 9(8), 51–59. https://doi.org/10.5539/ies.v9n8p51

Kose, S., Savran Gencer, A., Gezer, K., Erol, G. H., & Bilen, K. (2011). Investigation of undergraduate students’ environmental attitudes. International Electronic Journal of Environmental Education, 1(2), 85–96.

Lile, R., & Bran, C. (2014). The assessment of learning outcomes. Procedia - Social and Behavioral Sciences, 163, 125–131. https://doi.org/10.1016/j.sbspro.2014.12.297

Madhuri, G. V, Kantamreddi, V. S. S. N., & Prakash Goteti, L. N. S. (2012). Promoting higher order thinking skills using inquiry-based learning. European Journal of Engineering Education, 37(2), 117-123. https://doi.org/10.1080/03043797.2012.661701

Mahoney, J. W., & Harris-Reeves, B. (2019). The effects of collaborative testing on higher order thinking: Do the bright get brighter? Active Learning in Higher Education, 20(1), 25–37. https://doi.org/10.1177/1469787417723243

Mercer-Mapstone, L., & Kuchel, L. (2017). Core skills for effective science communication: a teaching resource for undergraduate science education. International Journal of Science Education, Part B: Communication and Public Engagement, 7(2), 181–201. https://doi.org/10.1080/21548455.2015.1113573

Meyer, A. (2016). Heterogeneity in the preferences and pro-environmental behavior of college students: The effects of years on campus, demographics, and external factors. Journal of Cleaner Production, 112, 3451–3463. https://doi.org/10.1016/j.jclepro.2015.10.133

Nordin, A. B., & Alias, N. (2013). Learning outcomes and student perceptions in using of blended learning in history. Procedia - Social and Behavioral Sciences, 103, 577–585. https://doi.org/10.1016/j.sbspro.2013.10.375

Okur Berberoglu, E., Ozdilek, H. G., & Yalcin Ozdilek, S. (2014). The short term effectiveness of an outdoor environmental education on environmental awareness and sensitivity of in-service. International Electronic Journal of Environmental Education, 5(1), 1–20. https://doi.org/10.18497/iejee-green.03640

Puran, R., Behzadi, M. H., Shahvarani, A., & Lotfi, F. H. (2017). The effects of training and other factors on problem solving in students. European Journal of Contemporary Education, 6(3), 448–460. https://doi.org/10.13187/ejced.2017.3.448

Quieng, M. C., Lim, P. P., & Lucas, M. R. D. (2015). 21st century-based soft skills: Spotlight on non-cognitive skills in a cognitive-laden dentistry program. European Journal of Contemporary Education, 11(1), 72–81. https://doi.org/10.13187/ejced.2015.11.72

Ratumanan, T. ., & Laurens, T. (2006). Evaluasi Hasil belajar yang relevan dengan kurikulum berbasis kompetensi [Evaluation of learning outcomes relevant to the curriculum based on competency]. Surabaya, Indonesia: Unesa University Press.

Saltan, F., & Divarci, O. F. (2017). Using blogs to improve elementary school students’ environmental literacy in science class. European Journal of Educational Research, 6(3), 347–355. https://doi.org/10.12973/eu-jer.6.3.347

Saputri, A. C., Sajidan, S., Rinanto, Y., Afandi, A., & Prasetyanti, N. M. (2018). Improving students’ critical thinking skills in cell-metabolism learning using stimulating higher order thinking skills model. International Journal of Instruction, 12(1), 327–342. https://doi.org/10.29333/iji.2019.12122a

Sener, N., Turk, C., & Tas, E. (2015). Improving science attitude and creative thinking through science education project: A design, implementation and assessment. Journal of Education and Training Studies, 3(4), 57–67. https://doi.org/10.11114/jets.v3i4.771

Sharif, A., & Cho, S. (2015). 21st-century instructional designers: bridging the perceptual gaps between identity, practice, impact and professional development. RUSC Universities and Knowledge Society Journal, 12(3), 72–85. https://doi.org/10.7238/rusc.v12i3.2176

Suhendar, S., & Wahyuni, A. (2018). Achievement and response of students at favorite junior high schools in sukabumi on trends in international mathematics and science study (TIMSS) questions. Biosfer: Jurnal Pendidikan Biologi /  Biosphere: Journal of Biology Education, 11(2), 126–133. https://doi.org/10.21009/biosferjpb.v11n2.126-133

Talmi, I., Hazzan, O., & Katz, R. (2018). Intrinsic motivation and 21st-century skills in an undergraduate engineering project: the formula student project. Higher Education Studies, 8(4), 46. https://doi.org/10.5539/hes.v8n4p46

Tyabaev, A. E., Sedelnikova, S. F., & Voytovich, A. V. (2015). Student-centered learning: The experience of teaching international students in Russian universities. Procedia - Social and Behavioral Sciences, 215(June), 84–89. https://doi.org/10.1016/j.sbspro.2015.11.578

Vincent-Ruz, P., & Schunn, C. D. (2017). The increasingly important role of science competency beliefs for science learning in girls. Journal of Research in Science Teaching, 54(6), 790–822. https://doi.org/10.1002/tea.21387

Walsh, R., Bowes, J., & Sweller, N. (2017). Why would you say goodnight to the moon? response of young intellectually gifted children to lower and higher order questions during storybook reading. Journal for the Education of the Gifted, 40(3), 220–246. https://doi.org/10.1177/0162353217717032

Xia, B. S. (2017). An in-depth analysis of teaching themes and the quality of teaching in higher education: evidence from the programming education environments. International Journal of Teaching and Learning in Higher Education, 29(2), 245–254.

Yang, C.-M. (2018). Applying design thinking as a method for teaching packaging design. Journal of Education and Learning, 7(5), 52–61. https://doi.org/10.5539/jel.v7n5p52

Yee, M. H., Yunos, J. M., Othman, W., Hassan, R., Tee, T. K., & Mohamad, M. M. (2015). Disparity of Learning Styles and Higher Order Thinking Skills among Technical Students. Procedia - Social and Behavioral Sciences, 204(November 2014), 143–152. https://doi.org/10.1016/j.sbspro.2015.08.127

Yu, T. Y., Yu, T. K., & Chao, C. M. (2017). Understanding Taiwanese undergraduate students’ pro-environmental behavioral intention towards green products in the fight against climate change. Journal of Cleaner Production, 161, 390–402. https://doi.org/10.1016/j.jclepro.2017.05.115

Zohar, A., & Alboher Agmon, V. (2018). Raising test scores vs. teaching higher order thinking (HOT): senior science teachers’ views on how several concurrent policies affect classroom practices. Research in Science and Technological Education, 36(2), 243–260. https://doi.org/10.1080/02635143.2017.1395332