ETR&D

Flipped learning has been recognized as a promising pedagogical model for methodological progress in educational environments. Studies have shown the effectiveness of flipped learning when used with appropriate educational technologies and learning strategies. On the other hand, comprehensive guidance is required to combine this pedagogical model with new technologies. The current study investigates how discussion tools integrated into online flipped learning environments affect students’ engagement and self-regulation. Participants targeted for this study consisted of 121 first-year students randomly assigned to one of four experimental conditions formed by a 2 (synchronous online discussions vs. asynchronous online discussions) × 2 (online flipped learning vs. online learning) factorial pretest/post-test design. The results revealed that there was a significant interaction effect between the online flipped learning approach and synchronous online discussions on behavioral and cognitive engagement. While no interaction effects on self-regulation between the learning approach and online discussions were found, the results revealed that the online flipped learning approach and synchronous online discussions separately increased self-regulation. The findings contribute to the online flipped learning approach by adding a new perspective, namely synchronous online discussions, and thereby proposing a new interactive learning experience for a more engaging and deeper exploration of online learning. The implications of designing an online flipped learning environment with synchronous online discussion tools are discussed.

Abstract

Professional vision (PV), which includes the ability to perceive and interpret classroom events, is important for classroom behaviour management, particularly in the training of student teachers. However, to date, few assessment systems that can assess student teachers’ professional vision by immersing them in a realistic classroom environment (presence) from their own perspective (first-person perspective) have been developed. To address this gap, this study employs a design-based research approach to develop an immersive virtual reality (IVR) technology-based professional vision assessment system (IVR-based PVAS). The research outlines the four-stage process through which the system was constructed to meet the requirements of professional vision assessment and address the core challenges of the current assessment approach. Twenty-four student teachers were enrolled as participants in an implementation case study in which their perceptions and interpretations of seven classroom events related to student misbehaviour were assessed via an IVR-based PVAS. The participants’ problems with perception and interpretation were diagnosed with multiple assessment indices. The benefits of the IVR-based PVAS are summarised, and recommendations are provided for the use of this assessment system in both instruction and research.

Abstract

Digital game-based learning (DGBL) has emerged as an effective strategy to enhance students’ learning effectiveness. Concept mapping, recognized as a valuable tool for knowledge construction, has been widely implemented in educational settings. However, research indicates challenges when integrating concept maps into games, particularly when the learning content is extensive or complex. In such cases, the use of concept maps may increase cognitive load and negatively impact learning effectiveness. Consequently, this study addressed the issues of reducing learners’ cognitive load and increasing their motivation within a DGBL context. To address these issues, this study developed a progressive concept map-based game approach. This approach integrates mathematical concepts with real-life situations and employs progressive concept maps to facilitate knowledge construction. The aim is to help students understand the relationships between mathematical concepts and guide them in solving learning tasks and achieving higher learning outcomes during gameplay. A quasi-experimental design was employed, with the experimental group using the progressive concept map-based game approach and the control group using a conventional concept map-based game approach. The results indicated that the experimental group significantly outperformed the control group in learning achievement, learning motivation, problem-solving tendencies, and self-efficacy. These findings offer valuable insights for future DGBL research, particularly in the development of progressive strategies.

Abstract

Collaboration scripts are widely employed in online collaborative learning to enhance student engagement and facilitate collaboration. However, the optimal level of scripting remains a subject of debate. This study aims to address this issue by designing and developing different types of collaborative scripts implemented through conversational agents and supported by WeChat. Utilizing interventional studies, we investigate the effects of these different collaboration scripts on student engagement during online collaborative learning. A total of 54 college students participates in the study, divided into six adaptable scripts teams, six maximal script team, and six minimal script team, with each team consisting of three students. Both quantitative and qualitative data are collected and meticulously analyzed. The results reveal that the maximal collaboration script significantly enhances cognitive interactions, whereas the minimal collaboration script fosters high-quality cognitive engagement. In terms of socio-emotional engagement, the adaptable collaboration script effectively promotes positive socio-emotional engagement, while the maximal collaboration script facilitates greater socio-emotional interactions. Furthermore, thematic analysis demonstrates that all three types of collaboration scripts support student engagement by providing time reminders, facilitating planning, clarifying ideas, and promoting task reflection. These findings have important implications for improving group learning engagement in online collaborative learning environments.

Abstract

This study explores the roles of students’ help-seeking profiles when seeking help from AI chatbots, specifically ChatGPT, in a digital game-based learning environment, Summon of Magicrystal. The study involved 102 middle school students who played an online game with the provision of ChatGPT and sought help from ChatGPT while solving physics problems. The results revealed that students’ help-seeking profiles, help-seeking threats, help-seeking avoidance, and instrumental help-seeking were positively correlated. Students’ instrumental help-seeking profile has a positive effect on game performance/engagement, while students’ avoidance help-seeking profile has a positive effect on the number of game attempts. The findings highlight the importance of students’ help-seeking profiles when considering designing AI-assisted game-based learning environments to better support students’ science learning.

Abstract

Mastering correct pronunciation is crucial for effective Spanish language learning and communication. However, many existing language learning resources lack adequate coverage of pronunciation guidance and feedback mechanisms. This study aims to address this gap by developing SpanishBot, an innovative chatbot designed to facilitate the learning of Spanish letter pronunciations and their variations for non-native speakers. Forty-eight participants, unfamiliar with Spanish, were randomly divided into an experimental group using SpanishBot and a control group using independent learning methods. The experimental group interacted with SpanishBot over a 2-month period, which utilized Python programming and the Line instant messaging platform for delivering personalized pronunciation feedback and practice. Instruments included a pre-test and a post-test, as well as the SpanishBot system, which provided real-time feedback on pronunciation accuracy based on audio recordings. Findings revealed a statistically significant difference between the two groups’ post-test scores, with the experimental group demonstrating remarkable improvements in Spanish pronunciation proficiency. This study highlights SpanishBot’s potential in language education, specifically for Spanish pronunciation training.

Abstract

In higher education, concept mapping has been extensively adopted as an assessment and evaluation tool for conceptual knowledge. In recent years, an increasing number of researchers have applied concept mapping to teaching in technology-based environments. However, no research was found to holistically explore the role of concept maps in technological contexts of higher education, or their influences on different learning aspects. To address this gap, the present study referred to the technology-based learning model to conduct a systematic review of the dimensions of the research trends, features (including data analysis, participants, media of concept maps, application domains, and roles of concept maps), and research foci. Based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses procedure, this study reviewed the Social Sciences Citation Index articles published in technology-based learning and higher education journals by the end of 2021 from the Web of Science database. The results indicated that in studies on the use of concept maps in technological contexts in higher education (CMHE), the most productive countries/regions (of the first authors) were Taiwan and the United States. The most frequently adopted data analysis methods were quantitative analysis and mixed. In the aspect of application domains, Engineering (including Computer courses) was the most frequent subject for CMHE studies, followed by Language, Social Studies, and Health, Medical and Physical Education. Desk-top computers were the most frequently adopted medium for working on concept maps, although there was increasing adoption of mobile devices. The role of concept maps was mainly as a personal mindtool and assessment and evaluation tool, followed by a collaborative mindtool. In terms of research foci, the cognition dimension was explored the most in CMHE studies, followed by the affect dimension, and learning behavior. Based on the findings of this study, several recommendations are made as a reference for educators, researchers, and policy makers in higher education.

Abstract

To help young students succeed in problem-based learning (PBL), researchers suggested investigating students’ need for cognition (NFC), one’s inclination to exert mental effort during learning. How one puts mental effort into a learning task is related to motivation. If motivated, students are more likely to engage in challenging tasks, put in more effort, and feel competent about what they are doing. This study investigated, through a mixed-methods design, middle school students’ NFC, their motivation to learn, their learning performance, and the relationships among these factors as they engaged in technology-enriched PBL. The findings showed that NFC played an important role in students’ learning. There were significant positive relationships among NFC level, intrinsic motivation both in general and in using PBL, and their learning performance. There were also significant differences in learning performance among the high, medium, and low NFC groups, showing that students in the high group performed better than their counterparts. However, the low NFC group gained more knowledge than their counterparts after using PBL. The study’s findings were further substantiated by qualitative data, which provided nuanced insights that complement the quantitative evidence through detailed topic and sentiment analyses. Limitations of the study were also discussed.

Abstract

This study evaluates the impact of a computer-assisted language learning (CALL) tool for the acquisition of academic English and oral language skills in children learning English as a second language. Using a quasi-experimental design, we compare English proficiency scores for K-5 students who did or did not use the program during the 2020–21 school year. Analyses showed that learners who used the program scored higher on the overall test, including on the oral and written domains, compared to students who did not use the program. When controlling for prior year achievement, we found small, positive but non-significant effects for program users. Proficiency analyses did not reveal any significant differences between student groups. The results show promising evidence that CALL tools, and particularly those focused on oral language development, can be used to provide structured support to students for learning academic English and developing greater overall English language proficiency.

Abstract

This study investigated the sentiment of Twitter discourse on Open Educational Resources (OER). We collected 124,126 tweets containing hashtags related to OER posted from January 2017 to December 2021. We performed fine-grained sentiment analysis using Bidirectional Encoder Representations from Transformers (BERT) to categorize tweets into five sentiment classes: strongly negative, weakly negative, neutral, weakly positive and strongly positive. In addition, thematic analysis was performed by using PyTorch to identify the hidden themes in the tweets. Findings from this study reveal a predominantly positive sentiment toward OER on Twitter, highlighting the perceived benefits of accessibility, inclusivity, and the potential for enhancing educational equality. However, we also found that there are some negative sentiments expressed towards OER, with concerns about quality and effectiveness being the main reasons for criticism. In addition, longer tweets were more likely to express negative sentiments about OER. Finally, the thematic analysis revealed that most tweets center on resources or products that are obtainable through open licensing. These findings have implications for the promotion and implementation of OER and for understanding the role of social media in shaping discourse on education.

Abstract

Argumentation is fundamental and essential in mathematics education. It promotes deep mathematical understanding and helps students connect abstract ideas logically. However, teachers and students in the traditional teacher-centered classroom face difficulties teaching and learning math argumentation. In this article, a cooperative conversation-based tutoring system to foster argumentative skills in learning Pythagorean Theorem was designed. The study analyzed results from an experiment involving 118 middle school students in Taiwan who engaged in formulating, validating, generalizing, and justifying learned mathematics concepts with the help of virtual tutors and peers. The control group included 82 middle schoolers who received the same learning content in the teacher-centered classroom setting. Results confirmed that this agent system promoted significantly better learning outcomes, and the learners’ argumentative experience was also enhanced. Moreover, the unique interactions that took place between each student and the agent system resulted in numerous opportunities for learning mathematical argumentation through an adaptive learning mode.

Abstract

This study explores factors that influence teachers’ technology adoption in technology-rich classrooms and how they interact by integrating task technology fit into the Technology Acceptance Model (TAM). A proposed model was tested via 343 survey responses from Grade 1–12 teachers using structural equation modeling. The results indicated technology task fit played an essential role in teachers’ technology adoption in technology-rich classrooms. Perceived ease of use, however, did not influence teachers’ intention to use technology as previously predicted. The findings suggest that to promote technology adoption in teaching, it is important to help teachers integrate technology into their instructional design and create a supportive culture with sufficient technological support.

Abstract

Role-play tasks have long been used by researchers and practitioners to observe L2 (Second language) speaking performance. This social-situated simulation allows students to employ their language skills to converse about real-life themes. While role-plays are highly plausible to actively engage students in interactive learning environments, it has been challenging to determine whether students perform at an adequate level of speaking proficiency with an appropriate learning approach. Nevertheless, the emerging technology-supported role-play tasks employing AI (artificial intelligence) could enhance competencies, enabling students to perform better in role-plays. Therefore, to enhance and support students’ performance in role-plays, English speaking skills, and their interaction mindset, we integrated an AI-based speaking learning app in the Generalization, Formulation, Correction, Appreciation (AI-GFCA) learning model. A quasi-experiment was conducted in a university with a total of 45 students. One class was randomly assigned to apply the AI-GFCA learning model as the experimental group, while the other was the control group (AI-C). The findings indicated that the AI-GFCA learning model could significantly enhance students’ role-play performance, English speaking skills, and interaction mindset. Furthermore, students produced fewer L2 errors and perceived a better learning experience than the AI-C group. It is noted that with the support of AI learning speaking through role-play tasks, students received sufficient corrective feedback, which encouraged them to establish a positive and motivating learning interaction, thus benefiting their academic performance.

Abstract

The ever-changing global educational landscape, coupled with the advancement of Web3, is seeing rapid changes in the ways pedagogical artificially intelligent conversational agents are being developed and used to advance teaching and learning in higher education. Given the rapidly evolving research landscape, there is a need to establish what the current state of the art is in terms of the pedagogical applications and technological functions of these conversational agents and to identify the key existing research gaps, and future research directions, in the field. A literature survey of the state of the art of pedagogical AI conversational agents in higher education was conducted. The resulting literature sample (n = 92) was analysed using thematic template analysis, the results of which were used to develop a conceptual framework of pedagogical conversational agents in higher education. Furthermore, a survey of the state of the art was then presented as a function of the framework. The conceptual framework proposes that pedagogical AI conversational agents can primarily be considered in terms of their pedagogical applications and their pedagogical purposes, which include pastoral, instructional and cognitive, and are further considered in terms of mode of study and intent. The technological functions of the agents are also considered in terms of embodiment (embodied/disembodied) and functional type and features. This research proposes that there are numerous opportunities for future research, such as, the use of conversational agents for enhancing assessment, reflective practice and to support more effective administration and management practice. In terms of technological functions, future research would benefit from focusing on enhancing the level of personalisation and media richness of interaction that can be achieved by AI conversational agents.

Abstract

Augmented Reality (AR) is increasingly being adopted in education to foster engagement and interest in a variety of subjects and content areas. However, there is a scarcity of instruments to measure the instructional impact of this innovation. This article addresses this gap in two unique ways. First, it presents validation results of the Augmented Reality Presence Scale (ARPS), which was created to evaluate presence in augmented learning environments. Using the Rasch Rating Scale Model, ARPS was validated with 90 college students involved in an AR learning experience. Second, it analyzed the correlations between ARPS scores and the Reduced Instructional Materials Motivation Survey (RIMMS). ARPS was found to be a reliable instrument to evaluate AR presence. Additionally, ARPS was found to be positively correlated to all the four RIMMS dimensions (i.e., attention, relevance, confidence, and satisfaction). These research results point to presence as a desirable outcome of AR-mediated instruction. Moreover, AR presence was facilitated by non-invasive interfaces and perceived agency. Finally, this technology was shown to be productive in addressing all motivation stages rather than working just as a starting step.

Abstract

In the clinical medical field, case studies, medication records, examination results, and physician prescriptions are documented in English. As a consequence, the English for Medical Professionals (EMP) program has become one of the important courses in nursing education in non-English-speaking countries. For English as a Foreign Language (EFL) learners, learning English for medical professionals can become challenging without the support of appropriate learning contexts. In general, the didactic teaching strategy widely used in the EMP program in large classrooms is a passive method without a feedback mechanism. To address the issues of English for Medical Professionals for EFL learners, the study proposed a self-determination theory-based digital gaming approach with autonomy, competence, and relatedness. To verify the effectiveness of the proposed approach, we conducted an experiment in the EMP program by comparing the self-determination theory-based digital gaming approach with the conventional approach, and explored the differences between these two approaches in terms of learning achievement, learning attitude, critical thinking tendency, technology acceptance, and flow experience. The experimental results showed that nursing students who learned with the self-determination theory-based digital gaming approach significantly enhanced their learning achievement, learning attitude, critical thinking tendency, technology acceptance, and flow experience in the EMP program.

Abstract

In the wake of network technology and with the flourishing development of online learning, online presence is beginning to be conceptualized as a pivotal determinant affecting students’ cognitive and learning behaviors in the online landscapes. However, how online presence influences students’ technology-enhanced language learning experience through a multivariate relationship is critical to developing multidimensional approaches to understand students’ online learning beyond the classroom. This study surveyed 330 undergraduate students of college English course in a comprehensive research university in Eastern China concerning online presence, learning aspiration, perceived authenticity and learning engagement which are associated with their technology-enhanced language learning experience. Structural equation modeling analyses of the survey responses indicated the significant association between online presence, learning aspiration, perceived authenticity and learning engagement. Specifically, research results supported the major hypothesis of online presence’s influence on learning aspiration and learning engagement, and this effect was found to be mediated by perceived authenticity and learning engagement. In addition, this study found that perceived authenticity significantly influenced learning engagement, and that learning engagement significantly influenced learning aspiration as well. This research extended our understanding of the main effects of online presence and would help inform teacher educators and network administrators for curriculum and technological development purposes.

Abstract

Aiming to promote equity in computing, this study proposes an educational model that offers an alternative approach to inspire K-12 students to become interested in CS and develop their computational thinking (CT) skills. It also examines the experience of marginalized students during the COVID pandemic in a learning environment grounded in the model. Adopting a mixed methods case study, this work focused on the experience of 82 girls enrolled in a free after school program. The results show that access to the opportunities is critical to promote equity. The experience allows the underrepresented population, i.e. the girls, to gain deepened understanding of not only CT/CS, but also other topics like work ethics, digital citizenship, and how to work with peers to achieve goals. The girls have also broadened their views of computing related fields by working on meaningful projects that demonstrated the value of abstract concepts of coding and programming. A combination of human facilitators and well-constructed tutorials has the potential of improving girls’ self-study skills and preparing them to become more independent learners.

Abstract

The benefits of peer evaluation of teaching effectiveness and quality in higher education are well documented. While instruments exist for the review and evaluation of entire online courses, there is no standardized single-lesson, peer evaluation instrument available for online instruction. This pilot study focused on the validation of a peer observation and evaluation tool for use with single lessons in both synchronous and asynchronous online courses in an inter-professional school of health professions. The researchers modified a psychometrically validated instrument developed for in-person peer observation by adding items from a renowned online course rubric to create a peer observation tool, entitled the Peer Observation and Evaluation Tool-Online (POET-O). The resulting instrument demonstrated adequate construct validity and reliability by using the many-facet Rasch measurement (MFRM) technique. MFRM results also indicated potential places to revise and improve the instrument. Recommendations for implementing the peer evaluation process of teaching are provided.

Abstract

To date, neuroanatomy education courses are still based on two-dimensional (2D) illustrations combined with cadaver dissections. To gain a more comprehensive understanding of neuroanatomy, we offered mixed reality experience using a head-mounted device (HMD) for medical students during their neuroanatomy course. This pilot study´s purpose was to determine whether or not, from a pragmatic view, the utilization of 3D VR/AR via HMD is viable in neuroanatomy courses and aimed to evaluate the feasibility of using mixed reality in neuroanatomy education and experiences with the mixed reality brain environment. A virtual model including major neuroanatomical structures was generated from a MRI dataset using computer software. Major structures were displayed and annotated in different combinations and scenes using an HMD. Along with the 3D virtual model, the original MRI was presented in a virtual form inside the HMD. Conventional 2D anatomical atlases were also used during the seminar. Thirty medical students (11 male; 19 female; average: 23.2 years) in their second year were recruited from October 2022 to February 2023 for this study via open invitation during neuroanatomy lectures. Participants were asked to wear the HMDs and to take a 2 h neurosurgery-oriented mixed reality seminar given by a neurosurgical teacher in small groups (3 per group). A questionnaire comprising five levels of options was designed and used to evaluate the feasibility/effectiveness of this seminar. The mixed reality environment, comprising virtual 3D models of major brain structures, virtual MRI, and conventional 2D anatomical graphs, was uncomplicated and feasible for neuroanatomy education of the medical students. According to our survey, all participants (30/30) strongly agreed that the 3D visualization of the spatial relationships between anatomical structures was easy to use as a meaningful supplement. Twenty-one of the participants strongly agreed and nine quite agreed that they had more interest in neuroanatomy. Eighty-seven percent of the participants were strongly satisfied with the mixed reality seminar versus conventional neuroanatomy seminars, and the other 13% were quite satisfied with the mixed reality approach. Most of the participants (20/30) strongly agreed that mixed reality helped them memorize the anatomical structures, and 9/30 participants quite agreed. Seventy-four percent of the participants agreed that immersive mixed reality is better than 3D models presented in 2D devices. Over half of the participants could wear the HMD for over 60 min (65%) without any ophthalmic discomfort, and the HMD was reported to be well tolerable (57%). Nearly three-fourths of the participants found that handling the device was extremely simple, and the other part indicated that it was quite simple. No health issues or discomfort on the forehead occurred. As a consequence, the seminar has been officially classified as an elective neuroanatomy course for second-year medical students. The use of mixed reality with HMDs to illustrate 3D brain models relevant for the neuroanatomy cadaver dissection education and described in our study was positively perceived by the medical students and demonstrated the viability of 3D AR/VR via HMD in neuroanatomy education. Future research lines are warranted to determine the usefulness of mixed reality technologies to effectively support medical students education of the complex three-dimensional brain anatomy.