Journal of Computing in Higher Education

Accessible and inclusive online learning in higher education: a review of the literature

1 week 3 days ago
Abstract

Disabled students are increasingly choosing to attend higher education. Online learning has the potential to meet the needs of disabled students in unique ways. However, questions remain about how well online learning is meeting the needs of disabled students and in what ways institutions are prepared for and actively providing students with accessible and inclusive online learning opportunities. This paper presents the results of a literature review of 91 sources focused on accessible and inclusive online learning. Themes that emerged from the literature are discussed, as are future implications for research and practice.

Exploring satisfaction of online teaching faculty from a Job Demands-Resources model perspective: the mediating roles of emotional exhaustion and motivation

1 week 4 days ago
Abstract

The purpose of this study is to investigate the structural relationship among the job demands and job resources of institutions regarding online teaching, faculty’s emotional exhaustion and autonomous motivation in online teaching, and their satisfaction in teaching. Since the pandemic, regardless of the capacities of universities where faculty work, there has been an increasing sense that the quality of online education and institutional decisions to offer more online courses and programs would be one of the most significant strategic steps for the universities. This has brought new job demands and at the same time new resources, for faculty’s work in the area of teaching. Situated in the Job Demands-Resources (JD-R) model, we collected survey data from 261 faculty members at US higher education institutions who teach online courses. The findings indicate the significant effect of job demands associated with online teaching on faculty’s emotional exhaustion. The study also highlights the mediating role of faculty exhaustion from online teaching on the relationship between job demands and satisfaction with their teaching. Moreover, emotional exhaustion mediates the relationship between job demands and motivation for online teaching. This study contributes to the current literature by sharing insights on the motivation and well-being of university faculty who face constantly changing job demands and workplaces. Implications for future research and practices to extend and apply the findings are discussed.

Academic course planning recommendation and students’ performance prediction multi-modal based on educational data mining techniques

1 week 5 days ago
Abstract

Educational Data Mining (EDM) has recently received significant attention, leading to the development of various Data Mining (DM) methodologies for extracting hidden knowledge within educational data. This knowledge is crucial for enhancing teaching methods and improving student learning experiences, ultimately contributing to better student performance and overall educational outcomes. Students confront difficulties in selecting appropriate courses and suitable departments, which is regarded as the most important factor in avoiding career failure. Predicting students’ academic performance is vital for evaluating the success of educational institutions. In this study, eleven Machine Learning (ML) algorithms and three Deep Learning (DL) algorithms namely Support Vector Classification (SVC), K-Nearest Neighbor (KNN), Logistic regression (LR), Decision tree (DT), Linear discriminant analysis (LDA), Quadratic Discriminant Analysis (QDA), Random Forest (RF), Gradient Boosting (GB), Extreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (Light GBM), Extra Trees, Deep Artificial Neural Network (DANN), Gated Recurrent Unit (GRU), and Long Short-Term Memory (LSTM), were evaluated using real dataset from the Faculty of Computers and Information Sciences (FCIS) at Mansoura University (MU). A prediction model was developed to predict students’ academic grades in upcoming courses based on their past performance, alongside a recommendation model for guiding students towards suitable courses and departments. The results demonstrate that the Support Vector Classification (SVC) model outperformed others, achieving a 78.04% multi-classification accuracy and a 75.37% F1-Score. This study underscores the potential of individual ML and DL models to predict students’ academic performance based on real dataset features.

Using digital technologies to support active and self-directed learning

3 weeks ago
Abstract

Digital technologies hold considerable promise for fostering both active and self-directed learning (SDL). However, understanding of how and to what extent educators employ them in higher education to meet this dual objective is still in its nascent stages. This study explored techno-pedagogical competencies among college educators for facilitating active and SDL. Techno-pedagogical competencies refer to the integration of technological skills with pedagogical knowledge that educators require to effectively facilitate learning with digital technologies. We also examined the educator’s perceptions of SDL involving the use of digital technologies. The research population comprised 156 educators from diverse academic disciplines across five Israeli teaching colleges. Utilizing a questionnaire, tailored for this study, and semi-structured interviews, the research reveals that the educators deployed digital technologies primarily to enhance their instructional methods and foster active learning and collaboration among students. Notably, only a limited number of the educators actively encouraged SDL by involving students in the selection and adaptation of digital tools. The interview findings revealed that their pedagogical perspectives on SDL often lacked depth and that they did not provide their students with choices. However, participants underscored the pivotal role of group and collaborative learning within digital contexts as a mechanism to foster SDL, unveiling an interesting perspective. To foster active and SDL it is vital to enhance technological skills while simultaneously fostering a pedagogical understanding of the significance of direct learners’ involvement in the use and selection of digital tools adapted to their educational needs. This dual approach is essential for the effective implementation of active and SDL methodologies within digital teaching environments.

Personalized games for computer science education in higher education: the effect of personalization feature on students’ engagement and flow state

3 weeks ago
Abstract

Extensive studies have been conducted to examine the effectiveness of the personalized games on students’ engagement and flow. However, engagement and flow were examined separately rather than concurrently in previous studies. In fact, engagement and flow are two interrelated entities and share similarities but the occurrence differs. How the interrelationship between engagement and flow impacts student learning in the personalized gaming environment has been seldomly investigated. Aiming to fill this gap, this study examined the impact of personalization on student engagement and flow concurrently within a gaming environment. The results showed that personalization had a significant impact on students’ engagement, specifically students’ focused attention. However, a significant difference in flow was not observed. Flow (primarily concentration, autotelic experience, and loss of self-consciousness) exhibited a strong correlation with engagement (primarily focused attention). The findings indicated that the personalization game feature could be used to engage students but needs to incorporate additional non-game features, such as instructional features, to promote the flow.

The impact of pedagogical agent’s emotional expression on multimedia learning: a multi-faceted perspective

3 weeks 3 days ago
Abstract

The present study conducted two experiments to investigate the impact of pedagogical agent’s emotional expression on multimedia learning from multi-faceted perspectives. Experiment 1 explored the overall impact of the pedagogical agent’s emotional expression (positive vs. neutral) on learning from a macro perspective. The positive pedagogical agent (PPA) had a smiling face and an enthusiastic voice, while the neutral pedagogical agent (NPA) displayed a neutral facial expression and a neutral voice. Sixty undergraduate students were randomly assigned to one of two conditions. Results showed that compared to NPA, PPA increased enjoyment but also induced frustration. Furthermore, it had no significant impact on intrinsic motivation or learning performance. Building on the results of Experiment 1, Experiment 2 explored the dynamic impact of the pedagogical agent’s emotional expression (positive vs. neutral) on learning processes from a micro perspective. Results showed that the dynamic impact of the pedagogical agent’s emotional expression was emotional-specific: PPA had an obvious advantage over NPA only when learners were enjoyable. However, presenting a PPA when learners were surprised could hinder learning. When learners felt frustrated and confused, PPA and NPA had their own advantages and disadvantages. Learners could benefit from both types of pedagogical agents when their emotions were neutral but disengaged from learning when they were bored. Therefore, pedagogical agents should identify learners’ emotions in real time and exhibit positive emotions on appropriate occasions.

How does task complexity affect group processes and dynamics in computer-supported collaborative learning? An analysis of structural relationships between perceived task complexity, group atmosphere, group cohesion, transactive memory

4 weeks ago
Abstract

Task complexity emerges as one of the factors affecting the computer-supported collaborative learning (CSCL) process, group dynamics, and processes. Upon reviewing the literature, it becomes apparent that there are conflicting results regarding the impact of escalating task complexity on group dynamics and collaboration processes. The lack of clear findings in the literature on how task complexity affects group processes in CSCL makes instructors uncertain about how to adjust the level of task complexity in CSCL processes. This uncertainty may lead to the negative effects of assigning tasks that are too difficult or too easy on group processes. The starting point of this research is whether giving complex tasks in CSCL improves group dynamics and collaboration. This study aimed to explore the effects of task complexity on group atmosphere, group cohesion, and the group’s transactive memory system in CSCL. One distinctive feature of this research within the educational context is the utilization of Zoom as the platform for CSCL. Although Zoom is used extensively for cooperative learning, especially after the pandemic, less research is examining its use in terms of CSCL. Zoom has been widely used due to its ease of use, high speed, and capacity, and CSCL features such as a whiteboard. However, there is a need for research in the literature regarding the collaborative learning process and outcomes using Zoom as a CSCL tool. The research was conducted on 166 university students studying in the field of computer science education. The analysis was carried out in the programming education course, which was taught with the CSCL method. Self-report scales of perceived task complexity, group atmosphere, group cohesion, and transactive memory were used in the research. Path analysis was performed in the study of the data. Research findings show that perceived task complexity greatly influences the transactive memory system. As task complexity decreases, the group's transactive memory system develops. It was seen that the transactive memory system had no effect on group cohesion, and group cohesion had a significant effect on the group atmosphere. Depending on the increase in group cohesion, the group atmosphere develops. Based on the research findings, several recommendations were provided for researchers and educators to manage the structure and processes of CSCL groups and to adjust task complexity.

Not now, maybe later: the mediating influence of techno-overload on the relationship between academic self-efficacy and procrastination

1 month ago
Abstract

The rise of online and hybrid learning in universities, especially due to the pandemic, has not only revolutionized how students learn, but also blurred the boundaries between work, school, and leisure activities because of the pervasive use of technology surrounding students in their daily lives. The purpose of this study is to investigate, using coping theory, the relationships among academic self-efficacy, academic procrastination, and techno-overload, three constructs especially crucial in the current education climate. Using a sample of 179 undergraduate students, we found that techno-overload partially mediates the relationship between academic self-efficacy and academic procrastination. This finding demonstrates that techno-overload helps further explain how academic self-efficacy is negatively associated with procrastination. Specifically, academic self-efficacy is negatively related to techno-overload which is then positively linked to procrastination. Consistent with coping theory, our findings highlight the importance of mitigating technology-related stress in order to reduce academic procrastination. Implications and future research directions are discussed.

Effect of pre-training on cognitive load and achievement in a computer-based learning environment

1 month ago
Abstract

Providing pre-training on new material can simplify complex content for learners who may need guidance to understand basic facts and organize their efforts. However, the effect of pre-training on learning outcomes is controversial because it tends to vary by context. Our aim was to investigate the effectiveness of pre-training in reducing intrinsic cognitive load and improving learning in a computer-based learning environment. Predictors of learning were also investigated. A total of 384 undergraduate students were randomly assigned to experimental conditions within a Solomon four-group design (n = 293). An additional manipulation control group (n = 91) was also included to determine the effectiveness of the current pre-training activity in improving achievement scores. Results showed significant relationships between cognitive load and achievement. Intrinsic and extraneous cognitive load were negatively correlated with performance, while germane cognitive load was positively correlated. Cognitive load explained 20% of the variance in achievement. In addition, topic interest and achievement motivation were associated with cognitive load. Interestingly, despite evidence of the usefulness of pre-training from the manipulation control group, it did not significantly affect learning gains. That is, all groups exposed to the video instruction had significantly better post-test scores, but pre-training did not make a difference between the groups. However, pre-training did appear to be somewhat effective in reducing intrinsic cognitive load. Findings underscore the importance of considering cognitive load dynamics and motivational factors in instructional design strategies aimed at optimizing learning experiences and outcomes for undergraduate students.

Community of Inquiry design decisions across disciplines

1 month 1 week ago
Abstract

This multiple case study explored the differences in online course design across disciplines using the Community of Inquiry (CoI) framework as a lens. While the CoI framework was developed to be generic, research on the CoI and disciplinary differences has called for changes to the framework, yet none of the studies have considered the instructors’ design decisions. Twelve cases were selected to represent the four disciplinary categories per Biglan’s framework (1973): hard-applied (n = 3), soft-applied (n = 3), soft-pure (n = 3), and hard-pure (n = 3); each case was a combination of instructor/teaching assistant and course, allowing us to deeply examine the course design elements and juxtapose the implemented design with the instructors’ reasoning behind their design decisions. Data sources consisted of pre-interview surveys, semi-structured interviews, and online course observations. A general case analytic strategy and a cross-case synthesis technique were employed to (a) construct case descriptions informed by the CoI framework and (b) compile and analyze patterns both within and across disciplines. The results indicated that CoI was a fit across all four disciplinary areas, regardless of instructors’ intention to purposefully design for a CoI. However, differences were observed in how indicators were applied within disciplines potentially due to differing values and emphasis of each discipline and individual instructor. This study has implications for both research and practice. Further research is needed to consider meaningful strategies for each CoI presence that are aligned with specific disciplinary practices while simultaneously updating the indicators traditionally used to represent the framework. The examples of different CoI indicators resulting from this research offer many useful possibilities for instructors to consider.

Evaluating the design of digital tools for the transition to an e-continuous assessment in higher education

1 month 2 weeks ago
Abstract

Evaluation is a crucial part of the teaching and learning process in any higher education institution and one that has gone through a deep change. This has been particularly true since the Bologna Declaration (http://www.ehea.info/page-ministerial-conference-bologna-1999, 1999) ushered in the European higher education area, with the subsequent major rise in the employment of continuous assessment methods focused on student participation. This article analyses the impact on academic performance of e-continuous assessment based on e-tests on a virtual platform as a previous step towards the substitution of the traditional evaluation system, based on a final exam, with a continuous evaluation system, prescribed as an alternative preferred by the regulations of multiple Spanish universities. Microeconometric models have been applied to a database of 250 first-year students on the Business Administration and Management course at the University of Seville (Spain). Our findings show that e-tests could prevent the risk of students dropping out and could also provide a credible predictor of students’ academic marks in the theoretical contents of the subject, but not in those of a practical or applied nature. Based on the results of this evaluation, an e-continuous assessment has been developed in the subject, which has become the majority option for students, with 90% participation, while also increasing pass rates. Moreover, the positive effect of a computing environment does not appear to be limited to the classroom, but also extends to students’ home environments. This teaching experience shows that the swift feedback that e-tools provides, especially in especially in environments of large class size such as in the class evaluated, could support instructors’ personal tutoring of students’ progress and promote a greater implementation of e-continuous assessment in Spanish higher education.

Enhancing learning from online video lectures: the impact of embedded learning prompts in an undergraduate physics lesson

1 month 2 weeks ago
Abstract

Use of online video lectures is increasingly common. However, students may struggle to self-regulate their attention and passively process the content. This study examined whether, and for whom, different types of embedded learning prompts improve student learning from video lectures. Undergraduate physics students (N = 253) watched an online, asynchronous physics lecture video as part of their course content. Students were randomly assigned to receive embedded cognitive prompts, metacognitive prompts, or a no-prompt control condition during the video, then took a quiz. A subset of students also reported perceived cognitive load after the video. Overall, students who received cognitive prompts exhibited higher quiz scores than students in the control condition. Scores in the metacognitive prompt condition did not differ from those of either other condition, demonstrating a middling effect. Perceived cognitive load did not differ between conditions. A subset of students additionally completed measures of individual differences in study approaches and metacognitive skills. Students who reported having more disorganized study approaches benefited the most from cognitive prompts. Individual differences in surface/deep processing approaches and metacognitive skills did not interact with prompt condition. These findings detail a simple intervention to increase cognitive engagement during online lectures while not increasing the reported mental effort required. These prompts may be most effective for students who otherwise have difficulty organizing their study time.

“Free selection and invitation” online peer assessment of undergraduates’ research competencies, flow, motivation and interaction in a research methods course

1 month 2 weeks ago
Abstract

This study examined and compared the effects of two types of online peer assessment, namely, “free selection and invitation” (FS&I) assessment and the commonly implemented “assigned-pair” (AP) assessment, on undergraduates’ research competencies, flow, motivation, and interaction, supported by the Cloud Classroom online learning system. Ninety-three undergraduates from a research methods course participated in this study. They were randomly divided into two groups: an FS&I group and an AP group. The two groups experienced exactly the same teaching conditions except for different online peer assessment types. The study was conducted over one semester (16 weeks). Both quantitative and qualitative methods were used to examine the effects of the two types of online peer assessment. Regarding research competencies that were represented by conceptual knowledge and research proposal, this study found that the FS&I and AP groups showed no significant difference in conceptual knowledge score, and that the FS&I group performed significantly better in the quality of research proposals than the AP group. The FS&I group also manifested higher levels of flow and motivation than the AP group. Additionally, social network analysis (SNA) revealed that the FS&I group exhibited more interactions and closer connections with peers than the AP group. These results suggest that FS&I online peer assessment is an effective scaffolding that can improve undergraduates’ research competencies, learning engagement and willingness to interact. The implications of this study are also discussed.

Digital technology adaptation and initiatives: a systematic review of teaching and learning during COVID-19

1 month 2 weeks ago
Abstract

COVID-19 dramatically influenced students’ and staff’s learning and teaching experiences and approaches to learning. While many papers examined individual experiences in the context of higher education, synthesising these papers to determine enabling and hindering influences of digital adaptation was needed to guide the next phase of online learning reforms. This study explored the main dimensions of digital technology adaptation in higher education during the COVID-19 pandemic. The consequences for student and staff experiences and what aspects should be sustained and developed were discussed in this review. A total of 90 articles (published between 1st January 2020 and 30th June 2021) were identified and analysed based on the preferred reporting items for systematic reviews and meta-analyses framework. Four dimensions (with associated sub-factors) were found to influence student and staff experiences: techno-economic; personal and psychological; teaching, learning and assessment; and social. The findings highlighted that an integrated approach, across institutional, technical platforms, and individuals would be required to sustain digital learning initiatives during the crisis time.

The impact of interactive synchronous HyFlex model on student academic performance in a large active learning introductory college design course

1 month 2 weeks ago
Abstract

HyFlex learning environments have been meeting the unique needs of students and institutions for nearly 20 years. However, it was the pandemic that gave HyFlex its widespread acceptance and application. Literature suggests that HyFlex may now be considered part of the new norm in education and therefore, further study is needed on how it affects both teaching and learning. Our flipped design thinking course leverages active learning requiring the instructor and students to interact extensively. We piloted a specific version of HyFlex we named “Interactive Synchronous HyFlex” where students can participate on a daily basis in person or synchronously online. In this specific instance of HyFlex we explore: (1) Does student academic performance differ in the HyFlex environment compared to the Face to Face only environment? And (2) Does student academic performance differ based on how they chose to participate in the HyFlex course? Data were collected for this quasi-experimental study design on overall semester grades and three significant design projects during the semester. We compared the course offered as a Face to Face only experience to the course offered as a HyFlex course enabling remote participation. Second, we parse students in the HyFlex course into two categories: those who did not participate remotely vs. those who participated remotely once or more times. Students in the HyFlex course had a significantly different grade distribution earning more A’s and more F’s than their Face to Face only counterparts. Given the positive results of the Interactive Synchronous HyFlex approach, we plan to continue implementing it in our introductory design course though we will increase our attention on the remote students as they may need additional scaffolding to be successful.

Academic dishonesty and monitoring in online exams: a randomized field experiment

1 month 2 weeks ago
Abstract

Cheating in online exams without face-to-face proctoring has been a general concern for academic instructors during the crisis caused by COVID-19. The main goal of this work is to evaluate the cost of these dishonest practices by comparing the academic performance of webcam-proctored students and their unproctored peers in an online gradable test. With this aim in mind, we carried out a randomized field experiment using a simple video surveillance system through Google Meet during an online closed-book final exam of an Introduction to Microeconomics course. Given that all conditions except for webcam monitoring were identical, differences in between-subjects scores are attributed to academic dishonesty. After controlling for potential confounding factors, including gender, academic degree, instructor, previous score and whether students were repeaters or not, we found that those students who were proctored via webcam obtained statistically significant lower scores in the final exam than those who were not using this surveillance system with a low level of invasiveness. Inspection of the potential factors behind these differences in scores suggests that the poorer performance of proctored students is more related to academic dishonesty than to reasons involving anxiety or heterogeneity factors.

Academic Communities of Engagement: exploring the impact of online and in-person support communities on the academic engagement of online learners

1 month 2 weeks ago
Abstract

Institutions of higher education are interested in supporting the academic success of their students in the most effective ways possible. Increasingly, this means engaging students in a blend of both online and in-person learning activities as well as connecting students with supportive communities in both modalities. This research explores the efforts of an institution that is trying to create positive post-secondary learning experiences for thousands of adults who have experienced significant barriers to accessing higher education through traditional routes. Students around the world are supported through both online and local, in-person communities created to support their academic engagement. In this study we used social network analysis to examine and compare the influence of both in-person and online support communities on student affective and cognitive engagement. We also compared the strength of engagement support from peers, teachers, and personal family/friend networks. We found significant differences in the strength, frequency, and type of support offered by the online and in-person aspects of the program as well as in the students’ self-reported engagement and enjoyment between the two modalities. While in-person communities in this context had the greatest impact on both blended and in-person student engagement, the online community also had a significant effect on student engagement. This research adds to the blended learning literature by illustrating that course communities are not only distinguished based on time and actors, but also by modality. Support communities that occur in blended and online contexts affect student engagement in different, and often complementary, ways.

Sentiment analysis for formative assessment in higher education: a systematic literature review

1 month 2 weeks ago
Abstract

Sentiment Analysis (SA), a technique based on applying artificial intelligence to analyze textual data in natural language, can help to characterize interactions between students and teachers and improve learning through timely, personalized feedback, but its use in education is still scarce. This systematic literature review explores how SA has been applied for learning assessment in online and hybrid learning contexts in higher education. Findings from this review show that there is a growing field of research on SA, although most of the papers are written from a technical perspective and published in journals related to digital technologies. Even though there are solutions involving different SA techniques that can help predicting learning performance, enhancing feedback and giving teachers visual tools, its educational applications and usability are still limited. The analysis evidence that the inclusion of variables that can affect participants’ different sentiment expression, such as gender or cultural context, remains understudied and should need to be considered in future developments.

Microanalytic evaluation of students’ self-regulated learning in flipped EFL instruction

1 month 2 weeks ago
Abstract

The aim of this study is to examine the development of self-regulated learning (SRL) of university students in an EFL course via Flipped classroom through a novel measurement roadmap. Microanalytic techniques were used throughout the process rather than students’ perceptions at a given moment. SRL skills scores are reported as well as sample testimonies from students as qualitative data used to explain the analytic measures. The study was conducted with 12 students studying at a public university and lasted for 6 weeks. A new system FCMWEB is designed throughout to monitor online SRL development taking Zimmerman (2008) SRL model as a basis. While the forethought phase was monitored in the online sessions and the performance and self-reflection phase were associated with the face-to-face sessions. Records from FCMWEB as microanalytic, worksheet, observation notes and self-reflection form were used as data collection tools. During the study, the sub skills of forethought phase, self-reflection phase and performance phase are analyzed and validated through students’ perspectives. The developments in the skills of the forethought and self-reflection phases were between sufficient and advanced levels. The performance phase was mostly sufficient, but also included poor and advanced levels. The results provide implications for course designers and instructors who desire to provide a better flipped classroom experience in EFL for university students.

Examining the role of computing identity in the computing experiences of women and racially minoritized undergraduates: a literature review

1 month 2 weeks ago
Abstract

This paper offers a synthesis on computing identity and the experiences of women and minoritized populations in computing and computer science in higher education. Examining computing identity and its role in the computing experiences of minoritized undergraduates can help us better understand ways to engage and support women and minoritized individuals in the computing field thus increasing participation and persistence of these groups in computing. In this article, we present a review of research literature on computing identity within the experiences of women and minoritized undergraduate students in computing. The research questions guiding this work are: (1) What research literature exists about computing identity?, (2) According to existing literature, what are the experiences of women and racially minoritized undergraduates in computing (e.g., persons who identify as Black, Hispanic/Latinx, Indigenous people)?, and (3) What theoretical frameworks are used to guide existing computing identity literature? Emergent themes include the need to focus on exposure to computing, persistence, career expectations, and engagement. While there is no consensus on a computer identity framework, there is research guided by social cognitive career theory, social identity theory, and practice theory. We conclude that computing identity, including its multiple conceptualizations, offers multiple opportunities for informing and broadening participation of minoritized populations in computing. Future research should include further conceptual exploration of computing identity.