Journal of Computing in Higher Education
2 weeks 3 days ago
In this manuscript, we explore the intersection of artificial intelligence (AI) and equitable learning in higher education, focusing on data science as a subset of AI and social justice as the core theme of equity. Our investigation sheds light on the nuanced tensions inherent in employing data science for social justice. Rooted in situated perspectives of learning and consequential learning, our study employs an instrumental case-study methodology and analysis techniques from interaction and conversation analysis. Collaborating with three undergraduate students and an urban farm, the students used data science practices to highlight inequities surrounding food justice and access to food. Our findings reveal three key tensions: (1) the undergraduates' discourse on simplicity versus complexity in utilizing data science for social justice, (2) the challenges of balancing data science with social justice imperatives, and (3) the successful application of data science by the students in their food justice project, culminating in a presentation of their findings to the farm's director. We conclude by discussing implications for research and the use of data science in social justice projects
2 weeks 4 days ago
In this study, the researchers surveyed 276 students from an undergraduate online course and analyzed 10,927 of traced behavior sessions in a learning management system. The study examined the relationship between students’ academic motivation (e.g., utility value, attainment value, intrinsic value, and self-efficacy) and their behavioral engagement in online learning. The researchers focused on both the quantity of behavioral engagement represented by the frequency of page views and the quality of behavioral engagement represented by the sequential patterns of page views. Markov Chain Model analyses revealed six unique sequential-action profiles of behavioral engagement, including Assignment-focused Profile, Dual-focused Profile on Assignment and Reading, Triangular-balanced Profile on Assignment, Reading, and Resource, Integrated Profile, Reading-focused Profile, and Assignment-focused with Planning Profile. Along with five single-action clusters (i.e., Assignment-only Profile, Reading-only Profile, Overview-only Profile, Resource-only Profile, and Overview-only Profile), the study included a total of eleven session clusters. The findings revealed nuanced relationships between motivation and various clusters of behavioral engagement in online learning.
4 weeks 1 day ago
Revealing the dynamics of collaborative engagement and its association with collaborative problem-solving (CPS) outcomes is beneficial for guiding teachers to provide adaptive support during CPS processes. Although existing research has indicated that the various dimensions of collaborative engagement influence each other over time, it remains unclear how the internal dynamics of collaborative engagement are associated with CPS outcomes. Additionally, previous studies have primarily employed manual coding to analyze collaborative engagement, which limits the exploration of the dynamic characteristics of collaborative engagement in large-scale datasets. This study aimed to investigate the internal dynamics of collaborative engagement, encompassing behavioral, cognitive, socio-emotional engagement, and their relationship with CPS outcomes. Specifically, a learning analytics method based on deep learning models was employed for the automatic detection of collaborative engagement. Subsequently, according to the results of automated detection, hidden Markov modeling was utilized to investigate the difference in the internal dynamics of collaborative engagement between high- and low-performing groups. These investigations were grounded in a dataset comprising 57,400 utterances collected from 20 groups participating in a CPS activity within a university setting. The findings showed that compared with high-performing groups, low-performing groups were more likely to become stuck in the states of "Limited Cognitive Engagement" and "Lone Neutral Participation" during CPS process. Furthermore, high-performing groups were found to transition away from the collaborative engagement state of "Cognitive Conflict with Confusion" by enhancing behavioral engagement and deepening cognitive engagement. While the low-performing groups remained trapped in the cycle between the states of "Cognitive Conflict with Confusion" and "Limited Cognitive Engagement." According to these findings, pedagogical insights and analytical implications were addressed.
1 month 1 week ago
The rapid emergence of artificial intelligence (AI) technologies is profoundly reshaping teaching and learning practices in higher education. This shift challenges traditional pedagogical approaches and increasingly requires learners to develop autonomy, adaptability, and lifelong learning skills. As this trend accelerates, it becomes essential to understand how AI-driven tools and teaching approaches are being used to promote self-determined learning. However, the use of AI technologies to support the development of lifelong learning skills in self-determined learners is still in its early stages, underscoring the need for further investigation into existing learning environments. Therefore, this scoping review investigates AI-driven tools and approaches for the development of self-determined lifelong learning skills. This is the first scoping review to present and synthesize self-determined lifelong learning skills within the implementation of AI-driven learning environments. The results suggest that AI-driven technologies predominantly develop self-determined lifelong learning skills and competencies such as learner agency, self-efficacy and capability, metacognition and reflection, responsibility, digital competence, critical thinking, collaborative learning, problem-solving, employability, and self-regulated learning but do not sufficiently draw on non-linear learning and learning how to learn skills. In addition, computational thinking, with its scarcity among other skills and competencies, holds significant promise for future research on the development of self-determined lifelong skills. University instructors, instructional designers, and future employers can draw on these insights to collaborate and integrate AI-driven technologies to enhance the development of self-determined lifelong learners.
1 month 1 week ago
This study aims to validate the mediation effects of assessment engagement and its constructs on the relationship between online rating ability and critical thinking. This study involved graduate students from a university who enrolled in the “Research Methods” course and utilized an online peer assessment system to rate the project report of each other. This study, based on social cognitive theory and self-determination theory, proposes and validates a concurrent mediation model—“online rating ability◊assessment engagement/its constructs◊critical thinking.” The findings are summarized as follows: (1) Rating ability significantly and positively influences assessment engagement, and assessment engagement significantly and positively influences critical thinking. (2) Rating ability significantly and positively influences all four assessment engagement constructs, and assessment behavioral engagement and assessment cognitive engagement significantly and positively influence critical thinking. (3) Rating ability not only significantly and directly influences critical thinking, but also simultaneously exerts a significant indirect influence on critical thinking through assessment engagement (significant indirect effect and partial mediation). (4) Rating ability can exert a significant and indirect influence on critical thinking concurrently through both assessment behavioral engagement and assessment cognitive engagement (significant indirect effect and full mediation); however, at this point, rating ability no longer significantly and directly influences critical thinking, nor does it significantly and indirectly influence critical thinking through assessment emotional engagement and assessment agentic engagement. (5) Assessment engagement exhibits a significant and partially competitive mediation effect in the influence of rating ability on critical thinking, with a substantial mediation effect size. (6) In the concurrent mediation model, assessment behavioral engagement and assessment cognitive engagement both exhibit complete and concurrent mediation effects in the influence of rating ability on critical thinking. The research results provide significant implications for academic theory and educational practices.
1 month 3 weeks ago
Centers for Teaching Excellence (CTEs) have existed for decades in US universities and provide a unique set of services focused on the growth and professional development of faculty in their institution. The purpose of this in-depth, qualitative research study is to carefully examine the organizational structure, operations, services, and assessment and evaluation of CTEs according to the directors who lead these units. We present a conceptual framework and research questions that were used to guide the creation of a semi-structured interview protocol. We interviewed n = 12 CTE directors from varied institutions of higher education and examined these data using the Constant Comparative Method (CCM) (Glaser 1965). Our findings are organized into five large themes constituting organizational structures, resource allocation and infrastructure, programs and services, and assessment and evaluation of center operations. We carefully unpack the themes for readers and discuss them in light of our findings. Implications for future research and practice are also provided.
1 month 3 weeks ago
The study employed a researcher-designed digital tool tailored to enhance student engagement with their writing performance. Through this digital tool, the researchers delved into the relationships between learner traits, including mindset, feedback orientation, and self-regulated learning repertoire, and their impact on improved engagement and student writing outcomes. The data for this study is derived from 40 students and encompasses their performance in student engagement enhancement tool, their mindset, feedback orientation, and self-regulated learning repertoires, as well as writing scores. Student engagement in writing tasks underwent analysis through open coding and axial coding of Feedback Related Episodes (FREs) extracted from booklets and Google Docs logs. Additionally, students’ mindset status, feedback orientation, and self-regulated learning repertoires were evaluated using relevant questionnaires. Writing performances were assessed using a holistic approach. Correlation and regression analyses were conducted to explore the relationship between learner factors, student engagement and writing performance. Results show significant positive correlations between writing performance and behavioral, emotional, and cognitive engagement, growth mindset, self-regulation, and feedback seeking. However, fixed mindset and feedback avoiding had non-significant correlations with writing performance. Regression analysis revealed emotional engagement as the most significant predictor of writing test performance, followed by growth mindset and cognitive engagement. These findings highlight the importance of student agentive engagement in enhancing writing skills and provide valuable insights into related factors.
1 month 3 weeks ago
While student privacy is frequently a topic of concern in studies about data-powered technologies in higher education, we still know little about handling student privacy in online proctoring systems (OPS). To better understand the challenges associated with student privacy in higher educational practice, we conducted an interview study examining various stakeholders’ understandings of privacy in OPS. We interviewed ten stakeholders–including teachers, students, and administration staff, such as the head of the department, the head of the IT department, and examination administrators–directly involved in the procurement and use of an online examination platform with proctoring features, in one of the largest universities in Scandinavia, to investigate stakeholders’ privacy perceptions, privacy concerns, privacy awareness, and perceived responsibility regarding the privacy practices of OPS. The findings show the participants perceive privacy in OPS as a seclusive and anonymous state of being, a way to control information, and an individual right. The results also point to stakeholders’ concerns regarding collecting sensitive information about the students, the possibility of information misuse, and improper access to students’ personal information. Furthermore, the study’s results identify trade-offs between the stakeholders’ concerns for privacy and the benefits of using OPS for examinations in higher education. This study underscores the need for higher education institutions to involve students and educators in procuring and deploying OPS and develop strategies for cultivating privacy awareness and responsible privacy practices. Finally, implications for developing responsible digital practices in higher education are discussed.
2 months 2 weeks ago
Indigenous community research partnerships face challenges when integrating technology into their infrastructure, and risk compromising the community’s cultural, technological, and rhetorical sovereignty. In this paper, we explore the practices that help mitigate this challenge, including making visible the technology itself and technology practices embedded in dominant research processes. We consider how technologies mediate community research partnerships and question how we overlook our understanding of and creation of technologies as designers. Drawing on empirical insights of community research across Indigenous communities, we provide guidance on technology use with values of transparency, accessibility, and relationality. From a lens of place and power, we unpack the question: How can we cultivate technology in our research practices with Indigenous communities to honor their sovereignties? By reflecting on technology in the context of community research partnerships, we acknowledge Indigenous people’s sovereignty and self-determination, heal from harmful systemic research practices through critical questioning and reflection, and rebuild relationships among multiple rich ways of knowing and being.
2 months 2 weeks ago
Digital literacy encompasses the skills needed to effectively navigate and use the digital tools and resources that are essential in today's educational landscape. Students with higher levels of digital literacy often demonstrate self-directed learning skills, enabling them to manage their study schedules and submit assignments in a timely and effective manner. Integrating digital literacy with preparation for self-directed learning is critical to fostering successful online learning experiences. Research into the impact of students' digital literacy and readiness for online learning on their self-directed learning is crucial to understanding the competencies and skills required for online education. Such competencies in learners may have unique effects, especially in specific online learning processes such as emergency remote teaching. Therefore, this study aimed to explore the potential impact of students' digital literacy on their self-directed online learning, with a particular focus on their online learning readiness. In line with the purpose of the study, a cross-sectional survey design was employed, using a structural equation modeling approach. The results showed that digital literacy has a direct and positive effect on online learning readiness. In addition, online learning readiness has a direct and positive influence on self-directed online learning. The results also highlighted that digital literacy indirectly and positively influences individuals' levels of self-directed online learning through their online learning readiness.
2 months 4 weeks ago
3 months ago
Educational Technologies (EdTech) and Technology-Enhanced Learning (TEL) are established fields of academic research with the potential to transform educational practices and outcomes. Yet, they are currently facing several problems that undermine their efficacy and relevance. In this discussion paper, we examine recurrent complaints of researchers in the field allowing us to identify four main root causes responsible for hindering the impact of the field (starting with the less serious to most serious): (4) Lack of formal methods to evaluate, give credit, share and mature prototypes, (3) The prioritization of publication and citation metrics over the acquisition of scientific knowledge that leads to the enhancement of education and learning, (2) Researchers and their lack of practical experience in the field, and (1) The absence of robust epistemological paradigms and frameworks. In this paper, we lay down the problems caused by these root causes, discuss solutions for these causes, and propose implementable steps towards these solutions.
3 months ago
Despite the benefits of collaborative learning, students often experience undesirable issues, especially in asynchronous online courses where place and time distribute group members. While the complex nature of social dynamics of asynchronous distributed learning groups warrants a comprehensive approach, there is a lack of empirical research on a holistic design to address issues related to online collaboration. This study employed design-based research and evaluated strategies and tools to address social loafing, the difficulty of regular communication, and incompatibility of group work in three iterations of design, enactment, and evaluation in graduate online courses. Cooperative game theory, social interdependence theory, and Piaget’s socio-cognitive conflict theory informed the development of design principles for collaborative learning: (1) fairness, (2) group processing, and (3) individual accountability. Achieving a perception of fairness could be more effective than individual accountability in reducing social loafing. Equal participation brought several desirable changes to group dynamics. This study provides practitioners with evidence-based strategies to facilitate productive group culture for asynchronous online collaborative learning.
3 months 1 week ago
Research on computing in higher education research has been dominated by studies on things that work (or not). While useful, the field now needs more research on authentic tech-related problems of practice and viable solutions that resolve them. This article describes one such approach: Educational Design Research (EDR). It begins with a brief portrayal of the research we have, and elaborates on the research we need now, before introducing EDR as one way to meet today’s needs. The evolutionary nature of EDR is discussed and multiple illustrations are given before a generic model is presented, together with a detailed example. Challenges are discussed as well as ways to support design researchers in facing these challenges. With the goal of increasing the relevance and robustness of scholarship in our field, the piece concludes with a call for increased use of EDR approaches.
3 months 1 week ago
This paper examines the value of embedding a systems-thinking lens in higher education research. A systems approach enables institutions to move beyond isolated interventions to explore the broader relationships and structures influencing learning and development by addressing the interconnected dimensions of people, processes, and technology. The paper emphasizes the importance of stakeholder engagement, iterative research processes, and ethical technology integration for sustainable and impactful research. Challenges such as institutional silos, power dynamics, and data ethics are discussed alongside strategies to foster inclusivity, collaboration, and adaptability in research practices. The authors present a systems-thinking framework that offers actionable recommendations and guiding research questions aligned with institutional goals and societal needs across three domains: people, processes, and technology.
3 months 1 week ago
With the globalization and innovation of digital technologies, scholars believe that the Internet generation, which lives, studies, and works in rich digital environments and ubiquitous social networks, can naturally enhance their digital literacy (DL). The study conducts a DL assessment among 511 English majors at universities in Vietnam using two types of self-developed and correlated measurement tools: subjective and objective. It tests the reliability and validity of the DL instruments and elucidates the relationship between digital self-efficacy and objective assessment. The DL instruments proved reliable and valid for assessing DL through factor analysis, structural equation modeling, and Rasch measurement. The findings indicate that, in the current educational research context, DL is a multidimensional model with four factors: digital task response; collaboration, interaction, communication, and learning safety protection; digital content creation; and digital self-learning and updating. The results of the subjective assessment demonstrate positive levels of DL and moderate levels of DL achievement. Moreover, the study finds that there is no significant difference between genders in either subjective or objective assessments; however, a noticeable disparity has been observed among students across different years in both types of assessments. Although the participants estimate that their DL is higher than their actual achievement, the gap between the results of the two types of assessment is non-significant. Furthermore, the participants’ appraisal exerts positive effects on their achievement despite the low path coefficient value. Lastly, we present certain implications for English as a foreign language (EFL) teaching and learning with technology and offer recommendations for future research.
3 months 1 week ago
Amid rapid technological advancements, it is increasingly crucial for educational technology research to move beyond a narrow focus on tools and gadgets, addressing instead the broader social and ethical challenges these technologies bring to education and human performance. Translational research, with roots in the biomedical sciences, is proposed here as a framework to bridge the gap between research findings and their practical applications, ultimately enhancing the positive societal impact of educational technology. We highlight the limitations of a technocentric approach and argue that the ethical and social implications of technology in education should take precedence, aligning research with real-world needs and problems. Key components of the translational-forward research approach, such as community engagement, collaborative problem-solving, and commitment to equity and social justice, are emphasized as essential for establishing a value-driven, learner-centered research agenda. This agenda envisions educational technology not only as a tool to improve learning outcomes but also as a means to foster social responsibility and advance equity and inclusion. Fully embracing stakeholder engagement and training future researchers in the process of translation and civic-minded approaches is essential to advancing an equitable, impactful, and socially responsible approach in educational technology research.
3 months 1 week ago
Since it was first developed in 2006, the hybrid flexible, or HyFlex, course model has been growing in prevalence in higher education. HyFlex courses are defined as those allowing students to decide whether to experience course material in person, online synchronously, or asynchronously on a weekly or daily basis without warning to, or permission from, the course’s instructor. Empirical research regarding this instructional approach is still relatively limited despite increased attention during and following the COVID-19 pandemic. Increasing interest in providing alternatives to fully in-person instruction has made it necessary to closely examine the existing body of research to determine the effectiveness of HyFlex instruction, challenges that it presents, strategies used to meet these challenges, and gaps in knowledge that must be filled by future studies. This systematic review analyzed 57 empirical studies focusing on the HyFlex course model during the last 10 years to determine its learning outcomes, challenges, beneficial technologies, instructional strategies and supports, and recommendations for future mitigation efforts.
3 months 2 weeks ago
Jacques Ellul, a 20th century French academic, is best known for his writing on technique, understood as both individual means to ends and an all-encompassing system that prioritizes efficient solutions to problems. While Ellul’s terminology is not necessarily familiar in contemporary educational technology research, it represents traditional understandings of individual tools as a subset of instructional systems and captures the field’s emphasis on finding more efficient and efficacious means of teaching and learning. However, Ellul’s writing on technique is largely skeptical, creating an opportunity for educational technology researchers to turn a more critical eye towards our emphasis on solutions to problems. This essay argues that while an increased emphasis problems over things is welcome, Ellul’s writing invites more careful consideration of what it means to solve problems. In particular, I draw on Ellul to ask three provocative questions: which problems should we solve, who should solve those problems, and is solving problems always good?
3 months 2 weeks ago
The educational technology field is at a critical juncture, facing the dual pressures of rapid technological advancement and a pressing need for research that genuinely addresses educational challenges. Despite increasing awareness of these issues, a significant amount of educational technology research remains entrenched in superficial or trend-driven inquiries, failing to tackle deeper, systemic issues. This paper critically examines the historical and institutional forces sustaining what we term “the research we don’t need,” and argues for a transformative shift toward “the research we need.” Such research must prioritize depth, long-term impact, and relevance over mere novelty or ease of publication. We outline how entrenched practices, including academic publishing standards, tenure and promotion metrics, and funding structures, contribute to a cycle that rewards superficial research. To disrupt this cycle, we propose actionable strategies to foster a research ecosystem that values substantive contributions and advocates for systemic change. Ultimately, we urge scholars, institutions, and professional organizations to embrace a collective responsibility to redefine research priorities holistically. By doing so, we can foster a field that meaningfully impacts educators, learners, and society. This is not merely a call for incremental improvements; it is a challenge to realign the field’s fundamental purpose toward more impactful, responsible, and enduring scholarship.