International Journal of Computer-Supported Collaborative Learning

Using generative ai as a simulation to support higher-order thinking

2 weeks 5 days ago
Abstract

In this paper, and as a tribute to our friend and collaborator Barbara White, we explore how Generative AI (GenAI) technology can create stimulating new learning environments that support complex sense-making activities. We present a case study of expert use of a chat-based generative AI tool to examine the feasibility of using human–computer collaborative interactions to support metacognition and sociometacognition, i.e., knowledge about, awareness of, and ability to regulate individual (meta) and collective (sociometa) cognition. Our questions are: (RQ1) Is it possible for human–GenAI collaborative interactions to support metacognition, and (RQ2) Is it possible for them to support sociometacognition, i.e., knowledge about, awareness of, and ability to regulate individual (meta) and collective (sociometa) cognition. Our initial findings, though limited by the exploratory, case-based methods used, indicate the promise of GenAI as a valuable social interaction and cultural simulation tool for learners to practice collective sensemaking skills. Although the limitations of chat-based GenAI technologies, including their tendency to provide definitive answers unsupported by evidence, are worth mentioning, our findings contribute to the ongoing conversations around how to develop technologies to support learners’ argumentation practices. Accordingly, this study has important implications for future research and practice on using chat-based GenAI as a partner for students to practice the knowledge and skills connected to argumentation and scientific claims, especially in larger courses or broader audiences.

Students’ use of technological tools to engage in collective mathematical proof activity

3 weeks 3 days ago
Abstract

While there are many documented approaches to using technological tools to support collaboration in remote environments, studies related to proof-based courses are overwhelmingly situated in the context of geometry. This study uses instrumental genesis theory to study how students in an introduction to proofs course operationalize the technological tools, namely Google Docs and Zoom, available to them to engage in collaborative proof activity during small group work. Results from our analysis found that students coordinate uses of different tools to develop instruments that can be used to (1) engage in collective argumentation by coordinating visual mediators and verbal communication and (2) co-construct a group solution by refining shared text. In particular, Google Docs was found to be a versatile and rich tool that supported the students’ collaborative activity and encouraged a more active approach to proof-related writing. We discuss implications of the students’ tool use on their collective mathematical proof activity.

Toward multimodal learning analytics in simulation-based collaborative learning: A design ethnography of maritime training

4 weeks 2 days ago
Abstract

Collaborative learning in high-fidelity simulators is an important part of how master mariner students are preparing for their future career at sea by becoming part of a ship’s bridge team. This study aims to inform the design of multimodal learning analytics to be used for providing automated feedback to master mariner students engaged in collaborative learning activities in high-fidelity navigation simulators. Through a design ethnographic approach, we analyze video records of everyday training practices at a simulator center in Scandinavia, exploring (a) how feedback is delivered to students during collaborative activities in full-mission simulators and (b) which sensors are needed and why they are needed for capturing the multimodal nature of professional performance, communication, and collaboration in simulation-based collaborative learning. Our detailed analysis of two episodes from the data corpus shows how the delivery of feedback during simulations consists of recurring, multidimensional, and multimodal feedback cycles, comprising instructors’ close monitoring of student’s actions to continuously assess the fit between the learning objectives and the ongoing task. Through these embedded assessments, feedback that draws on the rich semiotic resources of the simulated environment, while considering aspects of realism and authenticity, is provided. Considering the multidimensional and multimodal nature of feedback in professional learning contexts, we identify technologies and sensors needed for capturing professional performance in simulated environments.

Emergent group understanding: Investigating intersubjectivity in sociotechnical interdependencies

1 month 2 weeks ago
Abstract

Teaching with virtual worlds provides new means for collaborative learning but creates challenges for teachers in terms of IT skills. To address these challenges, we developed a teaching model for using virtual worlds in classroom practices and applied it to Minecraft in several rounds of design-based research experiments. Our conceptual framework combines ideas from software engineering (sociotechnical congruence) and social sciences (intersubjectivity and emergence). Empirically, we addressed the problem of how shared understanding evolves in computer-mediated learning activities. We video-recorded classroom activities and analyzed them using interaction analysis. The teaching model engaged the students in two interdependent processes, referred to as objects: (1) a social object (discussions) that led to a shared knowledge object (video-recorded role-play) and (2) a technology object (Minecraft buildings) for staging the role-play. Our findings include an empirical phenomenon that we call emergent group understanding, which arose from the complex social interactions between social and technology objects when Minecraft was used as a virtual world in a social studies classroom. This revealed two connected subprocesses: (1) a spontaneous act of providing information to assist learners in contextualizing their actions and interactions against a common background, and (2) setting localized goals to guide future actions and interactions. This finding extends previous research by identifying fine-grained processes of intersubjectivity that contribute to collaborative learning. More generally, our teaching model addresses the problem of balancing creative and instructional learning goals.

Collaborative Problem-Solving in Knowledge-Rich Domains: A Multi-Study Structural Equation Model

2 months 1 week ago
Abstract

Collaborative skills are crucial in knowledge-rich domains, such as medical diagnosing. The Collaborative Diagnostic Reasoning (CDR) model emphasizes the importance of high-quality collaborative diagnostic activities (CDAs; e.g., evidence elicitation and sharing), influenced by content and collaboration knowledge as well as more general social skills, to achieve accurate, justified, and efficient diagnostic outcomes (Radkowitsch et al., 2022). However, it has not yet been empirically tested, and the relationships between individual characteristics, CDAs, and diagnostic outcomes remain largely unexplored. The aim of this study was to test the CDR model by analyzing data from three studies in a simulation-based environment and to better understand the construct and the processes involved (N = 504 intermediate medical students) using a structural equation model including indirect effects. We found various stable relationships between individual characteristics and CDAs, and between CDAs and diagnostic outcome, highlighting the multidimensional nature of CDR. While both content and collaboration knowledge were important for CDAs, none of the individual characteristics directly related to diagnostic outcome. The study suggests that CDAs are important factors in achieving successful diagnoses in collaborative contexts, particularly in simulation-based settings. CDAs are influenced by content and collaboration knowledge, highlighting the importance of understanding collaboration partners’ knowledge. We propose revising the CDR model by assigning higher priority to collaboration knowledge compared with social skills, and dividing the CDAs into information elicitation and sharing, with sharing being more transactive. Training should focus on the development of CDAs to improve CDR skills.

Knowledge creation through maker practices and the role of teacher and peer support in collaborative invention projects

2 months 1 week ago
Abstract

This study analyzed collaborative invention projects by teams of lower-secondary (13–14-year-old) Finnish students. In invention projects, student teams design and make materially embodied collaborative inventions using traditional and digital fabrication technologies. This investigation focused on the student teams’ knowledge creation processes by examining how they applied maker practices (i.e., design process, computer engineering, product design, and science practices) in their co-invention projects and the effects of teacher and peer support. In our investigations, we relied on video data and on-site observations, utilizing and further developing visual data analysis methods. Our findings assist in expanding the scope of computer-supported collaborative learning (CSCL) research toward sociomaterially mediated knowledge creation, revealing the open-ended, nonlinear, and self-organized flow of the co-invention projects that take place around digital devices. Our findings demonstrate the practice-based, knowledge-creating nature of these processes, where computer engineering, product design, and science are deeply entangled with design practices. Furthermore, embodied design practices of sketching, practical experimenting, and working with concrete materials were found to be of the essence to inspire and deepen knowledge creation and advancement of epistemic objects. Our findings also reveal how teachers and peer tutor students can support knowledge creation through co-invention.

Combining Danmaku and Discussion Boards: Toward A Scalable and Sociable Environment for Mass Collaboration in MOOCs

2 months 1 week ago
Abstract

In online learning at scale, wherein instructional videos play a central role, interactive tools are often integrated to counteract passive consumption. For example, the forum or discussion board is widely used, and an emerging functionality, danmaku, which enables messages to be synchronized with video playback, has also been utilized recently. To explore how mass participation is accommodated and what categories of interaction learners implement, this study utilizes analysis of interaction and manual content analysis through learner-generated text data from two specific tools employed in a massive open online course (MOOC) setting: the discussion board (N = 739) and danmaku (N = 2435). Results of the analysis of interaction indicate that mass participation is managed differently by the tools: danmaku fosters a collective space for massive participants, while the discussion board organizes them into threaded small groups. In addition, results of the content analysis show danmaku primarily supports indirect interaction with a focus on the socio-emotional dimension, while the discussion board serves as a platform for direct discussions, particularly in the cognitive dimension. Furthermore, within the context of large-scale engagement, various levels of joint interaction, in addition to collaboration, are discerned and discussed in both socio-emotional and cognitive interactions. The findings offer insights for developing sociable and scalable socio-technical environments in computer-supported collaborative learning (CSCL), addressing emerging educational trends. Practical implications for educational design based on these findings are also discussed.

The perceptions of task cohesion in collaborative learning teams

2 months 1 week ago
Abstract

Team cohesion is critical in driving successful outcomes for teams in collaborative learning settings. It shapes team behaviour, fostering shared perceptions, group synchrony and a common goal-oriented approach. This affinity becomes evident in dynamic interactions, offering insights into team behaviour through interaction data analysis. Interpreting interaction data proves complex, hampering our understanding and insights into shared team perceptions and task cohesion development. This paper used temporal motif analysis to examine the changes in team members’ cohesive perceptions and behaviours, including task cohesion, performance outcomes, engagement and group synchrony. Trace data from an online work-integrated learning environment captured learning behaviours, while responses to a questionnaire at different stages of a study program captured task cohesion and cohesive perceptions. The findings reveal teams with strong task cohesion and high performance tend to share similar cohesive perceptions driven by interdependent interactions. Conversely, teams with different cohesion perceptions have lower interaction interdependence and poorer performance. Through analysing team interaction data, this study uncovered key insights to promote positive adjustments aligning team perceptions, enhancing collaborative learning and offering support for improved performance, engagement and synchrony among teams, ultimately benefiting learning outcomes and the cultivation of skills and competencies.

Comparing the effects of a collaboration script and collaborative reflection on promoting knowledge about good collaboration and effective interaction

2 months 2 weeks ago
Abstract

A key challenge in CSCL research is to find ways to support learners in becoming effective collaborators. While the effectiveness of external collaboration scripts is well established, there is a need for research into support that acknowledges learners’ autonomy during collaboration. In the present study, we compare an external collaboration script and a reflection scaffold to a control condition and examine their effects on learners’ knowledge about effective collaboration and on their groups’ interaction quality. In an experimental study that employed a 1× three-factorial design, 150 university students collaborated in groups of three to solve two information pooling problems. These groups either received an external collaboration script during collaboration, no support during collaboration but a reflection scaffold before beginning to collaborate on the second problem, or no support for their collaboration. Multilevel modeling suggests that learners in the reflection condition gained more knowledge about effective collaboration than learners who collaborated guided by an external collaboration script or learners who did not receive any support. However, we found no effect of the script or the reflection scaffold on the quality of interaction in the subsequent collaboration. Explorative analyses suggest that learners acquired knowledge particularly about those interactions that are required for solving information pooling tasks (e.g., sharing information). We discuss our findings by contrasting the design of the external collaboration script and the reflection scaffold to identify potential mechanisms behind scripting and collaborative reflection and to what extent these forms of support foster collaboration skills and engagement in productive interaction.

Capturing temporal pathways of collaborative roles: A multilayered analytical approach using community of inquiry

2 months 3 weeks ago
Abstract

In collaborative learning, students may follow different trajectories that evolve over time. This study used a multilayered approach to map the temporal dynamics of online problem-based learning (PBL) and the transition of students’ roles across time over a full year duration. Based on data from 135 dental students across four consecutive courses throughout a full academic year, the students’ discourses were coded based on the community of inquiry (CoI). A mixture model was used to identify students’ roles. The roles identified were leaders, social mediators, and peripheral explorer roles, and they were visualized using epistemic network analysis (ENA). Similar trajectories were identified and visualized using sequence and process mining. The results showed varying activity levels across three trajectories. Students in the active-constructive trajectory took on leadership roles, while the students in the social interactive trajectory were mostly social mediators, and the free rider trajectory showed a predominant peripheral explorer role. The students in all trajectories returned to their initial roles, showing features typical of stable collaborative dispositions. Both active trajectories (active constructive and social interactive) had very close levels of achievement, whereas the free riders demonstrated lower grades compared to their peers. This research suggests that understanding role dynamics and their evolving trajectories can help teachers better design future collaborative activities, assign roles, form groups, distribute tasks, and, more importantly, be able to support students.