Instructional Science

Relying on multiple documents to answer questions is becoming common for both academic and personal inquiry tasks. These tasks often require students to explain phenomena by taking various causal factors that are mentioned separately in different documents and integrating them into a coherent multi-causal explanation of some phenomena. However, inquiry questions may not make this requirement explicit and may instead simply ask students to explain why the phenomenon occurs. This paper explores an Activity Model Hypothesis that posits students lack knowledge that their explanation should be multi-causal and how to engage in the kind of thinking needed to construct such an explanation. This experiment, conducted on a sample of eigth grade students, manipulated whether students received a short 10-min lesson on the nature of scientific explanations and multi-causal reasoning. Students who received this causal chain lesson wrote essays that were more causally complex and integrated, and subsequently performed better on an inference verification test, than students who did not receive the lesson. These results point to relatively simple changes to instructions that can provide the support students need for successful multiple-document comprehension.

Self-explanation prompts in example-based learning are usually directed backwards: Learners are required to self-explain problem-solving steps just presented (retrospective prompts). However, it might also help to self-explain upcoming steps (anticipatory prompts). The effects of the prompt type may differ for learners with various expertise levels, with anticipatory prompts being better for learners with more expertise. In an experiment, we employed extensive modelling examples and different types of self-explanations prompts to teach 78 automotive apprentices a complex and job-relevant problem-solving strategy, namely the diagnosis of car malfunctions. We tested the effects of these modelling examples and self-explanation prompts on problem-solving strategy knowledge and skill, self-efficacy, and cognitive load while learning. In two conditions, the apprentices learned with modelling examples and received either retrospective or anticipatory prompts. The third condition was a control condition receiving no modelling examples, but the respective open problems. In comparison with the control condition, modelling examples did not promote learning. However, we observed differential effects of the self-explanation prompts depending on the learner’s prior knowledge level. Apprentices with higher prior knowledge learned more when learning with anticipatory prompts. Apprentices with less prior knowledge experienced a greater increase in self-efficacy and a higher germane cognitive load when learning with retrospective prompts. These findings suggest using different self-explanation prompts for learners possessing varying levels of expertise.

Academic self-concept plays a central role in successful learning and is substantially shaped by social comparisons. Research on the so-called Big-Fish-Little-Pond Effect (BFLPE) has yielded a highly robust and generalizable pattern of negative effects of higher class/school average achievement on students’ self-concept when controlling for individual achievement. However, most BFLPE studies have not provided information about the causes behind or the mechanisms underlying the proposed effects. To address this, we used a fully immersive virtual reality (IVR) classroom to experimentally test the extent to which students recognized performance-related classroom behavior as implicit social comparison information and how these perceptions explained differences in students’ self-concepts. Participants (N = 381 sixth-grade students) experienced an authentic yet standardized IVR teaching situation with virtual classmates who exhibited different performance levels (operationalized as 20% vs. 35% vs. 65% vs. 80% of classmates raising their hands). Hand-raising behavior had a significant positive effect on students’ perceptions of the class’ performance level (d20% vs. 65% = 0.60; d20% vs. 80% = 1.24). In line with the BFLPE, results showed a negative effect of higher performing classmates on students’ situational self-concept (d20% vs. 80% = 0.30). Students’ perceptions of the class’ performance level fully explained the effect of classmates’ hand-raising behavior on students’ situational self-concept. The study’s experimental approach provided new insights into the emergence of social comparison effects in the classroom, highlighting the major role of students’ perceptions of their classmates’ performance-related behavior, and moreover demonstrated the general potential of using IVR in classroom research.

Teachers form expectations that can influence their students’ performance, and there are a variety of ways these expectations can be communicated. In the current study, we tested a novel method for communicating expectations via examples of student work—examples that contain basic, entry-level work and communicate low, but manageable expectations or examples that contain complex, advanced-level work and communicate high and challenging expectations. Across three semesters, 91 college students in a data management course completed a class assignment that involved exploratory coding activities. Prior to the assignment, students were randomly assigned to view basic or advanced examples of student work. Students assigned to the advanced-examples condition reported higher perceptions of task difficulty and frustration, but they also exhibited higher levels of performance in terms of the complexity of their own work. Results suggest that setting challenging expectations can create a desirable difficulty that ultimately benefits students’ performance in an authentic learning environment.

There is abundant research on the use of concept maps in education. However, the most notable efforts have focused on learning outcomes as a consequence of individually constructed concept mapping for science concept learning. In the less explored field of history, some studies have found positive effects of collaborative concept mapping. However, student interaction has not been analyzed. This study employed quantitative and qualitative methods based on classroom discourse analysis to examine the extent to which students engage in historical reasoning and transactive interaction when they collaboratively complete a semiempty concept map, versus when they collaboratively write a summary, about 19th-century Western imperialism.

The participants were 20 secondary education students from two history classes with an average age of 16 years. Within each class, the students were randomly assigned to the different conditions: collaborative concept mapping and collaborative summary writing. Student interaction was analyzed at two different levels: the content level and modes of co-construction. The results show that the students in the semiempty concept mapping condition engaged significantly more in causal explanation and argumentation and used more historical and metahistorical concepts in their reasoning than the students in the summary writing condition. Interaction in the semiempty concept mapping condition included a much higher percentage of utterances which denoted the convergence and integration of the knowledge contributed by the partners in the dyad. This kind of transactive interaction not only reflected co-construction but also historical reasoning.

Because of the improvement-oriented nature of peer-feedback activities, students have to deal with errors (e.g., spelling and argumentation errors) when providing and processing peer-feedback on writing assignments. Despite the central role of errors in feedback activities, it is uncertain how students deal with errors and whether the dealing with errors is affected by interpersonal perceptions. Therefore, this study explores (1) whether cognitive sub-phases are distinguishable during the process of dealing with errors and (2) the extent to which dealing with errors is affected by interpersonal perceptions. Six dyads of Dutch 11th grade students provided and processed peer-feedback on argumentative texts while thinking-aloud, and they reflected on the processes in a post-interview. The think-aloud utterances and interviews were analyzed with a mixed-methods design, using quantitative content analyses, and qualitative thematic analyses. The dealing with errors during peer-feedback provision displayed two patterns: error identification either occurred simultaneously with the decoding and often any evaluation-related thoughts lacked, or error-identification occurred as a result of an interpreting/evaluating phase. Also during peer-feedback processing, two main patterns were observable: students either knew immediately whether they agreed with feedback, or they first had to study the feedback more thoroughly. Additionally, interpersonal perceptions seemed to affect most students implicitly during feedback provision, and most students explicitly during feedback processing. As such, this study provides empirical evidence for the existence of cognitive sub-phases in the process of dealing with errors during peer-feedback activities, and portrays how these activities may be affected by interpersonal perceptions.

Promotion of students’ scientific literacy has long been and continues to be a central goal for reform efforts in science education. Although there is a great number of research conducted to evaluate student’s scientific literacy, less is known about how we can improve students’ scientific literacy through variety of scientific practices. In this study we aimed to refer to this shortcoming in the literature by examining the effect of argument driven inquiry (ADI) instructional model to promote 8th grade students’ scientific literacy. A mixed method quasi experimental design was used in this study. Sixty-seven eighth grade students from the same public school attended the study. Two intact classes were randomly assigned either in structured inquiry (SI) or ADI groups. The data sources included a Scientific Literacy Assessment (SLA) and semi-structured interviews. The results indicated that students experiencing ADI instruction scored higher on the SLA-D test and personal epistemology dimension of SLA-MB test than students experiencing SI instruction. The results propose that engaging students in meaningful scientific practices may support their scientific literacy.

Advances in graphing technologies and learning sciences pedagogy have the potential to equitably support students when exploring complex systems depicting dynamic relationships across multiple disciplinary topics in Science, Technology, Engineering, and Mathematics (STEM). We report on the cumulative impact of science units designed in a Research Practice Partnership (RPP) that leveraged Knowledge Integration (KI) pedagogy to support middle school students to generalize insights to new graph representations and science topics. Teachers across 11 schools incorporated the graph-science units into their curriculum plans. We analyzed ~ 8000 responses to validated and reliable graph-science KI assessment items administered before the first year and after one, two, or three years of instruction aligned with KI pedagogy. With random coefficient, multi-level, mixed-effect regression modeling, we analyzed performance after one-, two-, and three-years of graph-science KI instruction. We also analyzed the growth trajectories of subgroups, i.e., multilingual learners. Data suggest two years of graph-science KI instruction is needed to make significant impacts on student learning and ameliorated the disparity between students with different native language fluencies. These results illustrate the value of technology-enhanced, pedagogically aligned K-12 science instruction that is designed to support connecting diverse graph data and science knowledge comprehensively and cumulatively.

The composite instructional design PS-I combines an initial problem-solving phase (PS) with a subsequent explicit instruction phase (I). PS-I has proven effective for conceptual learning in comparison to instructional designs with the reverse order (I-PS), especially when the explicit instruction phase productively builds on students’ erroneous or incomplete (i.e., failed) solution attempts. Building on student solutions during explicit instruction may support students to integrate their intermediate knowledge (acquired during problem solving) with the newly introduced knowledge components. While these effects have been shown for learning the concept of variance in multiple studies, it remains unclear whether these effects generalize to other situations. We conducted a conceptual replication study of Loibl and Rummel (Loibl and Rummel, Learning and Instruction 34:74–85, 2014a) choosing Bayesian reasoning as target knowledge. 75 students were assigned to four conditions in a 2 × 2 design (factor 1: PS-I vs. I-PS; factor 2: instruction phase with vs. without typical student solutions). In contrast to Loibl and Rummel (2014a), we did neither find a main effect for PS-I vs. I-PS, nor for building on typical student solutions. The missing effect of PS-I can be explained by the fact that students merely activated their prior knowledge on probabilities without exploring the problem-solving space and without becoming aware of their knowledge gaps. The missing effect of building on typical student solutions can be explained by a mismatch of the solutions generated and the ones included in the explicit instruction. Therefore, building on typical student solutions did not foster an integration of students’ intermediate knowledge and the introduced knowledge components.

Comparison is an important mechanism for learning in general, and comparing two worked examples has garnered support over the last 15 years as an effective tool for learning algebra in mainstream classrooms. This study was aimed at improving our understanding of how Modified for Language Support-Worked Example Pairs (MLS-WEPs) contribute to effective mathematics learning in an ESOL (English to Speakers of Other Languages) context. It investigated a novel instructional approach to help English Learners (ELs) develop better understanding in mathematical reasoning, problem solving, and literacy skills (listening, reading, writing, and speaking). Findings suggest that MLS-WEPs not only enhanced ELs’ ability to solve algebra problems, but it also improved their written explanation skills and enabled them to transfer such skills to different mathematical concepts. Moreover, when controlling for ELs’ prior knowledge, the effectiveness of the MLS-WEPs intervention for performing and explaining calculations did not vary by their English proficiency.

We compare the scheme for educational dialogue analysis (SEDA) to the actor-network theory (ANT) for the analysis of educational dialogues. We show that ANT unearths the socio-material structure of classroom talk as networks in which human and non-human actors (texts, diagrams, instructions, etc.) exert power on each other. The application of ANT to classroom talk led us to identify (non-)dialogic networks when human actors are not subordinated (resp. subordinated) to other actors. Roles in networks are not predetermined but translated in interactions, and networks are often blackboxed, as the original process and circumstances of their creation might be ignored. We show then that the adoption of ANT (resp. SEDA) uncovers phenomena that SEDA (resp. ANT) did not identify. SEDA helps observe the co-construction of ideas and describe shifts from the dialogic to the non-dialogic but does not explain the mechanisms that lead to these shifts. ANT explains shifts from one network to another, as it conveys the change of power relations between the different actors, role of non-human actors, and shows how they shape the dynamics of networks in classroom talk. We draw from this comparison implications both for research and educational practice in dialogic education.

Peer feedback is widely applied to support peer learning and accumulating studies pointed out that feedback features directly impact its learning benefits. However, existing peer feedback studies provide limited insights into group-level peer feedback activities in authentic classrooms. This study conducted group-level peer feedback activity in social studies classrooms of a Singapore secondary school. Fourteen groups of students (N = 61, Female = 61) participated in group-level peer feedback during the computer-supported collaborative argumentation activities. Students’ collaborative argumentation and peer feedback were collected. Paired sample t-test was conducted to compare each group’s argumentation performance before and after peer feedback activity. Qualitative content analysis was implemented to identify the cognitive and affective features of peer feedback given and received by more-improvement groups and less-improvement groups. A comparison of the feature networks between two student groups revealed the effective practices of peer feedback. The results demonstrated the key role of the specific solution when student groups gave and received peer feedback apart from problem identification and general suggestions. Besides, providing peer feedback at the overall argumentation level was found to be more beneficial than a word or evidence level. When receiving feedback, the use of hedge was found to bring more group improvement than mitigation language. These findings highlight the important features of peer feedback in group-level peer feedback activities, providing insights for the design and instruction of group-level peer feedback activities in authentic classrooms.

Students’ individual characteristics influence the effectiveness of instruction and learning and, therefore, the depth of learning. This study brings forth the voices of middle school students regarding their science learning preferences through four modalities: visual, auditory, sensorimotor, and agency support. We examined the relationship between the students’ science learning preferences and three of their personal characteristics (gender, having or not having a learning disability, and level of scientific knowledge and skills). The study encompassed 305 students (166 girls) and applied a quantitative methodology employing two questionnaires: Scientific Knowledge and Skills and Learning Preferences. Analysis of variance and multiple regressions revealed that the participants favored all four learning modalities, with a significant preference for learning via visual and sensorimotor means. Girls significantly preferred learning preferences via visuals and agency support. A significant correlation was found between the level of preference for learning science via auditory means and the students’ level of scientific knowledge and skills. Hierarchical regression analysis showed a significant positive contribution of gender and preference for learning science via auditory means but no contribution of having a learning disability to the students’ level of scientific knowledge and skills. The study results show the importance of implementing multi-faceted instructional strategies to address students’ diversity and learning preferences. Our findings underscore the need for educators and policymakers to be attentive to the students’ voices when striving to narrow gaps, achieve equality among students, and elevate students’ knowledge and skills in science studies.

The purpose of the study was to investigate (a) whether the effects of hand tracing and whole-body tracing reported in the literature could be extended to adults, and (b) the relative superiority of whole-body tracing over hand tracing. Two experiments were conducted to investigate the potential effects of these two kinesthetic approaches on learning outcomes, cognitive load, and intrinsic motivation. The results of Experiment 1 revealed that hand tracing enhanced germane load contingent upon a low-to-medium level of perceived difficulty. This effect disappeared in Experiment 2 where additional measures were taken to improve treatment fidelity. The findings of Experiment 2 revealed the beneficial effects of whole-body tracing on germane load, extraneous load, interest, and self-monitoring, some of which were dependent upon learners’ perceived difficulty and invested effort. These findings, along with implications, limitations, and future research directions, were discussed within the framework of cognitive load theory and embodied cognition theory.

To investigate whether a creative writing unit in upper secondary education would improve students’ creative as well as argumentative text quality and to examine whether it would change students’ writing behavior, we tested a creative writing unit based on encouraging writing in flow by using divergent thinking tasks. Four classes (Grade 10) participated in a switching replications design. Students received either creative writing instruction (CWI) or argumentative writing instruction (AWI). Key stroke logging software recorded students’ writing processes, their Creative Self-Concept (CSC) was measured, and text quality was rated holistically. Students were positive about the design of the creative writing unit and the lessons. The effects varied per panel. The first panel showed that CWI had an effect on creative text quality compared to AWI, while AWI had no effect on argumentative text quality, compared to CWI. This pattern indicates a transfer effect of creative writing instruction on argumentative text quality. The transfer effect was moderated by CSC, with larger effects for relatively high CSC-participants. The second panel did not replicate this pattern. Instead, a crossover effect was observed of CWI in panel 1 on the effect of participating in the unit on argumentative writing in panel 2, most pronounced in high CSC-participants. Students’ creative writing speed decreased in the first panel, except for students with a relatively high Creative Self-Concept, and then increased in the second panel. Our findings may guide decisions on incorporating creative writing in the curriculum.

Creativity is a valuable skill for instructional designers. However, few studies have researched creativity in instructional design (ID) graduate courses. Future professionals' creative thinking is necessary to address societal, technological, and economic challenges. Developing creative thinking in novice instructional designers could allow them to generate creative solutions to ill-structured problems in real-world contexts. This multiple case study investigated the extent to which the nine core courses in an online instructional design master’s program encouraged creativity. We conducted a document analysis of course materials for each course, to analyze whether creativity indicators derived from creativity literature were present. Subsequently, a cross-case synthesis was used to identify patterns across the cases. Semi-structured interviews of the lead course instructors were conducted to evaluate the extent to which they deliberately included creativity concepts into the course design process. Results indicated core courses include learning activities and instructional strategies with the potential to foster creativity. However, explicit references mentioning creativity or being creative were only found in three courses. Lead instructors considered creativity an important aspect of teaching and learning and a concept that needs to be further developed and discussed in ID education. Implications for instructional design education are discussed.

Inquiry includes a broad spectrum of approaches, depending on students’ responsibility over the process and the extent of the teacher’s guidance. While numerous studies have examined students’ achievements and engagement across different types of inquiry-based environments, analyses of teachers’ guidance during the process are lacking. Therefore, our overarching goal was to examine the interplay between characteristics of the inquiry-based environment and teacher’s just-in-time support. Specifically, we examined the learning processes and achievements of middle-school students as they collaboratively engaged in either a structured or a guided inquiry-based task and were supported by their teacher. Structuring scaffolds were designed to support the structured inquiry task, while problematizing scaffolds were designed to support the guided inquiry task. Post-test scores indicated a similar significant increase in students’ scientific understanding for both research conditions, despite significant differences in students’ engagement in metacognitive processes during their scientific trials. Students from the guided inquiry group engaged in longer discussions and made more references to metacognitive processes, in comparison to students from the structured inquiry group. A low to moderate correlation between students’ engagement in metacognitive processes and test-scores was identified. The teacher’s regulation of students’ discourse in the structured inquiry group was significantly greater than in the guided inquiry group, though the nature of regulation was similar. We propose that the teacher’s regulation of students’ metacognitive discourse outweighed the differences between students’ learning processes in the two learning environments, resulting in similar achievements in the two conditions albeit differences in metacognitive engagement. Implications are discussed.

Classroom interactions emerging from socioscientific argumentation may be incompatible with the traditional definitions of learning, thus creating tension and potentially undermining its implementation. Leveraging existing literature, we identify argumentative talk that shifts away from scientific content and toward subjective claims, as well as instances of unproductive argumentation as the points of incompatibility. We contend that attention to the degree of compatibility of enactments of socioscientific argumentation with traditional schooling practices may be necessary for substantive implementation. The role of teachers’ and students’ interactional moves in relation to this compatibility is qualitatively examined using two analytical frameworks related to the content and form of the students’ arguments. To generate practical implications with empirical foundations, compatibility is examined in teacher-led and peer-led argumentation. In teacher-led argumentation, we show that the degree of incompatibility can be managed when teachers extend their elicitation of responses with follow-up interrogative questioning, leading students to rely more on scientific knowledge. In peer-led argumentation, incompatibility can be identified when the argumentation collapses into confrontational disagreement or uncritical agreement, obscuring instances in which students rely on scientific knowledge. We discuss the significance of productive talk moves as a way to advance from incompatibility with traditional schooling toward integrating socioscientific argumentation as a core instructional practice.

The present study examines the measurement property of instructional quality in mathematics education, building on data from teachers and students, by combing TALIS 2013 and PISA 2012 linkage data from seven countries. Confirmatory factor analysis was applied to examine the dimensionality of the construct instructional quality in mathematics instruction. Three dimensions were identified (i.e., classroom disciplinary climate, teacher support, and cognitive activation) when building on teacher data from TALIS. This three-dimensional model did not fit all countries. When analyzing PISA data, the same three dimensions could be identified, but two additional dimensions appeared: classroom management and student-orientated instruction. This five-dimensional factor structure reflected metric invariance across all countries. The findings imply that students and teachers seem to hold different perceptions about mathematics instructional quality reflect different dimensions. These differences seem to vary within and between countries. This implies that care should be taken when using the construct as an equivalent measure of instructional quality when studying school effectiveness in mathematics education across countries.

Productive classroom discussion has been shown to support student learning across academic domains. Facilitating successful discussion hinges on the teacher’s ability to make adept in-the-moment observations of various aspects of student talk and classroom dynamics. In two studies, we explore a pedagogical intervention using contrasting cases to support novice teachers in learning to notice key features of classroom discussion. Study 1 involves preservice teachers in a bilingual teaching methods course in a university-based credential program. Study 2 involves undergraduates in an education psychology course, many of whom are prospective teachers. Study participants engaged in analyzing transcript-based contrasting cases of discussion vignettes as they collaboratively developed guiding principles for effective class discussion. Data include pre- and post-instruction video noticing task reflections, principles identified, and transcribed partner discussions during the activity. Post-instruction, learners displayed increased student-centered noticing when watching videos of classroom discussions. Additionally, there was increased awareness of the absence of productive features or missed opportunities within the discourse. In this proof-of-concept set of studies, we explore the potential of contrasting cases-based activities to help prepare teachers for the complex task of orchestrating discussion by supporting them in learning to notice.