Erhel and Jamet’s (2013)
This critical review utilizes a set of fifteen questions to assess Erhel and Jamet’s (2013) study on how instructional strategies (learning-focused vs. entertainment-focused) and feedback types affect learning outcomes and motivation within digital game-based learning (DGBL). These questions help assess the research problem’s clarity, educational significance, and robustness of the research design, sampling, and measurement methods.
A- Problem
- Identify the clarity with which this article states a specific problem to be explored.
Erhel and Jamet (2013) do not clearly state the specific problem they aim to explore in their study, which makes it difficult for readers to grasp the focus from the outset. Instead of presenting a direct problem statement, the authors expect readers to deduce the issue based on the general introduction and scope of the study. The research centers on the effectiveness of digital game-based learning (DGBL) and the role of instructional framing, specifically looking at how different instructional approaches affect motivation and learning outcomes. Their goal is to see if instructional framing and feedback can promote deeper learning, but this objective is not framed as a specific problem to be solved. The authors note a gap in the literature, pointing out that more research needs to be done on the impact of particular instructional strategies on learning and motivation. However, they do not present this gap as an apparent central problem, which lessens the study’s impact.
Without a well-defined problem, the practical and theoretical issues involved are not emphasized enough. The problem is also framed too broadly, as it does not focus on particular types of games or specific learning contexts, limiting the study’s depth. A more precise problem statement could have sharpened the study’s focus and led to more actionable conclusions. The vague and broad framing may make the study’s significance seem less substantial. Not having a clearly defined problem makes it harder for readers to understand the real significance of the research. By not explicitly stating the problem, the authors miss a chance to show why this study matters and what it adds to the field. A well-articulated problem statement would bring clarity and strengthen the study’s impact by making its purpose and direction more apparent. In academic research, having a clear problem statement is essential, it guides the reader and shapes the relevance of the results. Because of this, the vague approach to defining the problem weakens the overall presentation and limits the study’s potential influence. - Comment on the need for this study and its educational significance as it relates to this problem.
Erhel and Jamet’s (2013) study lacks focus and does not clearly define a research problem. They explore how instructional framing and feedback affect learning in digital game-based learning (DGBL) environments without explaining why this research is necessary or what pressing educational issues it aims to solve. The broadness of this study diminishes its educational significance. Although the authors note gaps in the literature concerning instructional strategies and their effects on motivation and learning, they fail to narrow these gaps to the specific challenges that educators face. Without a clear problem statement or targeted focus, the potential to inform practical improvements in instructional design for real-world settings is limited. Hence, the study falls short of offering actionable guidance for educators or game developers. A more precise approach could have better-addressed educators’ real-world challenges when using digital games to promote more profound learning outcomes. Consequently, the educational value is reduced, as the study does not fully meet the need for practical, targeted research in DGBL.
3. Comment on whether the problem is “researchable”? That is, can it be investigated through the collection and analysis of data?
Erhel and Jamet’s (2013) study addresses a researchable problem by exploring how instructional framing and feedback influence motivation and learning outcomes in digital game-based learning (DGBL). The study utilizes well-established research methods, such as surveys and experiments, which are effective for measuring these variables, as supported by previous research like Azevedo et al. (2010). By using controlled experiments, the study shows that their approach to data collection and analysis is feasible. However, the broad scope might limit the study’s ability to deliver specific and actionable conclusions. A more focused examination of particular types of digital games or learning contexts could have offered clearer insights. While the study provides a solid foundation, a narrower focus might enhance its practical applications for educators and instructional designers.
B- Theoretical Perspective and Literature Review
4. Critique the author’s conceptual framework.
Erhel and Jamet’s (2013) study builds on Deci and Ryan’s intrinsic motivation theory and Sweller’s cognitive load theory. However, it lacks coherence and does not integrate these theories effectively. Intrinsic motivation emphasizes engagement through enjoyable tasks. Cognitive load theory focuses on managing mental effort for optimal learning. The study needs to adequately explain how these two concepts interact in the context of DGBL, particularly how feedback might simultaneously manage cognitive load and enhance motivation.
Also, the study misses the chance to effectively incorporate feedback to reduce extraneous load and support deeper learning. It overlooks recent advancements like adaptive learning systems that could personalize feedback, making the framework less aligned with current educational practices. The study’s framework remains fragmented because it does not address how DGBL might require unique applications of these theories. A more integrated approach could have offered more robust insights and practical relevance for applying these theories to digital learning environments.
5. How effectively does the author tie the study to relevant theory and prior research? Are all cited references relevant to the problem under investigation?
In their 2013 study, Erhel and Jamet connect their digital game-based learning (DGBL) research to established theories like Deci and Ryan’s intrinsic motivation theory and Sweller’s cognitive load theory. While these theories are appropriate for the DGBL context, the authors need to fully integrate them, which leads to a somewhat fragmented framework. For example, although they discuss cognitive load, they miss an opportunity to examine how feedback could manage load and simultaneously boost motivation, which would provide a more cohesive theoretical foundation.
The literature review draws on useful references, like Azevedo et al. (2010) on self-regulation and cognitive load. However, some claims, such as “digital games are a powerful learning tool”, are not backed up with enough empirical evidence, and certain references, like Connolly et al. (2012), do not directly tie into the study’s specific focus on instructional framing and feedback. These gaps weaken the argument and make it feel less convincing. Furthermore, they leave some hypotheses unsupported. The review also repeatedly includes citations about the benefits of digital games, referencing Gee (2005), Prensky (2001), and Shaffer (2006) numerous times. Although, Erhel and Jamet cite relevant theories a more streamlined approach would help in strengthening the framework of their study and make their findings more impactful in the DGBL context.
6. Does the literature review conclude with a brief summary of the literature and its implications for the problem investigated?
Erhel and Jamet’s (2013) literature review would be clearer with a formal summary at the end. Instead, they recap key points later in the paper when discussing research gaps, like the lack of studies on how different instructional approaches and feedback affect learning outcomes and motivation. Moving this recap to the end of the literature review would create a smoother transition to the study’s focus and better connect the literature to the research objectives. This adjustment would also help clarify how the identified gaps relate to the study’s goals, especially in the absence of clearly stated research questions.
7. Evaluate the clarity and appropriateness of the research questions or hypotheses.
Research Design and Analysis
In Erhel and Jamet’s (2013) study, the absence of clearly stated research questions makes it challenging to understand the specific focus. Readers must infer the objectives, as the authors do not provide formal questions, leaving their aim somewhat vague to explore how learning-focused and entertainment-focused instructional framing and feedback affect learning outcomes and motivation in digital game-based learning (DGBL). The lack of a summary at the end of the literature review also disrupts the paper’s flow, as straightforward questions would have strengthened the study’s direction and coherence. While the study’s focus on instructional strategies and feedback in DGBL is relevant, it needs more impact due to the undefined research questions. Specific questions, such as: How do learning-focused strategies in DGBL affect motivation compared to entertainment-focused strategies? Moreover, What role does feedback play in enhancing these outcomes? It would have provided clarity and better aligned the literature review with the research goals. Incorporating hypotheses based on cognitive load and intrinsic motivation theories further bolstered the framework. Overall, without specific research questions, the study lacks focus and summarizing the literature while posing straightforward questions would have improved its clarity and organization.
8. Critique the appropriateness and adequacy of the study’s design in relation to the research questions or hypotheses.
In their 2013 study, Erhel and Jamet use a value-added experimental design to examine how learning-focused and entertainment-focused instructional approaches and feedback affect motivation and learning outcomes in digital game-based learning (DGBL). The design isolates the impact of different instructional strategies and feedback. Also, it underscores how feedback enhances learning beyond baseline conditions. While this design suits their objectives, the authors do not provide a detailed explanation for their design and choice. A more varied approach to feedback and a more precise justification for the chosen assessment tools would enhance the study’s ability to capture learning and motivation in DGBL. However, the value-added experimental design has limitations. It solely focuses on Knowledge of Correct Response (KCR) feedback and fails to explore other design types (i.e., explanatory feedback), which could offer a broader perspective. Moreover, quizzes primarily measure recall rather than deep learning.
9. Critique the adequacy of the study’s sampling methods (e.g., choice of participants) and their implications for generalizability.
In their 2013 study, Erhel and Jamet use a convenience sample of 46 undergraduate students from universities in Rennes, France. While this method is typical in educational research, they need to explain their choice and address its limitations regarding generalizability. The study’s small sample size and with participants aged 18–26, the findings are difficult to generalize beyond this group. Since the research examines how instructional framing and feedback affect motivation and learning in digital game-based learning (DGBL), the narrow sample misses out on how diverse groups, like older adults or individuals from various educational backgrounds, might respond differently. Given these limitations, the authors could have acknowledged the narrow sampling and suggested future research with a more representative group to provide deeper insights into DGBL’s impact across diverse learners.
10. Critique the adequacy of the study’s procedures and materials (e.g., interventions, interview protocols, data collection procedures).
Erhel and Jamet (2013) use adequate procedures and materials, but their study would have benefitted from clear expectations and rationale. In the study, participants explored aging-related diseases through the ASTRA multimedia learning environment, which simulated a living room. This setup worked well for studying how instructional framing and feedback affect motivation and learning. However, Erhel & Jamet (2013) do not explain some of their decisions, like using quizzes to measure recall without discussing their relevance for assessing deeper cognitive engagement. While quizzes are fine for basic recall, they do not necessarily capture deeper learning. The study also only used Knowledge of Correct Response (KCR) feedback, which limited its scope. Including other types, like explanatory feedback, might have offered more insights. Although random assignment added to the study’s validity, the lack of detail around certain procedures affected clarity. A clearer rationale and a wider range of feedback types would have allowed the study to better address its research problem.
11. Critique the appropriateness and quality (e.g., reliability, validity) of the measures used.
The study has strengths and areas of improvement in terms of procedures and materials. They used the ASTRA multimedia platform to create a structured environment. Using the ASTRA platform Erhel & Jamet (2013) explore how instructional approaches and feedback impact motivation and learning. This setup aligns with their research goals and maintains consistency across participants, which is great for ensuring solid internal validity. To measure learning and motivation, they used recall quizzes, inference questions, and a motivation questionnaire, good choices for evaluating cognitive and motivational aspects in digital game-based learning (DGBL). However, quizzes focus on recall and basic knowledge, which does not always capture deeper thinking processes.
In addition to using the Knowledge of Correct response (KCR) feedback Erhel & Jamet (2013) should have utilized explanatory or reflective feedback to broaden the field of study and offer richer insights. Tracking participants’ interactions with the digital environment in real time could have shown how they engaged with different instructional strategies in more detail. Furthermore, Erhel & Jamet (2013) do not provide any metrics on how reliable or valid the assessment tools were. Sharing more about these aspects would strengthen the study’s methodology and build more confidence in its findings. Overall, the study would benefit from a wider variety of feedback types, deeper assessment tools, and better clarity on reliability and validity, which would make the findings more robust and provide a fuller understanding of how instructional strategies and feedback influence learning and motivation in DGBL settings.
C. Interpretation and Implications of Results (about 3 pages)
12. Critique the author’s discussion of the methodological and/or conceptual limitations of the results.
Erhel & Jamet (2013) recognize several limitations in their study. First, they mention the small sample size, which limits how the generalizability of their findings. This limitation can be avoided with a larger and more diverse group of students. They also point out that the ASTRA simulation lacked interactivity, which impacts participant engagement; using more interactive games might have led to different results. Additionally, the quizzes used may not have been challenging enough to highlight differences between the instructional strategies, potentially overlooking more complex learning processes.
Erhel & Jamet (2013) could have further addressed their overreliance on Knowledge of Correct Response (KCR) feedback. Using other forms, such as explanatory feedback, may have produced different outcomes. Furthermore, the study relies on self-reported motivation surveys. This allows bias to cloud participants’ perceptions may not fully match their actual motivation levels. Exploring these aspects in more depth would have bolstered the study’s conclusions.
13. How consistent and comprehensive are the author’s conclusions with the reported results?
The conclusions drawn by Erhel and Jamet (2013) generally align with their findings. They conclude that participants in the learning-focused condition performed better on tasks requiring cognitive effort. Similarly, the conclusions about feedback are consistent with the results, showing that feedback improved performance in the entertainment-focused condition, underscoring feedback’s role in digital game-based learning (DGBL).
Inconsistencies between the results and conclusions still need to be explored. For example, participants in the entertainment-focused group unexpectedly outperformed those in the learning-focused group on specific comprehension tasks. However, this discrepancy lacks a more profound analysis or connection to existing theories. Another limitation worth noting is the over-reliance on recall-focused quizzes, which do not engage deeper learning behaviors. A more thorough exploration of these inconsistencies and broader implications would enhance the depth of the conclusions, and offer a fuller understanding of how instructional strategies and feedback can be optimized in DGBL environments.
14. How well did the author relate the results to the study’s theoretical base?
Erhel and Jamet’s (2013) study does a solid job linking its findings to established theories, though there are areas where it could be stronger. One of the study’s strengths is its use of Cognitive Load Theory. The authors explain how adding feedback in digital game-based learning (DGBL) can reduce mental effort, leading to better learning outcomes. This aligns with research by Moreno and Mayer (2005), which shows that feedback can enhance how students process and retain information in multimedia settings. The connection between lower cognitive load and improved learning supports their use of Cognitive Load Theory as a framework.
The study also effectively ties into Intrinsic Motivation Theory, citing research on how instructional methods affect both learning and motivation (e.g., Gee, 2005; Mayer & Johnson, 2010). The authors connect their findings to this work, highlighting that while entertainment-focused games can be engaging, they need clear educational feedback to foster deeper learning. This supports the idea that intrinsic motivation can be enhanced through thoughtful instructional design, which further anchors the study in established theory.
However, there are some weaknesses. In one experiment, the entertainment-focused group unexpectedly outperformed the learning-focused group on deeper learning questions, but the authors don’t fully explain this result or connect it to existing theories. A deeper discussion and reference to prior research could have offered insight into why this occurred, helping to clarify the findings. Additionally, the authors briefly mention that the learning-focused group experienced higher levels of fear of failure, which was surprising, yet they don’t explore this issue in much detail. A more thorough look at how fear of failure interacts with instructional methods, supported by additional research, would have strengthened their analysis.
In summary, while the study effectively connects many of its findings to Cognitive Load Theory and Intrinsic Motivation Theory, it could improve by addressing some unexpected results. The stronger-than-expected performance of the entertainment group, for example, would benefit from further exploration and reference to related literature. By filling these gaps, the authors could offer a more comprehensive analysis that better integrates their results with the theoretical foundation.
15. In your view, what is the significance of the study, and what are its primary implications for theory, future research, and practice?
While the Erhel and Jamet (2013) study has some limitations that need closer attention to improve its quality and reliability, it also makes valuable contributions. There are clear opportunities for further research and improvement that could build on these findings. The study offers important insights into how different types of instructional framing, affect motivation and learning in digital game-based learning (DGBL). A key takeaway is that while entertainment-focused games can engage learners, learning-focused feedback is crucial for better outcomes. This highlights the importance of instructional design and underscores the critical role that feedback plays in supporting deeper cognitive processing.
The study reinforces theories on intrinsic motivation and cognitive load, showing how instructional methods can either promote or hinder deep learning. It emphasizes that entertainment alone doesn’t lead to effective learning, aligning with theories that stress the need for active cognitive engagement. At the same time, the findings on motivation raise new questions about its role in game-based learning environments. By examining how instructional design and feedback impact cognitive engagement in digital learning, the study enhances our understanding of balancing entertainment with educational content. It also shows that well-designed feedback can reduce cognitive load and encourage deeper learning, adding value to existing theories as digital games become more common in education. Furthermore it suggests several directions for future research, such as exploring the effects of different types of feedback, like explanatory or peer feedback, on learning and motivation in DGBL. Future studies could also look into long-term knowledge retention in these environments or test other feedback types, such as immediate or reflective feedback, to see if they improve learning outcomes. Additionally, using larger, more diverse samples could make the findings applicable to a broader range of learners. Research into more interactive game environments or how personal factors like prior experience and learning styles affect DGBL outcomes could lead to more tailored approaches in educational game design.
For practical applications, the study makes it clear that simply making educational games entertaining isn’t enough for deep learning. Educators and game designers need to set clear learning goals and incorporate feedback to help learners process information effectively. Balancing fun with educational content and integrating learning-focused feedback can enhance the value of digital games, boosting both engagement and learning outcomes. Overall, the study offers significant insights and advances our understanding of DGBL, even though there’s room for refinement and further exploration. Its contributions are valuable for both research and practical use, helping shape future educational tools and showing how instructional strategies and feedback can optimize digital game-based learning. It also lays a solid foundation for future studies to explore ways to make DGBL environments even more effective.
References:
Ross, S. M., Morrison, G. R., & Lowther, D. L. (2010). Educational technology research past and present: Balancing rigor and relevance to impact school learning. Contemporary Educational Technology, 1(1), 17–35. https://doi.org/10.30935/cedtech/5959
Azevedo, R., Moos, D. C., Johnson, A. M., & Chauncey, A. D. (2010). Measuring cognitive and metacognitive regulatory processes during hypermedia learning: Issues and challenges. Educational Psychologist, 45(4), 210-223. https://doi.org/10.1080/00461520.2010.515934
Erhel, S., & Jamet, E. (2013). Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness. Computers & Education, 67, 156-167. https://doi.org/10.1016/j.compedu.2013.02.019
Kuiper, E., Volman, M., & Terwel, J. (2005). The web as an information resource in K–12 education: Strategies for supporting students in searching and processing information. Review of Educational Research, 75(3), 285-328. https://doi.org/10.3102/00346543075003285
Shapiro, A., & Niederhauser, D. (2004). Learning from hypertext: Research issues and findings. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology (2nd ed., pp. 605-620). Lawrence Erlbaum Associates.
Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9–13. https://doi.org/10.3102/0013189X032001009
Hoepfl, M. C. (1997). Choosing qualitative research: A primer for technology education researchers. Journal of Technology Education, 9(1), 47–63. https://doi.org/10.21061/jte.v9i1.a.4
Kozma, R. B. (1994). Will media influence learning? Reframing the debate. Educational Technology Research and Development, 42(2), 7–19. https://doi.org/10.1007/BF02299087