Introduction

Practitioners in various domains are often faced with ill-structured problems. For example, teachers devise lesson plans that consider learners’ prior knowledge, curriculum guidelines, and classroom management strategies. Similarly, engineers must develop products that meet safety standards, yet achieve project guidelines that meet client needs. Given the types of problems that practitioners face in everyday decision-making, educators have increasingly begun to adopt inquiry-based learning, which better exposes learners to the types of issues faced within a domain (Hung et al., 2019; Koehler & Vilarinho-Pereira, 2021). This instructional approach includes multiple changes to the educational experience when compared to the teacher-centric classroom approach (Reigeluth & Carr-Chellman, 2009). As opposed to a didactic strategy to instruction, students take ownership of their learning and generate questions among their peers, while teachers serve as facilitators (Lazonder & Harmsen, 2016; Loyens & Rikers, 2011; Savery, 2009). The central focus of these strategies also includes ill-structured cases that are similar to the types of problems practitioners face. The complexity of these problems often consists of interconnected variables (latent, salient) and multiple perspectives, so there is rarely a single predetermined solution that satisfies all options (Ifenthaler, 2014). Additionally, these problems are challenging because they include multiple criteria for evaluation (Jonassen, 2011b; Ju & Choi, 2017), which makes it challenging to definitively determine when a ‘right’ answer has been achieved.

There are a number of skillsets needed for problem-solving instructional strategies, such as the inquiry process (Glazewski & Hmelo-Silver, 2018), collaboration (Koehler & Vilarinho-Pereira, 2021), and argumentation  (Noroozi et al., 2017). Another important element of problem-solving includes decision-making; that is, the process by which individuals make choices as they resolve the ill-structured case. Understanding decision-making is important because individuals engage in a myriad of choices throughout the problem representation and solution generation phases of problem-solving (Ge et al., 2016). Moreover, learners must engage in multiple and interconnected decisions as they select evidence and determine causal chains during various stages of problem-solving (Shin & Jeong, 2021). The decision-making process is also closely linked with failure and the iterative choices needed to overcome errors in the problem-solving cycles (Schank et al., 1999; Sinha & Kapur, 2021). As such, decision-making is key for learners’ agency as they engage in self-directed learning and take ownership of ill-structured cases.

Despite its importance, the field of learning design only minimally addresses theories and models specifically associated with decision-making. The decision-making processes required for inquiry-based learning necessitates a more in-depth analysis because it is foundational to problem-solving as individuals weigh evidence, make strategic choices amidst an array of variables, and causal reasoning. In addition, an advanced understanding of this skill set would allow educators to develop systems that leverage specific decision-making strategies within design. Based on this gap, we survey broad decision-making paradigms (normative, descriptive, and prescriptive), along with case-based decision-making theory (Gilboa & Schmeidler, 1995; Kolodner, 1991). For each category, we then proffer an example that instantiates the theory. Finally, the article concludes with implications for practice.

Literature Review

Inquiry-based learning is an instructional strategy that affords learners with agency as they solve ill-structured problems. Although variations exist (problem-based learning, project-based learning, case-based instruction), the strategy often situates a contextual case to the learners that is representative of the domain (Lazonder & Harmsen, 2016; Loyens & Rikers, 2011). When compared with teacher-centric approaches where the instructor acts as the ‘sage on the stage’ (Reigeluth & Carr-Chellman, 2009), students in inquiry-based learning engage in a variety of learning actions in the problem representation and solution generation stage. The former necessitates learners define the problem, identify variables, and determine the underlying causal mechanisms of the issue (Delahunty et al., 2020; Ertmer & Koehler, 2018). Solution generation requires learners propose a way to resolve the issue, along with supporting evidence (Ge et al., 2016). This latter stage also includes how learners test out a solution and iterate based on the degree to which their approach meets its goals. As learners engage in these tasks, they must remedy knowledge gaps and work with their peers to reconcile different perspectives. Beyond just retention of facts, learners also engage in information seeking (Belland et al., 2020), question generation (Olney et al., 2012), causal reasoning (Giabbanelli & Tawfik, 2020; Shin & Jeong, 2021), argumentation (Ju & Choi, 2017; Noroozi & Hatami, 2019), and other higher-order thinking skills.

Another important aspect of inquiry-based learning also includes decision-making, which describes the choices learners select as they understand the problem and move towards its resolution. To that end, various theories and models that explicate the nuances of problem-solving have implicitly referenced decision-making. When describing the solution generation stage, Jonassen (1997) asserts that learners’ “resulting mental model of the problem will support the learner's decision and justify the chosen solution” (p. 81). Ge et al. (2016) proposed a conceptual model of self-regulated learning in ill-structured problem-solving in which “students not only must make informed decisions and select the most viable against alternative solutions, but also must support their decisions with defensible and cogent arguments” (p. 4). In terms of encountered failure during problem-solving, Kapur (2008) explains how students must “decide on the criteria for decision making or general parameters for solutions” (p. 391) during criteria development. Indeed, these foundation theories and models of problem-solving highlight the importance of decision-making in various aspects of inquiry-based learning.

Despite its importance, very little understanding is known within the learning design field about the specific decision-making processes inherent within problem-solving. Instead, there is a large body of literature dedicated to strategic approaches to self-directed learning (Xie et al., 2019), collaboration (Radkowitsch et al., 2020), and others. However, specific attention is needed towards decision-making to understand how learners seek out information, weigh evidence, and make choices as they engage in problem-solving. A review of theories argues for three distinct overarching theoretical paradigms of decision-making (Schwartz & Bergus, 2008): normative, descriptive, and prescriptive. There is also a related body of literature around case-based decision-making theory (Gilboa & Schmeidler, 1995), which describes how prior experiences are used to inform choices for new problems. Below we define the theory and related literature, along with a design example that instantiates the decision-making approach.

Table 1

Outline of Decision-Making Theories and Constructs

Normative Decision-Making

Normative decision-making theoretical foundations

Normative decision-making describes how learners make choices based on the following: (a) perceived subjective utility and (b) probability (Gati & Kulcsár, 2021). The former focuses on the values of each outcome, especially in terms of how the individual assesses expected benefits and costs associated with one’s goals and preferences. Alternatively, probability describes the degree to which individuals perceive that a selected action will lead to a specific outcome. Hence, a key assumption - and potential criticism - of normative decision-making is that individuals are logically consistent as they make choices under the constraints of rationality, which has been called into question.

Another important element of normative decision-making includes ‘compensatory models’; that is, how the benefits of an alternative outweigh the disadvantages. The most common compensatory model described in the literature is multi-attribute utility theory (MAUT), which is used to account for decision-making amidst multiple criteria (Jansen, 2011). MAUT thus aligns well with ill-structured problem-solving because it assumes that choices are made amongst a variety of competing alternatives. In a conservation example, one might select a green energy alternative to reduce carbon emissions, but it may be disruptive to the existing energy sources (e.g., fossil fuels) and raise costs in the short term. In the context of medicine, a surgery might ultimately resolve an issue, but it poses a risk for post-procedure infections and other complications. As individuals consider each alternative, MAUT is a way of “measuring the decision-maker’s values separately for a set of influential attributes and by weighting these by the relative importance of these attributes as perceived by the decision-maker” (Jansen, 2011, p. 101).  MAUT component of normative decision-making specifically argues individuals progress in the following five steps (Von Winterfeldt & Edwards, 1993): 

1. Individuals explicate the various alternatives and salient attributes associated with each choice.
2. Each alternative is evaluated separately based on each attribute in terms of the following: complete (all essential aspects are addressed), operational (attributes can be meaningfully used), decomposable (deconstructing aspects of evaluation as to simplify evaluation process), non-redundant (remove duplicates of aspects), and minimal (keep a number of attributes focused and central to the problem).
3. Individuals assign relative weights to each attribute
4. Individuals sum the aggregate weight to evaluate each alternative.
5. Individuals make a final choice.

Rather than pursue a less than optimal selection, MAUT argues that “they [individuals] strive to choose the most beneficial alternative and obtain all information relevant to the decision, and they are capable of considering all possible outcomes of the choice, estimating the value of each alternative and aggregating these values into a composite variable.” (Gati et al., 2019, p. 123). Another characteristic is how individuals select the factors and assess the degree to which they can be compensated. Some individuals (e.g., expert, novice) may weigh a specific factor differently, even if the other aspects align with their desired outcomes. Given that individuals are not always rational and consistent in decision-making, some argue that the normative decision-making model is not truly representative of how individuals actually engage in everyday problem-solving (Gati et al., 2019; Jansen, 2011; Schwartz & Bergus, 2008). 

Normative decision-making theoretical application

Normative decision-making approaches applied to learning design make choices and probabilities salient to the learner, such as in the case of learner dashboards (Valle et al., 2021) or heuristics. Arguably, the most common application of decision-making in learning technologies for inquiry-based learning includes simulations, which situate individuals within an authentic context and posit a series of choices, and allow them to model choices  (Liu et al., 2021). Systems that especially exhibit normative decision-making often consist of the following: (a) encourages learners to consider what is currently known about the phenomena vs. what knowledge the decision-makers lack, (b) makes probability associated with a choice clear, and (c) observes the outcomes of the decision.

One example of normative decision-making applied to design includes The Wildlife Module/Wildfire Explorer project developed by Concord Consortium. In this environment, learners are tasked with lowering wildfire risk in terms of fires and other natural hazards (see Figure 1). The decision-making is especially focused on choices around terrain and weather conditions, which add to or limit the amount of risk that is posed to each town. As learners make decisions, the interface allows individuals to manipulate variables and thus observe how certain choices will result in higher benefits relative to others. For instance, reducing the amount of brush in the area will better prevent wildfire when compared with cutting fire lines. In another instance, they explore how dry terrain and 30 mile per hour (MPH) winds would increase the potential wildfire risk of an area. The learning environment thus instantiates aspects of normative decision-making as learners select the parameters and discern its effects on the wildfire within the region.

Figure 1

Wildlife Module/Wildfire Explorer as Applying Normative Decision-Making

Descriptive Decision-Making

Descriptive decision-making theoretical foundations

Whereas the normative decision-making approaches assume individuals make rational decisions that maximize choices, descriptive decision-making illustrates the gap between optimal decision-making and how people actually make choices (Gati et al., 2019). Although it is sometimes criticized for the lack of clarity, there are some elements of descriptive decision-making that have emerged. One key component includes satisficing, which posits that individuals attempt to make decisions based on how choices are maximized and meet specific goals. As outlined in the seminal work by Simon (1972), individuals aspire to engage in complex rational selections; however, humans have limited cognitive resources available to process the information available during decision-making. Because choices for ill-structured problems often have competing alternatives, individuals settle for decisions that meet some kind of determined threshold for acceptance in light of a given set of defined criteria. The theory further argues individuals will likely choose the first option that satisfices the desire; so while the final selection may be satisficing, it may not necessarily be the best and most rational decision (Gati et al., 2019). This is especially true in ill-structured problems that include multiple perspectives and constraints that make an ideal solution difficult. Rather, individuals instead strive for a viable choice that can be justified in light of multiple criteria and constraints.

Descriptive decision-making theoretical application

One example includes the EstemEquity project (Gish-Lieberman et al., 2021), which is a learning environment designed to address attrition rates for women of color in STEM through mentorship strategies aimed at building self-efficacy. Because the dynamics of mentorship can be difficult, the system relies heavily on decision-making and reflection upon choice outcomes (see Figure 2). The first steps of a scenario outline a common mentor/mentee challenge, such as a mentee frustrated because she feels as though the mentor is not listening to her underlying problem as she navigates higher education in pursuit of her STEM career. The learning environment then poses two choices that would resolve the issue. Although no single solution will fully remedy the ill-structured mentorship challenge, they must make value judgments about the criteria for success and the degree to which their decision meets the requirements. Based on the goals, the learning environment provides feedback as to how the choice satisfices given their determined threshold of optimal mentor and mentee relationships.

Figure 2

EstemEquity as Applying Descriptive Decision-Making

Prescriptive Decision-Making

Prescriptive decision-making theoretical foundations

The aforementioned approaches highlight how individuals engage in sense-making as they make a selection among latent and salient variables. To better support ideal decision-making, the prescriptive approach is concerned with providing overt aids to make the best decisions (Divekar et al., 2012). Moreover, prescriptive decision-making “bridges the gap between descriptive observations of the way people make choices and normative guidelines for how they should make choices” (Keller, 1989, p. 260). Prescriptive decision-making thus provides explicit guidelines for making better decisions while taking into consideration human limitations. For example, physicians may use a heuristic that outlines a specific medication based on symptoms and patient characteristics (e.g., height, weight, age). Similarly, a mental health counselor may select a certain intervention approach when a client presents certain behavioral characteristics. In doing so, prescriptive decision-making outlines a series of “if-then” scenarios and details the ideal choice; that is, the pragmatic benefit of the decision to be made given a set of certain circumstances (Gati et al., 2019).

There are multiple challenges and benefits to the prescriptive approach to decision-making. In terms of the former, some question the degree to which a single set of heuristics can be applied across multiple ill-structured problems with varying degrees of nuance. That said, the prescriptive approach has gained traction in the ‘big data’ era, which compiles a considerable amount of information to make it actionable for the individual. An emerging subset of the field includes prescriptive analytics, especially in the business domain (Lepenioti et al., 2020). Beyond just presenting information, prescriptive analytics distinguishes itself because it provides the optimal solution based on input and data-mining strategies from various sources (Poornima & Pushpalatha, 2020). As theorists and practitioners look to align analytics with prescriptive decision-making, Frazzetto et al., (2019) argues: 

If the past has been understood (descriptive analytics; ‘DA’), and predictions about the future are available (predictive analytics; ‘PDA’), then it is possible to actively suggest (prescribe) a best option for adapting and shaping the plans according to the predicted future (p. 5).

Prescriptive decision-making theoretical application

Prescriptive decision-making approaches arguably are most used in adaptive tutoring systems, which outline a series of “if-then” steps based on learners’ interactions. ElectronixTutor is an adaptive system that helps learners understand electrical engineering principles within a higher educational context (see Figure 3). Rather than allowing the learner to navigate as desired or make ad-hoc selections, the recommender system leverages user input from completed lessons to prescribe the optimal lesson choice that best furthers their electrical engineering knowledge. For example, after successful completion on the “Series and Parallel Circuit” (the “if”), the system prescribes that the learner advance to the next “Amplifier” lessons (the “then”) because the system has determined that as the next stage of the learning trajectory. When a learner inputs the correct decision, they are prompted with the optimal selection the system deems as best advances their learning. Alternatively, a wrong selection constrains the choices for the learner and reduces the complexity of the process to a few select decisions. In doing so, the adaptive system implements artificial intelligence to prescribe the optimal path the learner should take based on the previous input from the learner (Hampton & Graesser, 2019).

Figure 3

Autotutor as Applying Prescriptive Decision-Making

Case-Based Decision-Making Theory

Case-based decision-making theoretical foundations

The literature suggests case-based decision-making theory (CBDMT) is another problem-solving approach individuals employ within domain practice (Gilboa & Schmeidler, 1995). The premise behind CBDMT is that individuals recall previous experiences which are similar to the extant issue and select the solution that yielded a successful resolution (Huang & Pape, 2020; Pape & Kurtz, 2013). These cases are often referred to as ‘repeated choice problems’ whereby individuals see available actions as similar between the new problem and prior experiences (Ossadnik et al., 2013). According to the theory, memory is a set of cases that consists of the following constructs: problem, a potential act chosen in the problem, and ensuing consequence. Specifically, “the memory contains the information required by the decision-maker to evaluate an act, which is specific to the problem” (Ossadnik et al., 2013, p. 213). A key element in a case-based approach to decision-making includes the problem features, the assigned weights of said features, and observed consequences as a reference point for the new problem (Bleichrodt et al., 2017).

The CBDMT approach is similar to the normative approach to decision-making in that it describes how learners make a summative approach to decision-making; however, it differs in that it explicates how one leverages prior experience to calculate these values. Moreover, the value of a case for decision-making is evaluated through a comparison of related acts of other known issues when the new problem is assessed by the individual. Specifically, Gilboa and Schmeidler (1995) propose: “Each act is evaluated by the sum of the utility levels that resulted from using this act in past cases, each weighted by the similarity of that past case to the problem at hand” (p. 605). In this instance, utility refers to the benefits of the decision being made and the forecasting of outcomes (Grosskopf et al., 2015; Lovallo et al., 2012). The individual compares the new case to a previous case and then selects the decision with the highest utility outcome. As one gains expertise, CBDMT proffers one can “combine variations in memory with variations in sets of choice alternatives, leading to generalized versions”  (Bleichrodt et al., 2017, p. 127) 

Case-based decision-making theoretical application

Because novices lack prior experiences, one might argue it may be difficult to apply CBDMT in learning design. However, the most often applied approach is by leveraging narratives as a form of vicarious experience (Jonassen, 2011a). In one example by Rong et al. (2020), veterinary students are asked to solve ill-structured problems about how to treat animals that go through various procedures. As part of the main problem to solve, learners must take into consideration the animal’s medical history, height, weight, and a variety of other characteristics. To engender learners’ problem-solving, the case profiles multiple decision points, and later asks the learners to make their own choice and justify its selection. Decision-making is supported through expert cases, which serve as vicarious memory and encourage the learners to transfer the lessons learned towards the main problem to solve (Figure 4). In doing so, the exemplars serve as key decision-making aids as novices navigate the complexity of the ill-structured problem.

Figure 4

Video Exemplars as Applying Case-Based Decision-Making Theory

Discussion and Implications for Design

Theorists of education have often discussed ways to foster various elements of ill-structured problem-solving, including problem representation (Ge et al., 2016), information-seeking (Glazewski & Hmelo-Silver, 2018), question generation (Olney et al., 2012), and others. While this has undoubtedly advanced the field of learning design, we argue decision-making is an equally foundational aspect of problem-solving that requires further attention. Despite its importance, there is very little discourse as to the nuances of decision-making within learning design and how each perspective impacts the problem-solving process. A further explication of these approaches would allow educators and designers to better support learners as they engage in inquiry-based learning and similar instructional strategies that engender complex problemsolving. To address this gap, this article introduces and discusses the application of the following decision-making paradigms: normative, descriptive, prescriptive, and CBDMT.

The above theoretical paradigms have implications for how these theories align with other design approaches of learning systems. In many instances, scaffolds are designed to support specific aspects of problem solving. Some systems are designed to support the collaborative process that occurs during inquiry-based learning (Noroozi et al., 2017), while other scaffolds outline the argumentation process (Malogianni et al., 2021). Alternatively, learning environments may embed prior narratives to model how practitioners solve problems (Tawfik et al., 2020). While each of these theories supports a critical aspect of problem solving, there are opportunities to further refine these learning systems by more directly supporting the decision-making process. For example, one way to align these design strategies and normative decision-making theories would be to outline the different choices and probabilities of expected outcomes. A learning system might embed supports that outline alternative perspectives or reflection questions, but could also include scaffolds that explicate optimal solution paths as it applies a prescriptive decision-making approach. In doing so, designers can simultaneously support various aspects of ill-structured problem solving.

There are also implications as it relates to the expert-novice continuum, which is often cited as a critical component of problem-solving (Jonassen, 2011a; Kim & Hannafin, 2008). Indeed, a body of rich literature has described differences as experts and novices identify variables within ill-structured problems (Jacobson, 2001; Wolff et al., 2021) and define the problem-space within contexts (Ertmer & Koehler, 2018; Hmelo-Silver, 2013). Whereas many post-hoc artifacts have documented outcomes that describe how novices grow during inquiry-based learning (e.g., concept map, argumentation scores), less is known about in situ decision-making processes and germane design strategies novice learners engage in when they are given problem-solving cases. For example, it may be that novices might benefit more from a prescriptive decision-making design strategy given the inherent complexity and challenges of cognitive load presented within an inquiry-based learning module. Alternatively, one might argue simulation learning environments designed for normative decision-making would make the variables more explicit, and thus better aid learners in their choice selection when presented with a case. The simulation approach often employed for normative decision-making might also allow for iterative decision-making, which may be especially advantageous for novices that are newly exposed to the domain. A further understanding of these decision-making approaches allows educators and designers to better support learners and develop systems that emphasize this higher-order learning skillset.

As learners engage in information-seeking during problem-solving, it follows that a choice is made based on the synthetization of multiple different sources (Glazewski & Hmelo-Silver, 2018). Future explorations around information seeking and decision-making would yield important insights for problem solving in multiple respects. For instance, the normative decision-making approach argues individuals assign values to various attributes and use this assessment to make a selection. As learners engage in inquiry-based learning, designers can use understanding of normative approaches to determine how individuals search for information to satisfice an opinion, use this to assess the probability of an action, and the resulting choice. From a descriptive decision-making approach, learners weigh various information sources as they seek out an answer that satisfices. Finally, a case-based decision-making theory approach may find learners search for information and related weights for the following: problem (q ∈ Q), a potential act chosen in the problem (a ∈ A), and ensuing consequence (r ∈ R).  Although the design of inquiry-based learning environments often overlooks the intersection of information-seeking approaches and decision-making, a better understanding of the role of theory would aid designers as they construct learning environments that support this aspect of problem solving.

References

Belland, B., Weiss, D. M., & Kim, N. J. (2020). High school students’ agentic responses to modeling during problem-based learning. The Journal of Educational Research, 113(5), 374–383. https://doi.org/10.1080/00220671.2020.1838407 

Bleichrodt, H., Filko, M., Kothiyal, A., & Wakker, P. P. (2017). Making case-based decision theory directly observable. American Economic Journal, 9(1), 123–151. https://doi.org/10.1257/mic.20150172 

Delahunty, T., Seery, N., & Lynch, R. (2020). Exploring problem conceptualization and performance in STEM problem solving contexts. Instructional Science, 48, 395–425. https://doi.org/10.1007/s11251-020-09515-4 

Divekar, A. A., Bangal, S., & Sumangala, D. (2012). The study of prescriptive and descriptive models of decision making. International Journal of Advanced Research in Artificial Intelligence, 1(1), 77–80. https://doi.org/10.14569/IJARAI.2012.010112 

Ertmer, P., & Koehler, A. A. (2018). Facilitation strategies and problem space coverage: comparing face-to-face and online case-based discussions. Educational Technology Research and Development, 66(3), 639–670. https://doi.org/10.1007/s11423-017-9563-9 

Frazzetto, D., Nielsen, T. D., Pedersen, T. B., & Šikšnys, L. (2019). Prescriptive analytics: a survey of emerging trends and technologies. The VLDB Journal, 28(4), 575–595. https://doi.org/10.1007/s00778-019-00539-y 

Gati, I., & Kulcsár, V. (2021). Making better career decisions: From challenges to opportunities. Journal of Vocational Behavior, 126, 103545. https://doi.org/10.1016/j.jvb.2021.103545 

Gati, I., Levin, N., & Landman-Tal, S. (2019). Decision-making models and career guidance. In J. A. Athanasou & H. N. Perera (Eds.), International handbook of career guidance (pp. 115–145). Springer International Publishing. https://doi.org/10.1007/978-3-030-25153-6_6 

Ge, X., Law, V., & Huang, K. (2016). Detangling the interrelationships between self-regulation and ill-structured problem solving in problem-based learning. Interdisciplinary Journal of Problem-Based Learning, 10(2), 1–14. https://doi.org/10.7771/1541-5015.1622 

Giabbanelli, P. J., & Tawfik, A. A. (2020). Reducing the gap between the conceptual models of students and experts using graph-based adaptive instructional systems. In C. Stephanidis (Ed.), HCI International - Late breaking papers: cognition, learning and games (pp. 538–556). Springer International Publishing. https://doi.org/10.1007/978-3-030-60128-7_40 

Gilboa, I., & Schmeidler, D. (1995). Case-based decision theory. The Quarterly Journal of Economics, 110(3), 605–639. https://doi.org/10.2307/2946694 

Gish-Lieberman, J. J., Rockinson-Szapkiw, A., Tawfik, A. A., & Theiling, T. M. (2021). Designing for self-efficacy: E-mentoring training for ethnic and racial minority women in STEM. International Journal of Designs for Learning, 12(3), 71–85. https://doi.org/10.14434/ijdl.v12i3.31433 

Glazewski, K. D., & Hmelo-Silver, C. E. (2018). Scaffolding and supporting use of information for ambitious learning practices. Information and Learning Sciences, 120(1), 39–58. https://doi.org/10.1108/ILS-08-2018-0087 

Grosskopf, B., Sarin, R., & Watson, E. (2015). An experiment on case-based decision making. Theory and Decision, 79(4), 639–666. https://doi.org/10.1007/s11238-015-9492-1 

Hampton, A. J., & Graesser, A. C. (2019). Foundational principles and design of a hybrid tutor. Adaptive Instructional Systems, 96–107. https://doi.org/10.1007/978-3-030-22341-0_8 

Hmelo-Silver, C. (2013). Creating a learning space in problem-based learning. Interdisciplinary Journal of Problem-Based Learning, 7(1). https://doi.org/10.7771/1541-5015.1334 

Huang, M., & Pape, A. D. (2020). The impact of online consumer reviews on online sales: The case-based decision theory approach. Journal of Consumer Policy, 43(3), 463–490. https://doi.org/10.1007/s10603-020-09464-y 

Hung, W., Dolmans, D. H. J. M., & van Merriënboer, J. J. G. (2019). A review to identify key perspectives in PBL meta-analyses and reviews: trends, gaps and future research directions. Advances in Health Sciences Education: Theory and Practice, 24(5), 943–957. https://doi.org/10.1007/s10459-019-09945-x 

Ifenthaler, D. (2014). Toward automated computer-based visualization and assessment of team-based performance. Journal of Educational Psychology, 106(3), 651. https://doi.org/10.1037/a0035505 

Jacobson, M. J. (2001). Problem solving, cognition, and complex systems: Differences between experts and novices. Complexity, 6(3), 41–49. https://doi.org/10.1002/cplx.1027 

Jansen, S. J. T. (2011). The multi-attribute utility method. In S. J. T. Jansen, H. C. C. H. Coolen, & R. W. Goetgeluk (Eds.), The measurement and analysis of housing preference and choice (pp. 101–125). Springer Netherlands. https://doi.org/10.1007/978-90-481-8894-9_5 

Jonassen, D. H. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology Research and Development, 45(1), 65–94. https://doi.org/10.1007/BF02299613 

Jonassen, D. H. (2011a). Learning to solve problems: A handbook for designing problem-solving learning environments (1st ed.). Routledge.

Jonassen, D. H. (2011b). Supporting problem solving in PBL. Interdisciplinary Journal of Problem-Based Learning, 5(2). https://doi.org/10.7771/1541-5015.1256 

Ju, H., & Choi, I. (2017). The role of argumentation in hypothetico-deductive reasoning during problem-based learning in medical education: A conceptual framework. Interdisciplinary Journal of Problem-Based Learning, 12(1), 1–17. https://doi.org/10.7771/1541-5015.1638 

Kapur, M. (2008). Productive failure. Cognition and Instruction, 26(3), 379–424. https://doi.org/10.1080/07370000802212669 

Kim, H., & Hannafin, M. J. (2008). Grounded design of web-enhanced case-based activity. Educational Technology Research and Development, 56(2), 161–179. https://doi.org/10.1007/s11423-006-9010-9 

Koehler, A. A., & Vilarinho-Pereira, D. R. (2021). Using social media affordances to support ill-structured problem-solving skills: considering possibilities and challenges. Educational Technology Research and Development. https://doi.org/10.1007/s11423-021-10060-1 

Kolodner, J. (1991). Improving human decision making through case-based decision aiding. AI Magazine, 12(2), 52–68. https://doi.org/10.1609/aimag.v12i2.895 

Lazonder, A., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning: effects of guidance. Review of Educational Research, 87(4), 1–38. https://doi.org/10.3102/0034654315627366 

Lepenioti, K., Bousdekis, A., Apostolou, D., & Mentzas, G. (2020). Prescriptive analytics: Literature review and research challenges. International Journal of Information Management, 50, 57–70. https://doi.org/10.1016/j.ijinfomgt.2019.04.003 

Liu, A. L., Hajian, S., Jain, M., Fukuda, M., Obaid, T., Nesbit, J. C., & Winne, P. H. (2021). A microanalysis of learner questions and tutor guidance in simulation‐assisted inquiry learning. Journal of Computer Assisted Learning. https://doi.org/10.1111/jcal.12637 

Lovallo, D., Clarke, C., & Camerer, C. (2012). Robust analogizing and the outside view: two empirical tests of case-based decision making. Strategic Management Journal, 33(5), 496–512. https://doi.org/10.1002/smj.962 

Loyens, S., & Rikers, R. (2011). Instruction based on inquiry. In R. Mayer & R. Rikers (Eds.), Handbook of research on learning and instruction (pp. 361–381). Routledge Press.

Malogianni, C., Luo, T., Stefaniak, J., & Eckhoff, A. (2021). An exploration of the relationship between argumentative prompts and depth to elicit alternative positions in ill-structured problem solving. Educational Technology Research and Development: ETR & D, 69(5), 2353–2375. https://doi.org/10.1007/s11423-021-10019-2 

Noroozi, O., & Hatami, J. (2019). The effects of online peer feedback and epistemic beliefs on students’ argumentation-based learning. Innovations in Education and Teaching International, 56(5), 548–557. https://doi.org/10.1080/14703297.2018.1431143 

Noroozi, O., Kirschner, P. A., Biemans, H. J. A., & Mulder, M. (2017). Promoting argumentation competence: Extending from first- to second-order scaffolding through adaptive fading. Educational Psychology Review, 30, 153–176. https://doi.org/10.1007/s10648-017-9400-z 

Olney, A. M., Graesser, A. C., & Person, N. K. (2012). Question generation from concept maps. Dialogue & Discourse, 3(2), 75–99. https://doi.org/10.5087/dad.2012.204 

Ossadnik, W., Wilmsmann, D., & Niemann, B. (2013). Experimental evidence on case-based decision theory. Theory and Decision, 75(2), 211–232. https://doi.org/10.1007/s11238-012-9333-4 

Pape, A. D., & Kurtz, K. J. (2013). Evaluating case-based decision theory: Predicting empirical patterns of human classification learning. Games and Economic Behavior, 82, 52–65. https://doi.org/10.1016/j.geb.2013.06.010 

Poornima, S., & Pushpalatha, M. (2020). A survey on various applications of prescriptive analytics. International Journal of Intelligent Networks, 1, 76–84. https://doi.org/10.1016/j.ijin.2020.07.001 

Radkowitsch, A., Vogel, F., & Fischer, F. (2020). Good for learning, bad for motivation? A meta-analysis on the effects of computer-supported collaboration scripts. International Journal of Computer-Supported Collaborative Learning, 15(1), 5–47. https://doi.org/10.1007/s11412-020-09316-4 

Reigeluth, C., & Carr-Chellman, A. (2009). Instructional-design theories and models: Building a common knowledge base (C. Reigeluth & A. Carr-Chellman (eds.); Vol. 3). Routledge.

Rong, H., Choi, I., Schmiedt, C., & Clarke, K. (2020). Using failure cases to promote veterinary students’ problem-solving abilities: a qualitative study. Educational Technology Research and Development, 68(5), 2121–2146. https://doi.org/10.1007/s11423-020-09751-y 

Savery, J. (2009). Problem-based approach to instruction. In C. Reigeluth & A. Carr-Chellman (Eds.), Instructional-design theories and models: Building a common knowledge base (Vol. 3, pp. 143–166). Routledge.

Schank, R., Berman, T., & Macpherson, K. (1999). Learning by doing. In C. M. Reigeluth (Ed.), Instructional-design theories and models: A new paradigm of instructional theory (1st ed., Vol. 2, pp. 241–261). Lawrence Erlbaum Associates.

Schwartz, A., & Bergus, G. (2008). Medical decision making: A physician’s guide. Cambridge University Press. https://doi.org/10.1017/CBO9780511722080 

Shin, H. S., & Jeong, A. (2021). Modeling the relationship between students’ prior knowledge, causal reasoning processes, and quality of causal maps. Computers & Education, 163, 104113. https://doi.org/10.1016/j.compedu.2020.104113 

Simon, H. A. (1972). Theories of bounded rationality. Decision and Organization, 1(1), 161–176. https://edtechbooks.org/-EUvQ 

Sinha, T., & Kapur, M. (2021). When problem solving followed by instruction works: Evidence for productive failure. Review of Educational Research, 00346543211019105. https://doi.org/10.3102/00346543211019105 

Tawfik, A. A., Schmidt, M., & Hooper, C. P. (2020). Role of conjecture mapping in applying a game-based strategy towards a case library: a view from educational design research. Journal of Computing in Higher Education, 32, 655–681. https://doi.org/10.1007/s12528-020-09251-1 

Valle, N., Antonenko, P., Valle, D., Dawson, K., Huggins-Manley, A. C., & Baiser, B. (2021). The influence of task-value scaffolding in a predictive learning analytics dashboard on learners’ statistics anxiety, motivation, and performance. Computers & Education, 173, 104288. https://doi.org/10.1016/j.compedu.2021.104288 

Von Winterfeldt, D., & Edwards, W. (1993). Decision analysis and behavioral research. Cambridge University Press.

Wolff, C. E., Jarodzka, H., & Boshuizen, H. P. A. (2021). Classroom management scripts: a theoretical model contrasting expert and novice teachers’ knowledge and awareness of classroom events. Educational Psychology Review, 33(1), 131–148. https://doi.org/10.1007/s10648-020-09542-0 

Xie, K., Hensley, L. C., Law, V., & Sun, Z. (2019). Self-regulation as a function of perceived leadership and cohesion in small group online collaborative learning. British Journal of Educational Technology, 50(1), 456–468. https://doi.org/10.1111/bjet.12594