Aconceptualproposal
Aconceptualproposal
Aconceptualproposal
net/publication/349070399
CITATION READS
1 172
2 authors:
Some of the authors of this publication are also working on these related projects:
Fondecyt regular: Caracterización de las prácticas instruccionales de la enseñanza de la comprensión de textos, en segundo ciclo de enseñanza general básica y
enseñanza media, a partir de la evidencia audiovisual de la evaluación docente. View project
All content following this page was uploaded by Cristián Silva on 06 February 2021.
A R T I C L E I N F O A B S T R A C T
Keywords: In the last decade studies on the notion of complex thinking have proliferated and there are
Metacognition several authors who propose the need of promoting it through educational systems; However,
Complex thinking there is a lack of operational conceptualization allowing the development of instruments, tasks or
Creative thinking
evaluation systems for observation or measurement, especially from the conceptual perspectives
Critical thinking
developed by Edgar Morin and Mathew Lipman, considered the most relevant and referenced
notions in the educational field. In this sense, this study aims to develop a conceptual model with
the operational definitions of skills and/or cognitive processes of complex thinking. To accom
plish this, the main proposed conceptualizations and the approach to their processes from the
cognitive sciences were reviewed. Therefore, a new conceptualization for complex thinking is
proposed through a process of synthesis and conjugation of different conceptual perspectives.
1. Introduction
There are multiple studies regarding the educational context which propose the need to develop complex thinking at all levels of
training, from basic or primary through university education (Álvarez, Pérez, & Lara, 2019; Bustamante, Ayllón, & Escanés, 2018;
Colina, 2020; Degener & Berner, 2017; Estrada, 2018; Gomero, 2019; Servín, 2020; Viguri, 2019; Yang, 2018). One of the most
frequent argument suggests that science in the midst of its rationalization must understand that there are elements that cannot be
isolated, reduced, simplified, but rather understood as systems that interact with each other and with the environment. This requires
transforming education from a less reductive, less fragmented way of thinking to one that is more flexible, more critical, more creative,
more humane and, at the same time, complementary (Martínez & Vicuña, 2017; Roger & Regalado, 2018). Nevertheless, there is no
system or instruments that enable the evaluation of complex thought from the conceptual perspectives proposed by Edgar Morin
(1990; 1999) and/or Mathew Lipman (1997), who have developed the most important definitions in this regard.
To have an evaluation system which allows the analysis of higher order cognitive aspects, such as complex thinking, can be
extremely useful for any educational system. Particularly if we consider that evaluation systems determine the practices in the
teaching-learning processes (Dziob, Kwiatkowski, & Sokolowska, 2018; López-Pastor & Sonlleva, 2019; Otero-Saborido &
Vázquez-Ramos, 2019; Subheesh & Sethy, 2020). In this context, the present study aims to elaborate a conceptual model with the
operational definitions of the cognitive processes of complex thinking, which would serve for the further design and development of
instruments, tasks or an assessment system that allows the observation and/or measurement of complex thinking skills in university
* Corresponding author.
E-mail addresses: [email protected] (C. Silva Pacheco), [email protected] (C. Iturra Herrera).
https://doi.org/10.1016/j.tsc.2021.100794
Received 15 November 2020; Received in revised form 18 January 2021; Accepted 30 January 2021
Available online 3 February 2021
1871-1871/© 2021 Elsevier Ltd. All rights reserved.
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
students. Specifically, it would be used for a subsequent empirical study that would involve the application of an assessment system to
characterize complex thinking skills in undergraduate Arts students and also to be able to compare those skills with students from other
careers. To this end, this article was structured by considering: the conceptualization of complex thinking from a review of the main
notions proposed; an approach to the cognitive processes of complex thinking from the cognitive sciences; and the proposal of a
conceptual model with the operational definitions of the processes or cognitive abilities of complex thinking.
The notion of complex thinking was coined by Morin (1990) and refers to the ability of thought to pursue multidimensional
knowledge, which integrates the simplifying modes of cognition and rejects reductionist, unidimensional and blinding consequences.
It is the process of thought that allows us to face complexity understood as the union between unity and multiplicity (Unitas Multiplex),
this implies that we cannot understand the whole (or the multiple) without knowing the parts (or the unity) and neither can we know
the parts without knowing the whole, since every phenomenon is circumscribed in an interdependent, interactive and inter-retroactive
fabric between the object of knowledge and its context. Likewise, all knowledge is part of a system and, simultaneously, each system
interacts or is interrelated to other systems. It also entails the recognition of the principle of incompleteness and uncertainty.
Recognizing a reality that is: conflictive/harmonic; peaceful/aggressive; fair/unfair; equitable/inequitable, i.e., that carries within it
the contradiction, the dialectic; the dialogic, understood as a means of dialectic-conflictive communication between different forms.
Lipman (1997) suggests that understanding complexity requires a type of thinking that integrates algorithmic and heuristic
thinking, as well as procedural thinking with the noun. The heuristic thinking would allow to reformulate complex problems and to
simplify them for their easy resolution; the one that, in turn, can be submitted to a more precise, ordered and logical procedure, from
the tools used by the algorithmic thinking, "they can be useful as error mechanisms reducers, because if they are used correctly they can
produce justifiable conclusions"(p.65). For Lipman heuristics is linked to creative thinking and the algorithmic to critical thinking. On
the other hand, procedural thinking is methodological and it would have reduced content; and substantive thinking is related to
content and it would have limited method.
Following this line, Lipman (1997) proposes a model (see Fig. 1) that serves as a guiding axis, as it allows us to approach the
cognitive processes that underlie complex thinking. This model presents more cognitive characteristics than other conceptualizations
developed by other authors. It is circumscribed to the reasoning theories proposed by Sternberg: According to Lipman, complex
thinking is higher order thinking and takes as reference the concept of “higher order thinking” proposed by Resnick (1987); In turn,
Resnick takes as a reference the theory of components of human intelligence suggested by Sternberg (1980), Sternberg and Gardner
(1983) The componential theory, in turn, is situated within the theory of analogical reasoning and the unified theory of reasoning
proposed by Sternberg himself (1986).
For Lipman, complex thinking emerges from the fusion between critical and creative thinking. He argues that "there is no such thing
as totally pure critical or creative thinking; it is precisely higher-order thinking that leads to criticism and creativity" (p.222). There is
no creative thinking that does not have critical judgments, just as there is no critical thinking sidelined from creative judgments.
Complex thinking is based on both rationality and creativity. It combines the declarative with the procedural. It produces multiple
solutions. In contrast to lower-order thinking, complex (higher-order) thinking is not reduced to the algorithmic; it is expansive, it
requires tolerance of uncertainty, it is self-critical, and, synchronously coordinates various problem-solving skills. It is multiple and
dialogical. It implies the use of multiple criteria, meta-criteria or mega-criteria and the self-regulation of the thinking process
(metacognition).
When comparing Morin and Lipman proposed notions on complex thinking, some parallels or convergences can be distinguished:
Among the main convergent aspects are thoughts that: overcome a simple, reductive and fragmentary thought; explore the
logical, multilogical and dialogical possibilities; recognize uncertainty and ambiguity; imply approaching knowledge from
2
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
multidimensional aspects; utilize interdisciplinary, multidisciplinary or transdisciplinary methods; and examine in a critical or
self-critical way their own procedures and methodologies, self-regulating their thought processes (metacognition). (Silva, 2020,
p.251)
According to Lipman, metacognition would play a key role in the cognitive processes of complex thinking.
Complex thinking is one that is aware of its own assumptions and implications, as well as the reasons and the evidence on which
its conclusions are based. Complex thinking examines its methodology, its procedures, its own perspective and point of view.
Complex thinking is ready to identify the factors that lead to bias, prejudice, and self-deception. It involves thinking about the
procedures themselves in the same way that it involves thinking about the subject. (Lipman, 1997, p.67).
What we call complex thinking here includes resource-rich, metacognitive, self-correcting thinking and all those modes of thinking
that involve reflection on the methodology itself and on the content they deal with (Lipman, 1997, p.68).
Given to these metacognitive features, it has been postulated that complex thinking is circumscribed in a higher level of compe
tences, locating it as a metacompetence (Silva, 2020). Moreover, Tarricone (2011) sets the relationship between metacognition,
critical thinking and complex thinking. She argues that metacognition would be based on critical thinking since it would involve the
monitoring and control of inferences through reasoning, knowledge, and regulation of cognition, which is at a higher level of
reflection. Under this perspective, intentional critical thinking would turn into complex thinking.
Metacognition relies on critical thinking which involves monitoring and the control of inferences through reasoning, and
knowledge of cognition and regulation of cognition. It is important to note that critical thinking may not always be meta
cognitive; to be metacognitive, it must be purposeful and deliberate re‾ection. Both metacognition and critical thinking rely
upon an internal dialectic for the critiquing of prior knowledge and the understanding of new knowledge. Internal dialectic or
internal verbalisation is stimulated in collaborative situations where beliefs, judgments, prior knowledge and understandings,
and the interpretation of new information are challenged and supported. This occurs in complex problem solving and relies
upon a higher level of re‾ection which brings into play advanced understanding of self. This purposeful, critical thinking be
comes complex thinking, or higherorder thinking, which involves a focus on awareness of issues such as selfdeception, bias and
prejudice which can affect problem solving. Higherorder thinking is a combination of critical and creative thinking and is
considered to be complex thinking. (Tarricone, 2011, p.42)
The aforementioned suggests that there are three main cognitive processes involved in complex thinking: critical thinking, creative
thinking, and metacognition. The complementarity and interdependence of these cognitive processes would make complex thinking
possible. An evidence that could support this idea comes from the cognitive sciences. A relationship between creative or divergent
thinking and metacognition has been found metacognition (Ellamil, Dobson, Beeman, & Christoff, 2012; Fox & Christoff, 2014; Preiss,
Ibaceta, Ortiz, Carvacho, & Grau, 2019; Sanz de Acedo Lizarraga & Sanz de Acedo Baquedano, 2013; Van de Kamp, Admiraal, van Drie,
& Rijlaarsdam, 2015). Preiss et al. (2019) claim that metacognition predicts creativity. Zhang, Bohemia, and McCardle (2019)
postulate that people with a high level of metacognition are able to solve problems more creatively. Fox and Christoff (2014) propose
that creative evaluation depends on metacognition, since the optimal creative process would rely on metacognitive evaluation.
Furthermore, they argue that the default network, which is considered a traditional metacognitive brain region, is also involved in
creative processes and divergent thinking. They refer to a study where a simultaneous recruitment of metacognitive brain and network
regions in predetermined mode was found during the creative assessment process: “Three metacognitive regions—RLPFC, RMPFC, and
the anterior insula—were specifically identified as being part of metacognitive creative evaluation” (p.304). Other research indicates
that the frontal regions of the cerebral cortex (frontal cortex or frontal lobes) play an important role in metacognition (Allen et al.,
2017; Fleming, Huijgen, & Dolan, 2012; Hulbig, 2020). Imaging studies have identified that the prefrontal cortex (PFC) is specifically
involved in metacognitive aspects such as self-regulation, judgment, planning, and conscious behavior (Hulbig, 2020).
This is connected to the findings of Beaty et al. (2018; 2020), who argue that the Default mode network interferes with the processes
of divergent thinking and creative thinking alongside the Salience and Executive Control networks. It also links to another study where
they found that creativity involves the left dorsolateral prefrontal cortex (DLPFC) and the right lower frontal gyrus (IFG) (Chen, Beaty,
& Qiu, 2020). Beaty et al. (2018) postulate that in high creativity there is a dynamic coupling between these three neural networks
(default, salience and executive), suggesting that this coupling may be a reliable neural marker and predictor of creative ability.
Specifically, we found that the regions showing the greatest number of significantly correlated functional connections corre
sponded to the hubs of three largescale brain networks: default (posterior cingulate cortex), executive (right dorsolateral
prefrontal cortex), and salience (left anterior insula). These regions showed increased functional connectivity in a recent fMRI
study of divergent thinking (Beaty et al., 2018, p.1090).
Default network activity is associated with spontaneous and self-generated thinking, mental wandering, mental simulation, social
cognition, autobiographical retrieval, and episodic future thinking. The salience network works to identify candidate ideas (potentially
useful information generated through the default network). The executive network comprises the lateral and anteroinferior prefrontal
parietal regions, and it associated with cognitive processes that require externally directed attention, working memory, and high-order
processing, such as the evaluation, elaboration, or revision of ideas (Beaty, Benedek, Silvia, & Schacter, 2016). The coupling of these
neural networks is a relevant finding because it is an unusual feature, as these networks usually work separately; generally, the default
network is activated when the brain is at rest, rambling or imagining and is deactivated in a state of cognitive attention and/or when
3
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
2. Method
A systematic search of published articles was carried out which included the review of the following databases: Web of Science,
Scopus, ScienceDirect, Scielo and Latindex. Digitized books and doctoral theses were also reviewed online. Regarding the search and
selection criteria, the terms "complex thinking", "critical thinking", "creative thinking" and "metacognition" were used in isolation and
in conjunction with terms "definition", "education", "university education" and/or studies that related two or more of the aforemen
tioned terms. Their presence was sought in: a) original articles, b) with search terms in title, abstract and/or keywords, c) published in
English or Spanish, d) and without time limitations. Additionally, references from articles, books and doctoral theses were reviewed to
identify other authors and/or articles that were important in this review process.
The literature search and selection was applied in accordance with the preferred report elements for systematic reviews and meta-
analyzes (Moher, Liberati, Tetzlaff, Altman, & Group, 2010). Studies describing definitions or conceptualizations, models, relation
ships between different cognitive processes (complex, critical, creative thinking and meta-cognition) and relationships with associated
assessment systems were included. Experimental studies that developed and proposed new conceptualizations or evaluation systems
for some of the aforementioned cognitive processes were also included. The excluded articles corresponded to purely methodological
studies (validation of instruments, tasks or evaluation systems, etc.), which lacked a development of conceptualizations, definitions or
theoretical models associated with these cognitive processes.
2.3. Analysis
The Meta-synthesis methodology of the "theoretical construction" type was used, as it is an ideal systematic guide that allows the
clarification of concepts, patterns and results for the refinement of existing knowledge and the emergence of new models and theories
(Carrillo-González, Gómez-Ramírez, & Vargas-Rosero, 2007; Finfgeld, 2003). For the analysis of information, the intertextual reading
and analysis method was used (Genette, 1989; Kristeva, 1988), which served to recapitulate the main ideas of the different texts and to
synthesize the information that allowed to generate the proposed model.
4
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
3. Results
3.1. A conceptual model and operational definitions of the cognitive processes of complex thinking
Based on what has been previously developed, the following conceptual model is outlined and proposed, integrated by the different
cognitive processes and skills linked to complex thinking (see Fig. 2).
This model is shaped by three main cognitive processes: critical thinking, creative thinking and metacognition; and the skills/
indicators that result from each of these main processes. This model derives from Lipman’s proposal, but with some variants, such as
the inclusion of metacognition as one of the main cognitive processes of complex thinking. Although Lipman already emphasized the
importance of metacognition, he had not included it among the main processes of his model. Our proposal includes it because it would
be supported by several investigations developed from the cognitive sciences that establish that metacognition is a process inde
pendent of other processes, such as critical or creative thinking, however, it would be related or interrelated to these cognitive pro
cesses, as we previously reviewed. The inclusion of cognitive skills or sub-processes is proposed from the review, contrast and synthesis
of the different conceptualizations related to the main processes, establishing similarity or relationship with Lipman and Morin’s
conceptual proposals. The definitions for each of the main cognitive processes are set out below.
5
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
measure this competence, the Watson-Glaser Critical Thinking Appraisal Test, which assesses the following skills: inference, recog
nition of assumptions, deduction, interpretation of information and evaluation of arguments. Both Lipman and Watson & Glaser agree
on the importance of making judgments about certain things, qualities or specific contexts and on the use of criteria, such as inference
and deduction.
Recent studies have proposed some variants, extending the skills that compose it, such as: the ability to infer, analyze, synthesize,
suppose, argue, evaluate, the process of conceptualizing, interpreting and applying information to solve a problem, making statements
supported by evidence, making decisions, finding an answer to a certain question or reaching conclusions, and the capacity for dia
logue (El Soufi & See, 2019; Shavelson, Zlatkin-Troitschanskaia, Beck, Schmidt, & Marino, 2019; Silva, 2019; Rahardjoni, Hasanah, &
Nugraheni, 2020).
The definition we propose for critical thinking within this model of complex thought is as follows: ability to interpret and un
derstand information from some text, discourse or fact and judge the proposed conclusions; ability to draw judgements or conclusions
from certain facts, propositions or principles, whether general or particular, observed or assumed, and to discriminate between the
degrees of truth or falseness of inferences drawn from certain data or given information; dialogical ability to distinguish and evaluate
the strengths and weaknesses of opposing arguments or perspectives in order to arrive at consensual interpretations or better argued
solutions to specific problems; and ability to make informed judgements on particular issues through the use of criteria
3.1.3. Metacognition
the American epistemologist and psychologist John Flavell (1976), who proposed the first definition of metacognition, developed
extensive studies and provided the first classifications of the metacognitive process. He postulated that metacognition refers to one’s
knowledge of one’s own cognitive processes and products or anything related to them, for example, the properties of information or
data relevant to learning. Among other things, it also refers to the active monitoring and consequent regulation and orchestration of
these processes in relation to the cognitive objects or the data they contain, generally in the service of a specific objective. This
definition has remained almost unchanged by the most authors who have approached metacognition so far, who agree that it is
classified in two main aspects: knowledge of cognition and regulation of cognition (Anderson, 2008; Brown, 1987; Ozturk, 2017;
Tarricone, 2011).
For our model we have considered the definition proposed by Tarricone (2011) in her Taxonomy of Metacognition because it is the
one that best fits the theoretical construct proposed for complex thinking, considering that the same author links her proposal of
metacognition with the notion of complex thinking. From this author’s perspective, metacognition refers to knowing and regulating
the processes of cognition, including metacognitive experiences. We also propose to add a new component, extracted from the notion
proposed by Lipman, which is the multilogical aspect that we will call “multilogical awareness” since the use of multiple perspectives
and/or reasoning strategies serves to think, with precision and impartiality, contributing to the reanalysis, clarification or
6
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
Based on the conceptualizations developed so far, the following operational definitions of the skills or indicators of complex
thinking are proposed below (see Table 1).
The proposal of a conceptual model for complex thinking and operational definitions of its cognitive skills arises from the need to
promote complex thinking in educational systems, especially at the university level, as has been proposed by several authors. As Edgar
Morin would say, it would allow, students to develop thinking that dialogues with uncertainty, that links knowledge, that does not
separate the object of study from its context, from its background, from its future, in order to understand the different aspects of a
multidimensional reality and that is in tune with the new socio-cultural and scientific paradigm, the paradigm of complexity. In this
sense, our proposal would be a first step in that direction.
It is also important to note that this model is configured from a new conceptualization, which emerges from the synthesis and
conjugation of different conceptual perspectives, the result of which gives rise to the following definition of complex thinking: it refers
to systemic thinking that arises from the fusion between critical thinking, creative thinking and metacognition, from which the
Table 1
Operational definitions of skills/indicators.
Main cognitive Skills/indicators
processes
Fluency: it is the characteristic of creativity or the facility to generate a large number of ideas or the ability to produce a large number of
responses in a given field, from verbal or figurative stimuli.
Flexibility: it is the characteristic of creativity through which the process is transformed to reach the solution of the problem or its
approach. It includes a transformation, a change, a rethinking or reinterpretation. In short, it is the constant ability to produce different
Creative thinking ideas to move from one focus to thinking and using different problem-solving strategies.
Originality: it is the characteristic that defines the idea, process or product as something unique or different. It refers to the ability to
produce novel, unconventional responses, far from the established and habitual.
Bisociativity: ability to establish connections or relationships between apparently dissimilar concepts, coming from different areas of
knowledge and/or opposites; redefining concepts, structuring information or producing new logical alternatives to obtain novel ideas.
Metacognitive knowledge: ability to: know the characteristics and complexity of all the information included in a task, in its relation to the
strategies, the proposed processes, to the general, abstract or epistemological knowledge related to a task and its context; know the
monitoring and control strategies in their relation to the object of knowledge involved in specific tasks; know the application and transfer
of strategies and their adaptation to the demands of the tasks.
Multilogical awareness: it is the knowledge or awareness of the use of different strategies, forms of reasoning or logical systems (coming
from different areas of knowledge) in the solution of a problem or artistic production; to examine the assumptions, perspectives, and
Metacognition
conceptual structures that lie beneath the surface of a particular problem or task, considering different points of reference.
Regulation of cognition: ability to: control and monitoring cognitive strategies or processes, supervising retrospectively or prospectively or
making metacognitive judgments that provide feedback; observe their own beliefs, prejudices or states and their involvement in the
cognitive processes in the development of the task or artistic production; to self-assess or reflect on their memory and cognitive abilities
or characteristics, recognizing their cognitive strengths and weaknesses; to be aware of your own feelings, emotions, intuitions or
passions and how it influences your confidence or sense of satisfaction and, in turn, your performance and achievement of results.
Inference capacity: ability to extract judgments or conclusions from certain facts, propositions or principles, whether general or particular,
observed or assumed. The inference arises from a mental evaluation between different expressions that, when related as abstractions,
allow a logical implication to be drawn. From some hypotheses or arguments, it is possible to infer a conclusion.
Information interpretation: ability to interpret and understand information from a text, speech or event and judge the proposals; or to
elucidate the reasons that led a subject to act as he did, using broader contexts that include social norms, customs, or others, to give
meaning to the action.
Dialogic capacity: it is the process by which knowledge is built through dialogue or contradictions. It allows us to understand the
Critical thinking
interpretations of others and to look for arguments to refute, affirm or reformulate them. Communicative action and dialogue are key
components in the construction of knowledge and the main instrument of social transformation. This process also focuses on assessing the
strengths and weaknesses of opposing perspectives. And through this, we can arrive at consensual interpretations or better argued
solutions.
Ability to make judgments: ability to formulate judgments using criteria based on the evaluation of arguments. These judgments can be
universal, particular, singular, affirmative, negative, categorical, hypothetical or disjunctive depending on the problem or object in
question.
7
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
following skills/indicators are derived and integrated; fluency, flexibility, originality, bisociativity, metacognitive knowledge, mul
tilogical awareness, regulation of cognition, inference capacity, information interpretation, dialogic capacity and ability to make
judgments.
The choice and proposal of the skills/indicators for each of the main processes is a function of establishing coherence with the
conceptualizations proposed by Morin and Lipman. Additionally, it was considered to select the most used skills/indicators in the
different assessment systems related to the indicated cognitive processes and that have demonstrated sufficient empirical evidence of
validity. The reduction of indicators is also aimed at obtaining a simplified model that avoids the overlapping of components. For
example, multiple authors have proposed that the formulation of judgments is a component of critical thinking and also of creative
thinking (Mumford, Giorgini, Gibson, & Mecca, 2013), which is in line with the conceptualizations developed by Lipman. In our
proposal it was decided to place it in the set of critical thinking indicators, since the formulation of judgments is more predominant in
this cognitive process by definition. However, we consider that all the indicators would be interrelated and circumscribed to the
general construct of complex thinking, appealing to a relational structure of suprasumativity rather than the sum of the parts.
Appealing, moreover, to the inherent systemic character at the structural level of our proposal.
Regarding the indicators selected for creative thinking, fluency, flexibility and originality were chosen. The elaboration criterion
was omitted, as some studies have pointed out that this component is not related to the other criteria, it has shown a negative cor
relation with each of them. The "elaboration" could hinder the creative or divergent process by not allowing the subjects to produce a
large number of ideas (Kudrowitz & Dippo, 2013). Furthermore, Jiménez, Artiles, Rodríguez, and García (2007) warn that, although
the internal structure of divergent thinking and creativity would be defined by fluidity, originality, flexibility and elaboration;
nevertheless, the components that best define the construct are those that present greater saturation in the factor, being better defined
by the components of fluidity, originality and flexibility. On the other hand, many authors have opposed the use of scores that are
fluently confused, specifically alluding to their confusing relationship (quality versus quantity) with originality (Clark, Griffing, &
Johnson, 1989; Forthmann, Szardenings, & Holling, 2020; Silvia, 2008); however, other authors point out that both fluency and
originality cannot be confused, since "people differ in their abilities to generate original responses compared to many responses, and
these differences must be taken into account when designing training protocols" (Cotter, Ivcevic, & Moeller, 2020, p.8).
Another important component for measuring creativity, which has emerged with great interest in recent scientific literature, is
bisociation or bi-association (Benedek et al., 2020). The choice of this indicator variable is due to the fact that it connects with theories
of creativity that postulate that creative ideas arise from the recovery of remote associations that are combined in novel and appro
priate ways (Benedek et al., 2020; Mednick, 1962). Just as skills or indicators of divergent thinking have been highlighted as potential
predictors of creative thinking (Runco & Acar, 2012), bisociation represents a more restricted version of the generation of creative
associations and implies qualitatively different cognitive mechanisms in achieving conceptual integrations. Furthermore, due to their
relational characteristics, bissociative skills would play an important role in the linking of knowledge and in the ability to unite units to
multiplicities, which are key aspects that complex thinking tries to promote.
With regard to the selected skill/indicators for critical thinking, two indicator variables used in the Watson and Glaser (1980) test
were included, the ability to infer and interpret information, which have been included in other evaluation systems and are considered
basic skills for critical thinking. The inclusion of the dialogical capacity and the formulation of judgments is due to the fact that these
components are key in the conceptualizations developed by Morin and Lipman, respectively. Dialogic capacity would allow the
assessment of argumentation in its interaction. The evaluation of different or opposing arguments is a strategy that allows establishing
dialogue and/or contrasting information with the perspectives of other interlocutors (Remache-Bunci, 2019; Santiuste et al., 2001).
The formulation of judgments has also been postulated by other authors, but it has not been included in systems of critical thinking
assessments. This indicator would also allow the observation of the criteria used in the formulation.
Regarding the selected skills/indicators for metacognition, the most used and almost unchanged indicator variables since Flavell
(1976) were included: metacognitive knowledge and cognition regulation. However, it was proposed to add a new variable, multi
logical awareness, as mentioned above, since it would allow observing self-awareness about the use of multiple perspectives and/or
reasoning strategies used in problem solving and/or retrospective analysis.
As a future task, the challenge is to be able to design and validate a complex thinking evaluation system and apply it to different
students to observe, in an empirical way, its practical implications on learning processes in educational systems. It would serve to
characterize the levels of development of the competences or cognitive processes involved and to be able to make decisions with
greater knowledge in this regard, towards the configuration of an improved assessment system.
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to
influence the work reported in this paper.
References
Allen, M., Glen, J., Müllensiefen, D., Schwarzkopf, D., Fardo, F., Frank, D., et al. (2017). Metacognitive ability correlates with hippocampal and prefrontal
microstructure. NeuroImage, 149, 415–423.
Álvarez, L., Pérez, C., & Lara, R. (2019). Las tareas problematizadoras como propuesta para el desarrollo del pensamiento complejo. Revista Metropolitana de Ciencias
Aplicadas, 2(2), 75–83.
Amin, A., Corebima, A., Zubaidah, S., & Mahanal, S. (2020). The correlation between metacognitive skills and critical thinking skills at the implementation of four
different learning strategies in animal physiology lectures. European Journal of Educational Research, 9(1), 143–163. https://doi.org/10.12973/eu-jer.9.1.143.
8
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
Anderson, N. (2008). Metacognition and good language learners. In C. Griffiths (Ed.), Lessons from good language learners (pp. 99–109). Cambridge University Press.
Arslan, S. (2018). Investigating predictive role of critical thinking on metacognition with structural equation modeling. MOJES: Malaysian Online Journal of
Educational Sciences, 3(2), 1–10.
Barzegarbafrouee, K., Farzin, S., & Zare, M. (2019). The role of reading metacognitive strategies in prediction of critical thinking in students-teachers in Shiraz.
Advances in Cognitive Sciences, 21(1), 105–116.
Beaty, R., Chen, Q., Christensen, A., Kenett, Y., Silvia, P., Benedek, M., et al. (2020). Default network contributions to episodic and semantic processing during
divergent creative thinking: A representational similarity analysis. NeuroImage, 209. https://doi.org/10.1016/j.neuroimage.2019.116499.
Beaty, R., Kenett, Y., Christensen, A., Rosenberg, M., Benedek, M., Chen, Q., et al. (2018). Robust prediction of individual creative ability from brain functional
connectivity. PNAS; Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1713532115.
Beaty, R., Benedek, M., Silvia, P., & Schacter, D. (2016). Creative cognition and brain network dynamics. Trends in Cognitive Sciences, 20(2), 87–95.
Benedek, M., Jurisch, J., Koschutnig, K., Fink, A., & Beaty, R. (2020). Elements of creative thought: Investigating the cognitive and neural correlates of association and
bi-association processes. NeuroImage, 210, Article 116586.
Brown, A. (1987). Metacognition, executive control, self-regulation, and other more mysterious mechanisms. In F. Weinert, & R. Kluwe (Eds.), Metacognition,
motivation and understanding (pp. 65–116). Lawrence Erlbaum Associates.
Bustamante, L., Ayllón, S., & Escanés, G. (2018). Abordando la trayectoria universitaria desde el pensamiento complejo. Praxis Educativa, 22(3), 64–70.
Carrillo-González, G., Gómez-Ramírez, O., & Vargas-Rosero, E. (2007). La Metasíntesis: una Metodología de Investigación. Revista de Salud Pública, 9(4), 609–617.
Chen, Q., Beaty, R., & Qiu, J. (2020). Mapping the artistic brain: Common and distinct neural activations associated with musical, drawing, and literary creativity.
Human Brain Mapping, 41. https://doi.org/10.1002/hbm.25025.
Chua, R., & Kok, Y. (2017). Not just how much you know: Interactional effect of cultural knowledge and metacognition on creativity in a global context. Management
and Organization Review, 13(2), 281–300.
Clark, P., Griffing, P., & Johnson, L. (1989). Symbolic play and ideational fluency as aspects of the evolving divergent cognitive style in young children. Early Child
Development and Care, 51, 77–88.
Colina, A. (2020). La educación superior desde la visión del pensamiento complejo. Revista Científica Ecociencia, 7, 1–18.
Correa, J., Ossa, C., & Sanhueza, P. (2019). Sesgo en razonamiento, metacognicion y motivación al pensamiento crítico en estudiantes de primer año medio de un
establecimiento de Chillán. Revista de estudios y experiencias en educación, 18(37), 61–77.
Cotter, K., Ivcevic, Z., & Moeller, J. (2020). Person-oriented profiles of originality and fluency in divergent thinking responses. Journal of Research in Personality, 86.
https://doi.org/10.1016/j.jrp.2020.103941.
Degener, S., & Berner, J. (2017). Complex questions promote complex thinking. The Reading Teacher, 70(5), 595–599.
Dziob, D., Kwiatkowski, L., & Sokolowska, D. (2018). Class tournament as an assessment method in physics courses: A pilot study. Eurasia Journal of Mathematics
Science and Technology Education, 14(4), 1111–1132.
El Soufi, N., & See, B. H. (2019). Does explicit teaching of critical thinking improve critical thinking skills of English language learners in higher education? A critical
review of causal evidence. Studies in Educational Evaluation, 60, 140–162. https://doi.org/10.1016/j.stueduc.2018.12.006.
Ellamil, M., Dobson, C., Beeman, M., & Christoff, K. (2012). Evaluative and generative modes of thought during the creative process. NeuroImage, 59(2), 1783–1794.
Estrada, A. (2018). El pensamiento complejo y el desarrollo de competencias transdisciplinares en la formación profesional. Revista Científica RUNAE, 3(2), 177–193.
Fatmawati, A., Zubaidah, S., Mahanal, S., & Sutopo. (2019). Critical thinking, creative thinking, and learning achievement: How they are related. Journal of Physics
Conference Series, 1417, Article 012070. https://doi.org/10.1088/1742-6596/1417/1/012070.
Finfgeld, D. (2003). Metasynthesis: The state of the art-So far. Qualitative Health Research, 13, 893–904.
Flavell, J. (1976). Metacognitive aspects of problem solving. In L. Resnick (Ed.), The nature of intelligence (pp. 231–235). Hillsdale: Lawrence Erlbaum Associates.
Fleming, S., Huijgen, J., & Dolan, R. (2012). Prefrontal contributions to metacognition in perceptual decision making. Journal of Neuroscience, 32(18), 6117–6125.
Forthmann, B., Szardenings, C., & Holling, H. (2020). Understanding the confounding effect of fluency in divergent thinking scores: Revisiting average scores to
quantify artifactual correlation. Psychology of Aesthetics, Creativity, and the Arts, 14(1), 94.
Fox, K., & Christoff, K. (2014). Metacognitive facilitation of spontaneous thought processes: When metacognition helps the wandering mind find its way. In
S. Fleming, & C. Frith (Eds.), The cognitive neuroscience of metacognition (pp. 293–319). Springer.
Genette, G. (1989). Palimpsestos. La literatura en segundo grado. Madrid: Taurus.
Glaser, E. (1941). An experiment in the development of critical thinking. Bureau of Publications, Teachers’ College.
Gomero, V. (2019). Pensamiento complejo: un desafío para el educador y las familias de hoy. Educación: Revista de la Facultad de Ciencias de la Educación, 25(1),
115–121.
Guilford, J. (1950). Creativity. The American Psychologist, 5(9), 444–454.
Hulbig, P. (2020). Toward a neurological understanding of metacognition. Educational Studies Dissertations, 154. https://digitalcommons.lesley.edu/education_
dissertations/154.
Jia, X., Li, W., & Cao, L. (2019). The role of metacognitive components in creative thinking. Frontiers in Psychology, 10, 2404. https://doi.org/10.3389/
fpsyg.2019.02404.
Jiménez, J., Artiles, C., Rodríguez, C., & García, E. (2007). Adaptación y baremación del test de pensamiento creativo de Torrance: expresión figurada. Educación Primaria y
Secundaria. Canarias: Consejería de Educación, Cultura y Deportes del gobierno de Canarias.
Koestler, A. (1969). The act of creation. Danube: Hutchinson.
Kristeva, J. (1988). El lenguaje, ese desconocido. Introducción a la lingüística. Madrid: Editorial Fundamentos.
Ku, K., & Ho, I. (2010). Meta-cognitive strategies that enhance critical thinking. Metacognition and Learning, 5(3), 251–267. https://doi.org/10.1007/s11409-010-
9060-6.
Kudrowitz, B., & Dippo, C. (2013). Evaluating the alternative uses test of creativity. In In Proceedings of the National Conference On Undergraduate Research (NCUR)
2013.
Kusuma, D., Kartono, K., & Zaenuri, Z. (2018). Creative thinking ability based on students’ metacognition in creative problem solving learning model with recitation
and self-assessment in Ethnomatematics. Unnes Journal of Mathematics Education Research, 8(1), 25–34.
Lipman, M. (1997). Pensamiento complejo y educación. Ediciones de la Torre.
López-Pastor, V.y., & Sonlleva, M. (2019). Evaluación Formativa y Compartida en Educación. Revista Iberoamericana de Evaluación Educativa, 12(1), 5–9.
Lukitasari, M., Hasan, R., & Murtafiah, W. (2019). Using critical analysis to develop metacognitive ability and critical thinking skills in biology. JPBI (Jurnal
Pendidikan Biologi Indonesia), 5(1), 151–158.
Martínez, E., & Vicuña, C. (2017). El pensamiento complejo en la educación. Aportes teóricos y reflexivos desde una mirada global. Centro de Investigación y Estudios
Gerenciales, 30, 33–42.
Mednick, S. (1962). The associative basis of the creative process. Psychological Review, 69(3), 220–232. https://doi.org/10.1037/h0048850.
Miharja, F., Hindun, I., & Fauzi, A. (2019). Critical thinking, metacognitive skills, and cognitive learning outcomes: A correlation study in genetic studies. Biosfer:
Jurnal Pendidikan Biologi, 12(2), 135–143. https://doi.org/10.21009/biosferjpb.v12n2.135-143.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D., & Group, T. (2010). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement.
International Journal of Surgery, 89, 336–341.
Morin, E. (1999). Los siete saberes necesarios para la educación del futuro. Santillana-Unesco.
Morin, E. (1990). Introducción al pensamiento complejo. Gedisa.
Mumford, M., Giorgini, V., Gibson, C., & Mecca, J. (2013). Creative thinking: Processes, strategies and knowledge. In K. Thomas, & J. Chan (Eds.), Handbook of
research on creativity. https://doi.org/10.4337/9780857939814.
Otero-Saborido, F., & Vázquez-Ramos, F. (2019). La Evaluación Educativa en el Currículo LOMCE en Primaria: Análisis de los Currículos Autonómicos en Educación
Física. Revista Iberoamericana de Evaluación Educativa, 12. https://doi.org/10.15366/riee2019.12.1.003.
9
C. Silva Pacheco and C. Iturra Herrera Thinking Skills and Creativity 39 (2021) 100794
Ozturk, N. (2017). Assessing metacognition: Theory and practices. International Journal of Assessment Tools in Education, 4(2), 134–148.
Pitts, C.h., Anderson, R., & Haney, M. (2018). Measures of instruction for creative engagement: Making metacognition, modeling and creative thinking visible.
Learning Environments Research, 21, 43–59.
Preiss, D., Ibaceta, M., Ortiz, D., Carvacho, H., & Grau, V. (2019). An exploratory study on mind wandering, metacognition, and verbal creativity in Chilean high
school students. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.01118.
Rahardjoni, A., Hasanah, I., & Nugraheni, M. (2020). Developing critical thinking competence in algebraic thinking using augmented reality for junior high school.
PRISMA, Prosiding Seminar Nasional Matematika, 3, 497–503.
Remache-Bunci, M. (2019). Las dimensiones sustantivas y dialógicas del pensamiento crítico en estudiantes de bachillerato y universitarios. Revista Cátedra, 2(1),
60–75.
Resnick, L. (1987). Education and learning to think. Wash-ington DC: National Academy Press.
Rodríguez, G. (2013). Bisociaciones creativas, sinéctica y pensamiento divergente. Revista Q, 8(15). https://pdfs.semanticscholar.org/03f1/
9206a66a15bae5575d0dfdda8d30901b63cc.pdf.
Roger, E., & Regalado, C. (2018). Reflexiones en torno a la relación entre pedagogía, currículo y pensamiento Complejo. Revista del Centro de Investigación de la
Universidad la Salle, 12(48), 9–30.
Runco, M. (2018). Ejemplos políticos de un lado oscuro de la creatividad y el impacto en la educación. Teoría de la creatividad y acción en la educación (pp. 399–411).
Runco, M. (2017). Active ethical leadership, giftedness, and creativity. Roeper Review, 39, 242–249.
Runco, M., & Acar, S. (2012). Divergent thinking as an Indicator of creative potential. Creativity Research Journal, 24, 66–75.
Runco, M., & Jaeger, G. (2012). The standard definition of creativity. Creativity Research Journal, 24(1), 92–96.
Santiuste, B., Ayala, B., García, E., González, J., Rossignoli, J., & Toledo, E. (2001). El pensamiento crítico en la práctica educativa. Madrid: Fugaz Ediciones.
Sanz de Acedo Lizarraga, M., & Sanz de Acedo Baquedano, M. (2013). How creative potential is related to metacognition. European Journal of Education and
Psychology, 6(2), 69–81.
Saremi, H., & Bahdori, S. (2015). The relationship between critical thinking with emotional intelligence and creativity among elementary school principals in Bojnord
City, Iran. International Journal of Life Sciences, 9(6), 33–40.
Servín, D. (2020). Diseño formativo interprofesional: una estrategia para desarrollar el pensamiento complejo en estudiantes de ciencias de la salud. Fundación
Educación Médica (FEM), 23(1), 39–44.
Shavelson, R., Zlatkin-Troitschanskaia, O., Beck, K., Schmidt, S., & Marino, J. (2019). Assessment of university students’ critical thinking: Next generation
performance assessment. International Journal of Testing, 1–20.
Sıburıan, J., Corebıma, A., & Saptasarı, M. (2019). The correlation between critical and creative thinking skills on cognitive learning results. Eurasian Journal of
Educational Research, 19(81), 99–114. https://dergipark.org.tr/en/pub/ejer/issue/45577/572934.
Silvia, P. (2008). Creativity and intelligence revisited: A latent variable analysis of Wallach and Kogan (1965). Creativity Research Journal, 20, 34–39. https://doi.org/
10.1080/10400410701841807.
Silva, C. (2019). El desarrollo del pensamiento crítico en la propuesta curricular de la educación del arte en Chile. Estudios Pedagógicos, 45(3), 79–92. https://doi.org/
10.4067/S0718-07052019000300079.
Silva, C. (2020). Art Education for the Development of Complex Thinking Metacompetence: A Theoretical Approach. International Journal Art & Design Education
(IJADE), 39(1), 242–254. https://doi.org/10.1111/jade.12261.
Sternberg, R. (1986). Toward a unified theory of human reasoning. Intelligence, 10, 281–314.
Sternberg, R. (1980). Sketch of a componential subtheory of human intelligence. The Behavioral and Brain Sciences, 3(4), 573–614.
Sternberg, R.y., & Gardner, M. (1983). Unidades en el razonamiento inductivo. Revista de psicología experimental: General, 112(1), 80–116. https://doi.org/10.1037/
0096-3445.112.1.80.
Subheesh, N., & Sethy, S. (2020). Learning through assessment and feedback practices: A critical review of engineering education settings. EURASIA Journal of
Mathematics Science and Technology Education, 16(3). https://www.ejmste.com/download/learning-through-assessment-and-feedback-practices-a-critical-review-
of-engineering-education-7786.pdf.
Suratno, Komaria, N., Yushardi, Dafik, & Wicaksono, I. (2019). The effect of using synectics model on creative thinking and metacognition skills of junior high school
students. International Journal of Instruction, 12(3). https://repository.unej.ac.id/bitstream/handle/123456789/95172/F.%20KIP_Jurnal_Suratno_The%20Effect%
20of%20Using%20Synectics%20Model%20on%20Creative%20Thinking.pdf?sequence=1&isAllowed=y.
Tarricone, P. (2011). The taxonomy of metacognition. Psychology Press.
Torrance, E. (1990). Torrance tests of creative thinking. Manual for scoring and interpreting results. Verbal, forms A and B. Scholastic testing service.
Torrance, E. (1988). The nature of creativity as manifest in its testing. In R. J. Sternberg (Ed.), The nature of creativity (pp. 43–73). Cambridge University Press.
Torrance, E. (1981). Predicting the creativity of elementary school children (1958–80) and the teacher who “made a difference.”. The Gifted Child Quarterly, 25, 55–62.
Torrance, E. (1966). The Torrance tests of creative thinking-norms-Technical manual research edition-verbal tests, forms A and B-Figural tests, forms A and B. Princeton.
Personnel Press.
Torrance, E. (1962). Guiding creative talent. Englewood Cliffs: Prentice Hall.
Tsai, K. (2019). Investigating the empirical links between creative and critical thinking. Psychology Society & Education, 11(3), 267–280.
Van de Kamp, M., Admiraal, W., van Drie, J., & Rijlaarsdam, G. (2015). Enhancing divergent thinking in visual arts education: Effects of explicit instruction of
metacognition. The British Journal of Educational Psychology, 85, 47–58.
Viguri, M. (2019). Science of complexity vs. complex thinking keys for a critical reading of the concept of scientific in Carlos Reynoso. Pensamiento. Revista de
Investigación e Información Filosófica, 75, 87–106.
Watson, G., & Glaser, E. (1980). Critical thinking appraisal, forms A and B. Brace and Wold: Harcourt.
Yang, H. (2018). Complex thinking and responses to the question of why female graduates fail to practise medicine. Medical Education, 52(7), 687–689.
Zhang, Y., Bohemia, E., & McCardle, J. (2019). Aspects of a study of creative thinking and knowledge application. Conference contribution. Loughborough University
https://hdl.handle.net/2134/37604.
10