Archive for the ‘Education’ Category

I’ve had the following abstract accepted for a presentation at a conference in December at the University of Melbourne, Higher Education Research & the Student Learning Experience in Business.

A Pragmatic Definition of Critical Thinking for Business

This presentation will lay out a pragmatic definition of critical thinking.  It doesn’t purport to be the definitive characterization of what critical thinking is. Rather, it is offered as a convenient framework for understanding the nature and scope of critical thinking, which may be useful for purposes such as developing a dedicated subject in critical thinking for business, improving the teaching of critical thinking within existing subjects, or evaluating the effectiveness of a business course in developing critical thinking.

The definition is constructed around five commitments:

    • First, the essence of critical thinking is correct or accurate judgement. That is, to think critically is to think in ways that are conducive to being “more right more often” when making judgements.
    • Second, “being more right more often” can be achieved through the skillful application of general thinking methods or techniques.
    • Third, these techniques range on a spectrum from the simple and easily acquired to technical methods which require special training.
    • Fourth, for all but the simplest of methods, there are degrees of mastery in application of these techniques.
    • Fifth, there are many different kinds of judgements made in business, including decision making, prediction, estimation, (causal) explanation, and attribution of responsibility. For each major type of judgement, there are typical pitfalls, and a range of critical thinking methods which can help people avoid or compensate for those pitfalls.

These commitments enable us to define a kind of three-dimensional chart representing the critical thinking competency of any individual. Along one (categorical) axis is the various kinds of judgements (decision making, etc.). Another axis represents the spectrum from simple through to advanced critical thinking methods. Particular methods can then be placed in appropriate “boxes” in the grid defined by these axes. A person will have a degree of mastery of the methods in each box; this can be represented on a third dimension. A person’s critical thinking competency is thus a distinctive “landscape” formed by the varying levels of mastery.

This characterisation is tailoring, for business, a more general pragmatic approach to understanding critical thinking.  About a year ago I developed this approach in preparation for a workshop in the US on development of a test of critical thinking for intelligence analysts; my role in the workshop was to lay out a general framework for understanding what critical thinking is.   That approach was described in a manuscript Dimensions of Critical Thinking.

I’m also supporting a team from the University of Sydney Business School, who have had the following abstract accepted:

Evaluating critical thinking skill gains in a business subject

Helen Parker, Leanne Piggott, Lyn Carson
University of Sydney Business School
Tim van Gelder
University of Melbourne and Austhink Consulting

Critical thinking (CT) is one of the most valued attributes of business school graduates, and many business school subjects claim to enhance it. These subjects frequently implement pedagogical strategies of various kinds aimed at improving CT skills. Rarely however are these efforts accompanied by any rigorous evaluation of CT skill gains. But without such evaluation, it is difficult to answer questions such as:

    • Are our students’ CT skills in fact improving? By how much?
    • Are those skills improving more than they would have even without our special CT instruction?
    • Are the marginal gains worth the cost?
    • Are our attempts to improve our instruction from semester to semester making any difference?

These kinds of questions are particularly relevant to the University of Sydney Business School, which has an entire subject dedicated to improving CT (BUSS5000 – Critical Thinking in Business), enrolling some 800 students per semester. Consequently, in 2013, the Business School embarked on a large-scale, multi-year evaluation program. The evaluation is based on pre- and post-testing using an independent objective test (the Halpern Critical Thinking Assessment), whose coverage overlaps with the range of critical thinking skills taught in the subject. This presentation will give an overview of the approach it has adopted. It will discuss some of the challenges and pitfalls in the testing process, and how to interpret results. Finally, it will present data and insights from the first semester of full-scale evaluation. The session should be of interest to anyone interested in evaluating CT skills, or more generally in how business school education can enhance CT.

There’s an obvious complementarity between these two topics.

Read Full Post »

Regarding climate change, there is ”no website that has evidence-based information” that would allow a ”common-sense debate” .

So says the outgoing Governor of the state of Victoria, David de Kretser.  Or at least, this is what he was reported as saying in today’s Age.

I can hardly he believe he really said it.  There are many (how many? I don’t know – but heaps) of websites presenting evidence-based information.   Here are just a few which come to mind quickly:

  • Real Climate – “Climate science from climate scientists”
  • Climate Progress – the legendary blog relentlessly fighting the good fight;
  • Skeptical Science – a wealth of evidence-based information, including detailed responses to standard “denialist” arguments, at three levels of scientific detail, and available on an iPhone/Pad app;
  • Our very own CSIRO’s website section on climate change;
  • The IPCC.

Supposing de Kretser both said it and believed it, his strange assertion calls out for some kind of explanation.   Here’s a couple which seem plausible to me.

1.  de Kretser doesn’t actually surf the web very much.  He doesn’t read online.  He is of the generation that hardly uses computers very much, let alone dwells in the digisphere.  de Kretser thinks there is nothing out there because he hasn’t ventured out there to look.

2. de Kretser is sort of aware that there is at least some good stuff out there.  But he’s working backwards from the fact, seemingly inexplicable to him, that there is so much ignorance, delusion, and apathy in the population.  He tends to believe that when people are exposed to good information, they change their mind accordingly.  Since vast numbers of Australians don’t know and don’t care about climate change, they can’t have been exposed to information.  So there must be a lack of good information.  Maybe we should have a good website!

But this is naive.  It is naive about  individual psychology and how beliefs form and change.  And it is naive about the forces at work in society whose effect (only sometimes deliberate) is to distract, disinform, and confuse.   Possibly, intelligent and ethical scientists such as himself are exposed to, interested in, and form their beliefs on the basis of, good information.  But people such as himself are a tiny minority.

Sir, we don’t need more websites.  We have plenty already, and websites on their own are nearly useless in dealing with the kind of challenges we have – not just the primary challenge of dealing with climate change itself, but the tactical challenge of inducing appropriate change in people’s minds and behaviors.  Please devote your considerable capacities and influence to activities with real impact, not the shifting of pixels on the digital decks of a sinking civilisation.

Read Full Post »

Fernando Leal and colleagues at the University of Guadalajara have released Introducción a la Teoría de la Argumentación, an integrated selection of pieces intended to assist students and their teachers to focus on argumentation when reading and writing academic texts.

The section Parte II: La téchnica de mapeo de argumentos (argument mapping) contains three pieces emerging from work at the University of Melbourne and Austhink:

  • A translation of my article Teaching Critical Thinking: Some Lessons from Cognitive Science
  • A translation of Enhancing our Grasp of Complex Arguments, by Paul Monk and me, a big-picture view of why complex arguments are cognitively challenging and how argument mapping can help.  It has been available as a manuscript since 2004 and been well-received so we are very happy to see it finally appear in print.
  • A new chapter  by Claudia María Álvarez Ortiz, ¿El estudio de le filosofia mejora las habilidades de pensamiento crítico? which extracts some core material from her MA thesis Does Philosophy Improve Reasoning Skills?.  This is the first proper publication of the very important meta-analysis of studies of gains in critical thinking at college.

Well-designed and attractively produced, the appearance of the volume is a significant development in critical thinking pedagogy and theory, particularly in the Spanish-speaking Americas.   Regrettably the language barrier will be a major hurdle to recognition and uptake in the Anglosphere.  Perhaps somebody should undertake a translation of the whole volume into English?

Read Full Post »

Almost everyone agrees that critical thinking skills are important.  Almost everyone agrees that it is worth investing effort (in education, or in workplace training) to improve these skills.   And so it is rather surprising to find that there is, in the academic literature, little clarity, and even less consensus, about one of the most basic  questions you’d need answered if you wanted to generate any sort of gains in critical thinking skills (let alone generate those gains cost-effectively); viz., how are critical thinking skills acquired?

Theories on this matter come in five main kinds:

  • Formal Training. CT skills are simply the exercise of generic thinking power which can be strengthened by intensive training, much as general fitness can be enhanced by running, swimming or weightlifting.  This approach recommends working out in some formal ‘mental gym’ such as chess, mathematics or symbolic logic as the most convenient and effective way to build these mental muscles.
  • Theoretical Instruction. CT skills are acquired by learning the relevant theory (logic, statistics, scientific method, etc.).  This perspective assumes that mastering skills is a matter of gaining the relevant theory.  People with poor CT poor skills lack only a theoretical understanding; if they are taught the theory in sufficient detail, they will automatically be able to exhibit the skills, since exhibiting skills is just a matter of following explicit (or explicable) rules.
  • Situated Cognition. CT is deeply tied to particular domains and can only be acquired through properly “situated” activity in each domain.  Extreme versions deny outright that there are any generic CT skills (e.g. McPeck).  Moderate versions claim, more plausibly, that increasingly general skills are acquired through engaging in domain-specific CT activities.  According to the moderate version general CT skills emerge gradually in a process of consolidation and abstraction from particular, concrete deployments, much as general sporting skills (e.g., hand-eye coordination) are acquired by playing a variety of particular sports in which those general skills are exercised in ways peculiar to those sports.
  • Practice sees CT skills as acquired by directly practicing the general skills themselves, applying them to many particular problems within a wide selection of specific domains and contexts.  The Practice perspective differs from Formal Training in that it is general CT skills themselves which are being practiced rather than formal substitutes, and the practice takes place in non-formal domains.  It differs from Situated Cognition in that it is practice of general skills aimed at improving those general capacities, rather than embedded deployment of skills aimed at meeting some specific challenge within that domain.
  • Evolutionary Psychology views the mind as constituted by an idiosyncratic set of universal, innate, hard-wired cognitive capacities bequeathed by natural selection due to the advantages conferred by those capacities in the particular physical and social environments in which we evolved.  The mind does not possess and cannot attain general-purpose CT skills; rather, it can consolidate strengths in those particular forms or patterns of thinking for which evolution has provided dedicated apparatus.  Cultivating CT is a matter of identifying and nurturing those forms.

Formal training is the oldest and most thoroughly discredited of the perspectives.   It seems now so obvious that teaching latin, chess, music or even formal logic will have little or no impact on general critical thinking skills that it is hard to understand now how this idea could ever have been embraced.   And we also know why it fails: it founders on the rock of transfer.  Skills acquired in playing chess do not transfer to, say, evaluating political debates.  Period.

Theoretical Instruction has almost as old a philosophical pedigree as Formal Training.  It has been implemented in countless college critical thinking classes whose pedagogical modus operandi is to teach students “what they need to know” to be better critical thinkers, by lecturing at them and having them read slabs out of textbooks.   Token homework exercises are assigned primarily as a way of assessing whether they have acquired the relevant knowledge; if they can’t do the exercises, what they need is more rehearsing of theory.   As you can probably tell from the tone of this paragraph, I believe this approach is deeply misguided.  The in-depth explanation was provided by philosophers such as Ryle and Heidegger who established the primacy of knowledge-how over knowledge-that, of skills over theory.

Current educational practice subscribes overwhelmingly (and for the most part unwittingly) to the moderate version of Situated Cognition.  That is, we typically hope and expect that students’ general CT skills will emerge as a consequence of their engaging in learning and thinking as they proceed through secondary and especially tertiary education studying a range of particular subjects.  However, students generally do not reach levels of skill regarded as both desirable and achievable.  As Deanna Kuhn put it, “Seldom has there been such widespread agreement about a significant social issue as there is reflected in the view that education is failing in its most central mission—to teach students to think.”  In my view the weakness of students’ critical thinking skills, after 12 or even 16 years of schooling, is powerful evidence of the inadequacy of the Situated Cognition perspective.

There may be some truth to the Evolutionary Psychology perspective.  However in my view the best argument against it is the fact that another perspective – Practice – actually seems quite promising.   The basic idea behind it is very simple and plausible.   It is a truism that, in general, skills are acquired through practice.   The Practice perspective simply says that generic critical thinking skills are really just like most other skills (that is, most other skills that are acquired, like music or chess or trampolining, rather than skills that are innate and develop naturally, like suckling or walking).

In our work in the Reason Project at the University of Melbourne we refined the Practice perspective into what we called the Quality (or Deliberate) Practice Hypothesis.   This was based on the foundational work of Ericsson and others who have shown that skill acquisition in general depends on extensive quality practice.  We conjectured that this would also be true of critical thinking; i.e. critical thinking skills would be (best) acquired by doing lots and lots of good-quality practice on a wide range of real (or realistic) critical thinking problems.   To improve the quality of practice we developed a training program based around the use of argument mapping, resulting in what has been called the LAMP (Lots of Argument Mapping) approach.   In a series of rigorous (or rather, as-rigorous-as-possible-under-the-circumstances) studies involving pre-, post- and follow-up testing using a variety of tests, and setting our results in the context of a meta-analysis of hundreds of other studies of critical thinking gains, we were able to establish that critical thinking skills gains could be dramatically accelerated, with students reliably improving 7-8 times faster, over one semester, than they would otherwise have done just as university students.   (For some of the detail on the Quality Practice hypothesis and our studies, see this paper, and this chapter.)

So if I had to choose one theory out of the five on offer, I’d choose Practice.  Fortunately however we are not in a forced-choice situation. Practice is enhanced by carefully-placed Theoretical Instruction.  And Practice can be reinforced by Situated Cognition, i.e. by engaging in domain-specific critical thinking activities, even when not framed as deliberate practice of general CT skills.   As one of the greatest critical thinkers said in one of the greatest texts on critical thinking:

“Popular opinions, on subjects not palpable to sense, are often true, but seldom or never the whole truth. They are a part of the truth; sometimes a greater, sometimes a smaller part, but exaggerated, distorted, and disjoined from the truths by which they ought to be accompanied and limited.”

Read Full Post »

  1. Martin Davies, a colleague of mine at the University of Melbourne and a energetic advocate of argument mapping in teaching critical thinking has published “Computer-assisted argument mapping: a rationale approach” in the journal Higher Education.  In the article Martin describes using argument mapping in an upper-level Economics subject, and discusses how the students themselves regarded the exercise as helping them improve their critical thinking skills.  This reinforces the conclusion from other studies using pre- and post-testing which have found that student skills do in fact improve.
  2. The most popular post on this blog by a significant margin has been “What is Argument Mapping?“.   When first posted, it was a draft of an entry submitted to a new “Encyclopedia of the Mind.”  I have now revised the entry in response to editors’ suggestions & requirements, and I’ve now put the probably-final version on the blog post in place of the old draft version.    Or you can download a print-friendly version.


Read Full Post »

 Now available – the final version of my paper prepared in connection with the conference Graphic and Visual Representations of Evidence and Inference in Legal Settings in January this year.  The paper is now called The Rationale for Rationale™.

Read Full Post »

That’s the title the editor gave to a letter I had published in the Education Age (21 May 07), commenting on an opinion piece by my University of Melbourne colleague Marty Ross.  Since they don’t make the letters to Education Age available online, I’m putting it up here.

Marty’s piece generally was very good.  He and I have no deep disagreement; but this letter puts into relief one point where we’d differ at least in emphasis. 

According to Marty Ross, the purpose of teaching mathematics is “training in logical thinking, learning to reason about anything.”  But mathematics is a poor way to achieve this goal, and there are better reasons to study the “queen of the sciences”. 

Ross is recycling an idea as old as Euclid himself, for we can find in Plato the view that reasoning is like a muscle, which can be strengthened through training in some formal discipline such as mathematics or grammar. 

The view is plausible, even appealing, but it is misguided.  It violates a key insight of research into cognitive skills, known as the “problem of transfer”: skills learned in one situation “transfer” to other situations far less than we would expect.  Studying mathematics may help students learn to prove theorems, but quite different kinds of reasoning are usually needed in everyday life and the workplace.  

There is a better way.  General “informal” reasoning skills can be taught directly, i.e., as skills in their own right.  In recent years, some remarkably effective methods for doing this have emerged.   Crudely, to Ross I would say: if you want to improve general reasoning, why not teach general reasoning?  Why teach something else, in the forlorn hope that some general reasoning skills will result? 
Unfortunately, effective direct approaches are not widely used.  In addition to its mauling of mathematics, a major problem in the Victorian education system is its failure to systematically teach the fourth R, reasoning. 

Lets not try to make mathematics carry a burden it cannot bear.  Lets instead teach mathematics to give all students at least a chance to appreciate the profundity, and beauty, of the most magnificent achievements of the human intellect.    Meanwhile, lets teach general informal reasoning skills using more direct and effective approaches.

Read Full Post »

Older Posts »