Blooms 1984 – Getting an A instead of a C

When people see the year 1984 most think of George Orwell’s book about a dystopian future, but a few other things happened that year. Dynasty and Dallas were the most popular TV programs and one of my favorite movies, Amadeus won best picture at the Oscars. You can be excused for missing the publication of what has become known as the two Sigma problem by Benjamin Bloom, of Blooms taxonomy fame. He provided the answer to a question that both teachers and students have been asking for some time – how can you significantly improve student performance?  

One of the reasons this is still being talked about nearly 40 years later is because Bloom demonstrated that most students have the potential to achieve mastery of a given topic. The implication is that it’s the teaching at fault rather than the students inherent lack of ability. It’s worth adding that this might equally apply to the method of learning, it’s not you but the way you’re studying.

The two-sigma problem
Two of Bloom’s doctoral students (J. Anania and A.J. Burke) compared how people learned in three different situations:

  1. A conventional lecture with 30 students and one teacher. The students listened to the lectures and were periodically tested on the material.
  2. Mastery learning – this was the conventional lecture with the same testing however students were given formative style feedback and guidance, effectively correcting misunderstandings before re-testing to find out the extent of the mastery.
  3. Tutoring – this was the same as for mastery learning but with one teacher per student.

The results were significant and showed that mastery learning increased student performance by approximately one standard deviation/sigma, the equivalent of an increase in grading from a B to an A. However, if this was combined with one-to-one teaching, the performance improved by two standard deviations, the equivalent of moving from a C to an A. Interestingly the need to correct students work was relatively small.

Bloom then set up the challenge that became known as the two-sigma problem.

“Can researchers and teachers devise teaching/learning conditions that will enable the majority of students under group instruction to attain levels of achievement that can at present be reached only under good tutoring conditions?”

In other words, how can you do this in the “real world” at scale where it’s not possible to provide this type of formative feedback and one to one tuition because it would be too expensive.

Mastery learning – To answer this question you probably need to understand a little more about mastery learning. Firstly, content has to be broken down into small chunks, each with a specific learning outcome. The process is very similar to direct instruction that I have written about before. The next stage is important, learners have to demonstrate mastery of each chunk of content, normally by passing a test scoring around 80% before moving onto new material. If not, the student is given extra support, perhaps in the form of additional teaching or homework. Learners then continue the cycle of studying and testing until the mastery criteria are met.

Why does it work?
Bloom was of the opinion that the results were so strong because of the corrective feedback which was targeted at the very area the student didn’t understand. The one to one also helped because the teacher had time to explain in a different way and encourage the student to participate in their own learning which in turn helped with motivation. As you might imagine mastery is particularly effective in situations where one subject builds on another, for example, introduction to economics is followed by economics in business.

Of course, there are always problems, students may have mastered something to the desired level but forget what they have learned due to lack of use. It’s easy to set a test but relatively difficult to assess mastery, for example do you have sufficient coverage at the right level, is 80% the right cut score? And finally, how long should you allow someone to study in order to reach the mastery level and what happens in practice when time runs out and they don’t?

The Artificial Intelligence (AI) solution
When Bloom set the challenge, he was right, it was far too expensive to offer personalised tuition, however it is almost as if AI was invented to solve the problem. AI can offer an adaptive pathway tracking the student’s progression and harnessing what it gleans to serve up a learning experience designed specifically for the individual. Add to this instructionally designed online content that can be watched by the student at their own pace until mastery is achieved and you are getting close to what Bloom envisaged. However, although much of this is technically possible, questions remain. For example, was the improvement in performance the result of the ‘personal relationship’ between the teacher and student and the advise given or the clarity in explaining the topic. Can this really be replicated by a machine?

In the meantime, how does this help?
What Bloom identified was that in most situations it’s not the learner who is at fault but the method of learning or instruction. Be careful however, this cannot be used as an excuse for lack of effort, “its not my fault, it’s because the teacher isn’t doing it right”.

How to use Blooms principles.

  • Change the instruction/content – if you are finding a particular topic difficult to understand, ask questions such as, do I need to look at this differently, maybe watching a video or studying from another book. Providing yourself with an alternative way of exploring the problem.
  • Mastery of questions – at the end of most text books there are a number of different questions, don’t ignore them, test yourself and even if you get them wrong spend some time understanding why before moving on. You might also use the 80% rule, the point being you don’t need to get everything right

In conclusion – It’s interesting that in 1985 Bloom came up with a solution to a problem we are still struggling to implement. What we can say is that personalisation is now high on the agenda for many organisations because they recognise that one size does not fit all. Although AI provides a glimmer of hope, for now at least Blooms 2 Sigma problem remains unsolved.

Listen to Sal Khan on TED – Let’s teach for mastery, not test scores

When a horse might be a cow – the importance of Schema

Although there is a difference between learning, “the process of acquiring knowledge” and remembering, “the process of recording, storing and retrieving knowledge”, they are symbiotic, the one having little purpose without the other. Which goes someway to explaining why I have written so much about memory over the years. Here is one such example Never forget – improving memory.

In some of these blogs I have referred to the word schema but have not really explored it in much detail, it’s time to put that right.

It’s easy to think that when the brain transfers information from short to long term memory it just sits there floating in a vacuum, waiting for the day it will be needed. But it doesn’t work like that, the brain cannot simply pluck something from this vast space without having structured the information in the first place, effectively having filed it away correctly.

The packets that organise information and make sense of experience are ‘schemas’, the building blocks of cognition. Daniel Goleman

Schema – how information is stored
Schema can be derived from the word’s Greek origin, which means to shape or plan, but it wasnt until 1923 that the child developmental psychologist Jean Piaget used it in the context of learning.

Nine years later Frederic Bartlett described schema in more detail by saying that people organise concepts into mental constructs, models, or frameworks that help them process and remember information. The implication being that when faced with information that fits an existing schema, it will be remembered but if not, it is easily forgotten.

Schemas contribute to our understanding as to how information is stored in the brain and provide insight as to what we can do to learn more effectively. They are built through experience, for example a child may have been told that a cow is an animal that has four legs, eats grass and lives in a field, they may even have seen one. When they next come across a cow, they will associate what they see with that schema and say “cow”. However, if in the next field they see a horse which also has four legs, eats grass and lives in a field, they may believe that is also a cow. It’s at this point the child’s parents intervene by telling the child “No that’s a horse, can you see its taller and runs faster”, this leaves the child with two choices either, build a new schema or adapt the existing one.

Piaget gave us the answer as to what’s happening here, he called it Assimilation and Accommodation. Assimilation is when you make the new information fit with an existing schema for example, the child can adapt their schema by adding – not all animals that live in a field with four legs and eat grass are cows, some are horses. Alternatively, they create a new schema for horses, being fast, tall animals with four legs, that eat grass and live in a field, this is accommodation.

People who do well in maths are those that make connections and see maths as a connected subject.
Jo Boaler, 2014

Chess players use schemas
There is a general assumption that chess players have good memories, which on the face of it is true. But it’s not necessarily an innate ability, they have been building up information of past games and storing them in schemas for years. This is why an expert chess player is able to beat a novice, not because they are processing each move individually, they suffer from cognitive load like everyone else, they are simply accessing past schemas. (Chase & Simon, 1973 et al).

The reason experts remember more is that what novices see as separate pieces of information, experts see as organised sets of ideas. Donovan & Bransford, 2005

How does this help with learning?
If you aware of how your brain stores information you can change the way you study to work with your brain not against it. Below are a few tips you might want to consider.

  • Pre-Assessment or subject review – It’s a good idea before starting a new subject to test yourself or review the underpinning content. This is not so much about finding out what you know, although this might be helpful, it reminds you of prior knowledge and schemas that can be adapted to fit the new information you will learn.
  • Look for analogies and comparisons – when new information is presented think how this might fit with what you now. For example, if you have already learned about income tax, when you come to capital gains tax ask, what are the differences and similarities. They both fit into the schema of taxation.
  • Put Information Into context – when trying to understand something new, consider the context from which it comes, its possible that although the knowledge is new the context is familiar. For example, if you were learning about people who break the law, it might be a good idea to ask yourself in what context you would do this. This could help fit the new information into an existing schema.
  • Challenge your existing schemas – like many things’ schemas can be good or bad. Here is a riddle, a father and son have a car accident and are both badly hurt. They are both taken to separate hospitals. When the boy is taken in for an operation, the doctor says ‘I cannot do the surgery because this is my son’. How is this possible?

The answer is of course that the doctor is the son’s mother, but because we have a schema that tells us doctors are male, we get it wrong.

And one last big tip for teachers, inside your head you have created schemas that work, share them with your students, they have probably taken you many years to create making them hugely valuable in terms of knowledge transfer.

For more information here is a really good video that explains Memory Schemas in more detail.

Chatter – why talking to yourself matters

If you are reading this, think for a moment as to what you are doing……… are you sounding out the words in your head or did you pause, reflect and ask yourself “what exactly am I doing?”, either way you have been using your inner voice, your internal dialogue or have been experiencing what Ethan Kross calls Chatter.

Ethan is the Professor of Psychology and Management at the University of Michigan and author of a book called Chatter, the voice in our head and how to harness it.

On the one hand this might all seem a little strange, how many people would you ask what they have been talking to themselves about today, perhaps you wouldn’t because it’s too personal a question or maybe you don’t want to admit you do it all of the time. The good news is its perfectly normal and the vast majority of people talk to themselves. It’s worth adding however that not everyone has an internal voice, with some suggesting that this might be more likely for people with dyslexia.

Where does it come from?
Evolution would suggest that if we have this ability, it must serve a purpose. Mark Scott from the University of British Columbia has found evidence that a brain signal called “corollary discharge” plays an important role in our experiences of internal speech. Corollary discharge arises when the brain generates an internal copy of the sound of our voice in parallel to the external sound we hear. Its purpose is to prevent confusion between a self-caused sound or sensation for example, a dog growling noise inside our head and an externally-caused sound, for example a real dog growling who is about to bite. If both are the same, we run pretty fast, if not the brain will cancel the internal sound. This is the reason we can’t tickle ourselves; the brain sends a signal that we are going to tickle ourselves before we actually do, effectively cancelling the sensation.

Interestingly children don’t develop this skill until around 6 or 7 although its gradual and starts much earlier. This is the reason a young child will just say what they think, regardless of the consequences!

“Don’t let the noise of others’ opinions drown out your own inner voice.” Steve Jobs

Why it matters and what you can do?
One of the most powerful tools to help manage stress, wellbeing and self-esteem is your inner voice, and examinations provide a rich environment where without support all of these can bring you down. Heightened dialogue is not of course just experienced when studying or in the exam room, how was it possible that Marcus Rashford, Jadon Sancho and Bukayo Saka missed penalties in the Euros. Maybe it was the result of too much chatter, telling themselves that they must score, they have to score, the country is relying on them?

“Non-judgment quiets the internal dialogue, and this opens once again the doorway to creativity.” Deepak Chopra

And this is where Ethan Kross offers a whole raft of advice. He talks about having the ability to step back from the Chatter by adopting a broader, calmer and more objective perspective. You also need to listen to what your saying, low self esteem for example can easily develop if you are continually criticising yourself, perhaps as a thoughtless parent might do, always finding fault no matter what.

Here are a few of the practical tools in the book.

  1. Use distanced self-talk – rather than saying “why can’t I do this”, use your name in the second person “why is it that Stuart can’t do this”. This results in reduced activation in brain networks associated with negative thoughts.
  2. Imagine advising a friend – this has a similar impact in that it helps you view the experience from a distance. “I know this is a tricky question but you’ve been in a similar situation before and you figured it out”. This is also an example of what Kross calls time travel, (temporal distancing) either going forward in time to look in the rear-view mirror at the problem, effectively leaving it behind or travelling back to a time when you were successful.
  3. Broaden your perspective – in this situation, compare what you’re worrying about with other adverse events or ask what other people would do in the same situation. A variation on the “what would Jesus do?” question.
  4. Reinterpreted your bodies chatter response – when you experience stress its likely your heart rate will increase and you will begin to sweat. Becoming aware of this can lead you to conclude that you are stressed which in fact makes the situation worse. Kross suggest you tell yourself that this is not bad news but the body doing what it has to in order to help you.

And finally, if you want to find out more, check out this video, Do you have an inner voice?

Old Marley was as dead as a door nail – the power of analogy

“Marley was dead, to begin with. There is no doubt whatever about that. The register of his burial was signed by the clergyman, the clerk, the undertaker, and the chief mourner. Scrooge signed it. And Scrooge’s name was good upon ‘Change for anything he chose to put his hand to. Old Marley was as dead as a doornail.”

A Christmas Carol was written by Charles Dickens in October 1843 and published on December 19th the same year. By Christmas’s Eve it had sold 6,000 copies at 5 shillings each, unfortunately Dickens only made £230 due to the elaborate illustrations and a not so lucrative deal with Chapman and Hall, the publishers. Today you could by an original copy for around £40,000.

Although Dickens might not have struck a particularly good business deal, he used an excellent analogy to describe exactly how dead Marley, his business partner was. Incidentally the reason a doornail is considered so dead is to do with the way it is bent over and hammered flat, making it unusable. Click for a more detailed explanation.

Analogy
Put simply, analogies highlight shared characteristics between two things. It’s an umbrella term for a cognitive process where we transfer meaning or information from one subject to another and as a result improve understanding. For example, “life is like a box of chocolates – you never know what you’re gonna get” is an analogy from Forrest Gump that makes the connection between the choices and surprises you face when deciding on what chocolate to have…. and life. It helps illustrate the uncertainty of life, the fact that faced with choice you don’t always make the best one and sometimes when you “bite” into life you might be pleasantly surprised. Many analogies are used in everyday speech, for example “doing that will be as about as effective as rearranging deck chairs on the Titanic”, meaning it will make no difference. Similes and metaphors can be used in the same way, in many instances providing the infrastructure to support the analogy. Life is like a box of chocolates, is a simile.

But the distinction between, analogy, metaphor and similia doesn’t really matter, the important point is that all of these can be used to improve understanding, navigate complexity and help with problem solving by using what is called analogical reasoning.

Making abstract concrete
There are many reasons as to why analogies work so well. They often require the use of images, connect existing information with new and encourage reflection, retrieval and the manipulation of ideas. All of which help move information from short to long term memory. There is also a strong connection with the 6 evidenced based learning strategies covered in previous blogs, in particular using concrete examples to make concepts more real. This is one of the most powerful ways to use an analogy.

How do you explain the dual concept in accounting? Here is the answer – the dual concept tells us that every transaction affects the business in at least two ways which are equal and opposite in nature.

Even though you have an explanation, because it’s a concept, an abstract idea, it has no form which makes it difficult for the brain to grasp. But if you can relate it by way of an analogy, perhaps thinking of the dual concept as a set of scales where whatever you put on one side you have to put on another, it becomes more tangible and an understanding develops.

Designing an analogy
Sometimes an analogy will just emerge, from my own experience this is often the case when I have thought about a particular topic or taught it for many years. The catalyst might be someone saying, I don’t understand. As a result, you rack your brains to come up with an alternative way of explaining, and the analogy just appears. However, when studying, you don’t have time for this but coming up with your own analogy might really help. Here is one way of doing it.

Pick two objects, ideas or domains
e.g. a carrot and learning
Write down the main characteristics
– Carrots – are orange, grow from a seed, need water, good for you etc
– Learning – requires effort, takes time, builds on prior knowledge, helps you in life etc
Evaluate by looking for commonalities
Learning is not dissimilar to a carrot, it starts very small, takes time to grow, needs nurturing and is good for you. A slightly silly example but hopefully it shows how the process could work.

A word of warning, as powerful as analogies can be they aren’t the answer to everything. Research shows they can cause learners to create incorrect mental models and as such draw the wrong conclusions, so always keep a check on the logic behind the analogy and at what point it stops working.

A few more analogies
– “A good speech should be like a woman’s skirt; long enough to cover the subject and short enough to create interest.” Winston S. Churchill
– “You see, wire telegraph is a kind of a very, very long cat. You pull his tail in New York and his head is meowing in Los Angeles. Do you understand this? And radio operates exactly the same way: you send signals here, they receive them there. The only difference is that there is no cat.” Albert Einstein
– “Truth, like gold, is to be obtained not by its growth, but by washing away from it all that is not gold.” Leo Tolstoy
They can also make you laugh – “When I die, I want to go peacefully like my Grandfather did, in his sleep – not screaming, like the passengers in his car.”

And as Tiny Tim said, “A Merry Christmas to us all; God bless us, every one!”
Happy Holidays and here’s to a much better 2022.

Simulations, Case Studies and Games – Strictly Take 2

Last month’s blog looked at the difficult balancing act that has to be struck between knowledge and skills. It concluded that skills learned in one domain are not always transferable to another, making it important to have as realistic an environment in which to learn as possible.

The UK government believe, as set out in their skills for jobs white paper that by giving employers a central role in the design of technical courses it will ensure the education and training is directly linked to the skills needed in the world of work. Although this should result in a curriculum valued by employers, these skills won’t be learned unless they can be applied in a real-world environment. This is the reason the government promote apprenticeships and have built work experience into the new T levels.

But perhaps there is more that could be done, what if the transition between what is learned in the “classroom” and the real world was somehow smoother, almost as if it was the obvious next step.

Simulations, a type of rehearsal
One answer might be to use a simulation, an instructional scenario where the learner is placed in a world similar in some aspects to the real one. It is a representation of reality within which the student has to engage and interact. It’s controlled by the teacher who uses it to achieve a desired learning outcome.

Simulations are most effective when there is a need to explore relatively complex topics with many dimensions and factors. And because the student is placed in a situation of uncertainty, they are forced to navigate confusion, consider different possibilities, problem solve, think critically and in so doing develop those all-important higher-level skills so valued in the workplace. Despite there being good evidence, (Bogo et al, 2014, Cooper et al, 2012) as to the efficacy of simulations, in practice PowerPoints and chalk and talk are still all too common.

In terms of timing, simulations work best at the later stages of learning, after students have been taught theoretical concepts and the fundamental underpinning knowledge, effectively prior knowledge matters. The reason for this is our old friend “cognitive load” and the need not to overwhelm learners with too much information at any one time. (Kirschner et al., 2006).

Technology of course has a role to play, in particular Virtual Reality (VR) which although expensive has much to offer in areas where mistakes can be costly. This is perhaps most evident in the medical profession where VR can place students in realistic life and death situations but in an environment that is safe, controlled and allows for mistakes.

Case studies and games
Both case studies and games provide opportunities for a similar learning experience to simulations.

Case studies – are effectively real-world stories in which the student applies what they have been taught with the objective of solving a problem or offering alternative solutions. In the business world these are not new, for example Harvard Business School are celebrating their 100 years of teaching using the case study method this year.

Although it’s possible to study on your own using case studies, because of the absence of a single right answer it is beneficial to engage with other students, exchanging ideas, discussing different theoretical topics and listening to alternative answers.  After which if you require a group consensus there is a need to prioritise and persuade others within the group, all of which are valuable skills.

Games – Wikipedia defines a game as a structured form of play, usually undertaken for entertainment or fun, and sometimes used as an educational tool. Most games have the same components, rules, an objective, challenge and competition. As with case studies if used for teaching they can allow the student to explore and test themselves with different problems, many of which have alternative courses of action. Having a competitor adds another dimension, perhaps sometime they are rational which might make them predictable but on other occasions they are irrational and illogical.

“We do not stop playing because we grow old, we grow old because we stop playing!”

Benjamin Franklin

Just to give some idea as to the scale of gaming and its popularity, in 2020 the video gaming Industry was estimated to be worth $160 Billion and by 2025 this figure is set to increase to $270 Billion. Now of course these aren’t educational games but it does show how valuable they could become if educators could somehow tap into their magic. And if you’re not familiar with how these games might be used, take a look at this short video that showcases the new and upcoming management games of 2021.

Realistic environments are not enough
Simulations, case studies and games all provide the opportunity to place the learner in a realistic environment to help them develop valuable work-based skills, but there is a caveat. Research has shown that simply putting the learner into a realistic environment is not enough (Clark, 2019), unless the very same evidence-based learning theories that are used in the classroom are also applied, that is deliberate practice, spaced practice, interleaving etc.

Like any form of teaching, these training environments need to be carefully constructed with the desired learning outcomes clearly identified and placed up front when designing the simulation or game. Yes, they can be fun, yes, they can be engaging but they won’t help you develop the required skills unless the evidence-based practices are used.

Strictly take 2 – How are contestants on strictly prepared for their real-world task, they have a rehearsal (simulation) on the Friday and two dress rehearsals (simulations) on the Saturday morning just before the show goes out live on the evening.

A few skills you can learn from a simulation

The knowledge verses skills debate – Strictly speaking

The skills gap
Although it is estimated that by 2030 there will be more people than jobs for those with lower skills, research conducted by the Learning and Work Institute estimated that England faces a deficit in higher level skills of around 2.5 million people, this is why we have a skills gap.

It’s not that we don’t have enough people it’s that we don’t have enough people with the right skills. It’s an education problem not a resource one…..

The solution is of course easy, train more people, but its skills we need not knowledge, right?

What are skills
A skill is the knowledge and ability that enables us to do something well. There are many definitions of skills but I like this one because it highlights the importance knowledge plays. But although knowledge is valuable, on its own it has limitations. For example, knowing the steps to the Argentinian Tango doesn’t mean you will be able to dance it. Knowledge is theoretical, whereas skills are practical. There is arguably no better place to see how skills are learned than Strictly, the BBC’s hugely successful dance show. Celebrities with differing abilities are given a dance that they need to perform each week, the process they go through is however always the same, and involves practice, practice and more practice.

What is knowledge
Most people will assume that knowledge relates to something written in a text book, be it words, facts, dates, numbers etc, and they would be right. To be precise this type of knowledge is called explicit or declarative knowledge. In addition, you will be aware that you “know it”, which on the face of it might sound strange but some types of knowledge (implicit and tacit) are unconscious, that is you have the knowledge but don’t know that you do, for example, “I can hit a golf ball straight down the fairway without thinking, but don’t ask me to explain how I do it because I have no idea, I guess I’m just naturally talented”. One final point, for knowledge to be understood it should be applied in a specific context or illustrated by way of example, which lifts the words from the page, often putting the learner in a more practical environment where they can “see” what they need to learn.

The Knowledge V Skills debate
Often knowledge and skills are put into conflict, with some promoting knowledge as being the more important. The current national curriculum in England as set out by the then Education Secretary Michael Gove requires that pupils should be taught a robust “core knowledge” of facts and information.

“Our new curriculum affirms – at every point – the critical importance of knowledge acquisition”.
Michael Gove

Whilst others promote the value of skills over knowledge, suggesting that technology provides knowledge for free.

“The world no longer rewards us just for what we know – Google knows everything – but for what we can do with what we know.”
Andreas Schleicher, Special Advisor on Education Policy at the OECD

But like so many things this type of dichotomy is not helpful, with evidence on both sides attesting to the importance of each. The truth is you need both, you can’t learn skills without knowledge and although knowing something has value, it’s what you can do that is most highly prized.

How do you learn skills?
To learn a skill, you first need knowledge, for example here is some of the knowledge required to help dance the Argentinian Tango.

Every dance has its own unique music, and you can’t master it without developing a feel for the music. Tango is a walking dance, meaning that all the steps are based on walking. When you start learning, you must first master some basic movements. Beginners usually start with 8-Count Basic or simply Tango Basic. The rhythm is slow, slow, quick, quick, slow.

We can then follow what is called the four-step approach to learning skills:
One – Demonstrate the skill with little or no explanation (demonstration)
Two – Repeat with an explanation whilst encouraging questions (deconstruction)
Three – Repeat again with the learner explaining what is happening and being challenged (formulation)
Four – Learner has a go themselves with support and coaching (performance)

Skills are developed through continual practice and repetition, learning by trial and error, asking questions whilst receiving advice to improve performance. An analogy or metaphor can sometime help e.g. Finding your balance is about feeling stable like a ship with an anchor.

Transferable skills are not that transferable
The ultimate goal of those that promote skills development is that once learned they can be taken with you from job to job, they are in effect transferable. However, research suggests that this is not the case. In July 2016 the Education Endowment Foundation in the UK released the results of a two-year study involving almost 100 schools. The experiment looked at the benefits of teaching chess as a means of developing generic skills, in this instance mathematical ability. It concluded, that there were no significant differences in mathematical achievement between those who had the regular chess class and the control group. Playing chess, does not make you better at maths, on the whole it only improves your ability to play better chess.
This supports the argument that skills are domain specific and that critical thinking learned whilst studying medicine does not necessarily help you become a better critical thinker in other areas. One reason for this may be that to become a good critical thinker you need large amounts of knowledge on which to practice. Which brings us full circle, skills need knowledge and knowledge becomes more valuable when applied in the form of a skill.

Strictly foot note – there is an argument that the celebrities on Strictly are only skilled in one dance at a time, and what is learned from one dance does not transfer easily to another.

 

Inquiry based learning is harmful – ouch!

Can I ask you a question, would you prefer to discover something for yourself or be told what you should know?

Choices as to how you want to learn are to a certain extent personal, perhaps even a learning style, but shouldn’t we be asking which is the most effective, and when it comes to that, we have evidence.

The problem is you might not like the results, I’m not sure I do.

The headline for this month’s blog is not mine but an edited one from John Sweller, of cognitive load fame, in a paper published this August by the Centre for Independent Studies in Australia. Although I have written about some aspects of Inquiry based learning before (IBL), it’s worth taking a closer look, especially given the impact Sweller believes IBL type methods have had in Australia. He suggests that the countries rankings on international tests such as PISA have reduced because of a greater emphasis on IBL in classrooms across the country.

But first…..

What is inquiry-based learning?
Inquiry based learning can be traced back to Constructivism and the work of Piaget, Dewey, Vygotsky et al. Constructivism is an approach to learning that suggests people construct their own understanding and knowledge of the world, through experiencing it and reflecting on those experiences. This sits alongside Behaviourism (see last month’s blog) and Cognitivism to form three important theories of learning.

As a process IBL often starts with a question to encourage students to share their thoughts, these are then carefully challenged in order to test conviction and depth of understanding. The result, a more refined and robust appreciation of what was being discussed, learning has taken place. It is an approach in which the teacher and student share responsibility for learning. There are some slight variations to IBL that include Problem-based learning (PBL), and Project-based learning (PjBL), in these rather than a question being the catalyst, it’s a problem.

This method is intuitively attractive and promoted widely in schools and higher education institutions around the world. Which is what makes Swellers argument so challenging, how can someone “learn better” when they are being told as opposed to discovering the answer for themselves?

What’s wrong with it?
To answer this question, I will quote both Sweller and Richard E Clark who challenged enquiry-based learning fifteen years ago in a paper called, Why Minimal Guidance During Instruction Does Not Work.

Unguided and minimally guided methods… ignore both the structures that constitute human cognitive architecture and evidence from empirical studies over the past half-century that consistently indicate that minimally guided instruction is less effective and less efficient than instructional approaches that place a strong emphasis on guidance of the student learning process.

The cognitive architecture they are refereeing to is the limitation of working memory and the need to keep cognitive load to a minimum e.g. 7+-2. In the more recent paper Sweller goes onto explain how the “worked example effect” demonstrates the problems of IBL and the benefits of a more direct instructional approach. If one group of students were presented with a series of problems to solve and another group given the same problems but with detailed solutions, those that had the worked example perform better on future common problem-solving tests.

“Obtaining information from others is vastly more efficient than obtaining it during problem solving“. John Sweller

In simple terms if a student (novice) has to formulate the problem, position it in a way that they can think about it, bring to bear their existing knowledge, challenge that knowledge, the cognitive load becomes far too high resulting in at best weak learning, and at worst confusion.

“As far as can be seen, inquiry learning neither teaches us how to inquire nor helps us acquire other knowledge deemed important in the curriculum.” John Sweller

What’s better – Direct instruction?
Sweller is not simply arguing against IBL, he is comparing it and promoting the use of direct instruction. This method you might remember requires the teacher to presents information in a prescriptive, structured and sequenced manner. Direct Instruction keeps cognitive load to a minimum and as a result makes it easier to transfer information from working to long term memory.

Best of both worlds
It may be that so far this blog has been a bit academic and does little more than promote direct instruction over IBL, my apologies. The intention was to showcase IBL, clarify what it is and point out some of the limitations. In addition to highlight how easy it is to believe that something must be good because it feels intuitively right. And in that IBL is compelling, we are human and learn from asking questions and solving problems, it’s what we have been doing for thousands of years. But that alone does not make it the best way to learn.

The good news is these methods are not mutually exclusive, and for me John Hattie, coincidentally another Australian has the answer. He says that although IBL may engage students, which can give an illusion of learning, if you are new to a subject (a novice) and have to learn content as opposed to the slightly deeper relationship between content, then IBL doesn’t work. Also, if you don’t teach the content, you have nothing to reason about.

But, there is a place for IBL…..its after the student has acquired sufficient knowledge that they can begin to explore by experimenting with their own thoughts. The more difficult question is, when do you should do this, and that is likely to be different for everyone.

One for another day perhaps.

Motivation by Reward and Consequence – Behaviourism

Motivation is one of the most important aspects of learning and as a result has featured in many previous blogs. In its simplest form motivation can be defined as something that you want; you want to get fit or you want to pass the exam, and as a result that want directs your behaviour. For example, if I want to pass the exam, a good behaviour would be to attempt 5 more questions.

But do we ever really know what is motivating someone? We could ask Tom Dean, the gold medal winner in the 200-meter freestyle at this year’s Tokyo Olympics. What motivated him to train even harder after he contracted Covid for a second time? I’m sure he would give us an answer, the problem is it could well be something he has constructed to explain it to himself rather than the real reason.

Maybe we should think less of the cognitive reasoning behind motivation and consider only the actions of a motivated person? It’s likely Tom had a few early mornings and went through some pretty painful training sessions in order to get fit for the games, but it could be that his ability to do this is more a consequence of conditioning rather than his desire for a gold medal. There is also the question as to why a gold medal is motivational, after all its not even gold, they are 92.5% silver. Interestingly the Tokyo medals include recycled metal from electrical devises. Maybe its because he associates it with success and or pride, something that he has been conditioned to over many years.

Behaviourism
Behaviourism, is a theory of learning which states that all behaviours are learned through interaction with the environment by a process called conditioning. The implication is that your behaviour is simply the response to a stimulus, a cause and effect.

The environment shapes people’s actions. B.F. Skinner

Its highly likely you will have experienced and even been involved in motivating someone in this way. For example, were you ever put on the naughty step as a child or told your dog to sit and when he does, reward him? These are examples of how changing the environment results in a different behaviour. The dog is motivated to sit not because it’s a lifelong ambition but because he wants the reward. Tom Dean may well have got up early to go training but that might have more to do with the conditioning resulting from his alarm going off, than a burning desire to get out of bed.

It is effectively motivation as a result of reward and consequence, if you do something you get something.

Classical conditioning – association
Ivan Pavlov, a Russian physiologist, discovered that dogs could “learn” to salivate at the sound of a bell that rang before they were fed. He called this classical conditioning, the dog associating the bell with food. These types of associations can be the reason people are afraid of spiders or chewing gum, yes, it’s real, Oprah Winfrey is a sufferer. It also explains why having a designated study area can help you feel more like studying, you associate it with getting work done. Here are a few more examples, your smart phone bleeps and you pick it up, celebrities are used to associate a product with glamour, Christmas music makes you feel Christmassy and an exam hall brings on exam anxiety.

Operant conditioning – reinforcement
In contrast to classical conditioning, operant conditioning encourages or discourages a specific behaviour using reinforcement. The argument being that a good behaviour should be reinforced by a repeated reward or a bad behaviour stopped by a repeated punishment. The person who developed this type of conditioning is B.F. Skinner, who famously used pigeons in what became known as “Skinner boxes”.

There are four types of reinforcement

  • Positive reinforcement – The behaviour is strengthened by adding something, a reward (praise/treats/prizes) which leads to repetition of the desired behaviour e.g. “Well done, Beth, that was a great question”. Here praise is added to encourage students to ask questions.
  • Negative reinforcement – The removal of something to increase the response e.g. “I can’t study because, everyone is shouting”. The shouting stops which encourages the behaviour of studying.
  • Punishment – The opposite of reinforcement, it adds something that will reduce or eliminate the response. e.g. “that’s probably the worse answer I have ever heard Beth, were you listening at all”. Here humiliation is added that will reduce the likelihood of students asking questions.
  • Negative punishment (Extinction) – This involves removing or taking something away e.g. “You can have your mobile phone back when you have done your homework”. In this situation removing access to the mobile phone results in the homework being completed.

A person who has been punished is not thereby simply less inclined to behave in a given way; at best, he learns how to avoid punishment. B.F. Skinner

Limitations
Skinner remained convinced anything could be taught with operant conditioning and went on to invent a teaching machine using the principles of reinforcement. It required students to fill in the blank, if the answer was correct, they were rewarded if incorrect they had to study the correct answer again to learn why they were wrong.

Give me a child and I’ll shape him into anything. B.F. Skinner

However, there are many limitations, the motivation is not always permanent, it’s too basic to teach complex concepts, punishment can lead to a reinforcement of the undesirable behaviour and its possible the person is just pretending.

Operant conditioning is still a hugely influential in the modern world, for example have you ever watched someone play a fruit machine, the required behaviour rewarded to extract more money. What about online gaming where points and leader boards provide rewards in terms of status and prizes.
Then then there are the ideas surrounding behavioural economics popularised by Nudge theory which suggest that you can influence the likelihood that one option is chosen over another by changing the environment.

And finally, have ever seen how the military train, check out this video.

So next time you think you are making a decision of your own free will, maybe you’re just responding to an external stimulus!

Becoming a better thinker – Edward de Bono learning leader

There are a number of people who have changed the way I think but no more than Edward de Bono who died this month aged 88, a great example of a learning leader.

Born in 1933, he graduated as a doctor from the University of Malta before studying physiology and psychology at Oxford as a Rhodes Scholar. He represented Oxford in polo, set two canoeing records and later gained a PhD in medicine from Trinity College, Cambridge.

But he is probably best known for two things, firstly as the creator of the term lateral thinking and secondly for his six thinking hats strategy that went on to influence business leaders around the world.

Lateral thinking

To understand lateral thinking, we first need to figure out what thinking is. There are many definitions but my own take is that it’s a reflective process involving the manipulation of knowledge, feelings and experiences as we seek to connect what we know with new information, normally focused on a problem.

There are two or maybe three modes of thinking!

1. Convergent – focuses on coming up with a single, “correct” answer to a question or problem. Examples of convergent thinking would include critical thinking, a logical process that involves challenging underpinning assumptions, questioning accuracy, motivation and purpose in order to make sense of a situation or solve a problem. Its origins can be traced back to Socrates, Plato and Aristotle, or as De Bono disparagingly referred to them, the gang of three.  Also, analytical thinking, where you break down complex information into its component parts, this can and is often used in conjunction with critical thinking. Convergent thinking is logical thinking, meaning its rule based, systematic and linear. If for example we concluded that 2 + 2 = 4 and we decided to add another 2, logically the answer would be 6. 

But logic can still be challenging, there is a logical answer to this question yet 80% of people get it wrong.

Jack is looking at Anne, but Anne is looking at George. Jack is married, but George is not. Is a married person looking at an unmarried person?
A: Yes
B: No
C: Cannot be determined

The correct answer is A. (click here for the explanation)

The need to be right all the time is the biggest bar to new ideas.

2. Divergent – is the opposite of convergent and involves coming up with many possible solutions, acknowledging that there may be no single correct answer. This type of thinking is often emergent, free flowing, illogical and requires creativity. Convergent and divergent thinking can be used together, divergent to generate ideas and convergent to make sense of those ideas and find a practical application. Click here for a video that explains how these two types of thinking work together.

3. Lateral thinking – is a way of solving problems by taking an indirect and creative approach by looking at the problem from different perspectives. Although there are similarities with divergent thinking it is not the same. Divergent thinking starts with a problem at the centre and random ideas are generated branching outwards in all directions, lateral thinking requires the individual to come up with a solution by generating different ideas that result from changing perspective. De Bono writes that lateral thinking forces the brain to break set patterns, it’s a pattern switching technique.

Let’s consider one of his examples, Granny is sitting knitting and three-year-old Susan is upsetting Granny by playing with the wool. One parent suggests putting Susan into the playpen, a relatively creative (divergent) solution. A logical (convergent) answer might be to tell Susan not to do it, but anyone with a three-year-old will know how effective this will be, but that won’t stop them trying!

The other parent suggests it might be a better idea to put Granny in the playpen to protect her from Susan, this is lateral thinking, looking at the problem from a different perspective. Its illogical because granny is bigger and surely you don’t need to protect granny from a three-year-old, but it is still a solution and would work.

I am reminded of a question I was once asked whilst visiting Berlin. “Why did the East Germans build the Berlin wall?” ………“To keep people in of course”, it was a prison not a defence. It’s all about perspective.

Lateral thinking is not a substitute for logical thinking and can be used as a way of generating new divergent solutions, they complement each other and are interchangeable. Lateral thinking is generative, logical thinking selective.

In summary lateral thinking is about changing perspective……

Most of the mistakes in thinking are inadequacies of perception rather than mistakes of logic.

My own personal favourite perspective story

This is the transcript of a radio conversation of a US naval ship with Canadian authorities off the coast of Newfoundland in October, 1995. Radio conversation released by the Chief of Naval Operations 10-10-95.

Americans: Please divert your course 15 degrees to the North to avoid a collision.

Canadians: Recommend you divert YOUR course 15 degrees to the South to avoid a collision.

Americans: This is the Captain of a US Navy ship. I say again, divert YOUR course.

Canadians: No. I say again, you divert YOUR course.

Americans: This is the aircraft carrier USS Lincoln, the second largest ship in the United States’ Atlantic fleet. We are accompanied by three destroyers, three cruisers and numerous support vessels. I demand that YOU change your course 15 degrees north, that’s one five degrees north, or countermeasures will be undertaken to ensure the safety of this ship.

Canadians: This is a lighthouse. Your call.

Lateral thinking for learning

But what has this got to do with learning? Well learning is not just about facts and knowing stuff, the reason we go to school is to gain an understanding of a wide range of issues, concepts and ideas that when faced with a problem we can manipulate and cross check in order to form opinion and come up with a solution. Learning is a consequence of thinking.

Learning without thinking is useless. Thinking without learning is dangerous.
Confucius

De Bono believed that thinking was a skill that could be learned and because lateral thinking helps people develop creative ideas, creativity could also be learned. It is not an innate trait, a type of intelligence that you are borne with, it’s something we all possess, we just need the techniques to do it. He did however distinguish between artistic creativity and idea creativity, Michael Angelo and Shakespeare are artistically creative, lateral thinking will only ever make you idea creative.

As to the techniques, maybe they will feature in another blog but if you can’t wait, here is a short video, but beware De Bono was the master of acronym.

We tend to take thinking for granted, believing we are good at it or maybe never even questioning our ability. But what De Bono made popular was the idea that it was a skill and that we can improve. We live in a time when information is more accessible and freely available than ever, so the real value has to be in what we do with it.

Thank you, Edward De Bono 1933 – 2021.

And lastly….the blog would not be complete without one of De Bono’s lateral thinking puzzles.

A man lives on the tenth floor of a building. Every day he takes the elevator to go down to the ground floor to go to work or to go shopping. When he returns, he takes the elevator to the seventh floor and walks up the stairs to reach his apartment on the tenth floor. He hates walking so why does he do it?

The man is a dwarf and cant reach the higher buttons.

Note making, not note taking – it’s about effort

I have always been a believer in the idea that much of what you need to know is accessible, the answer is staring you in the face and yet you can’t always see it. Maybe because you’re not asking the right question or looking at it from the wrong perspective.

Figuring out how learning works and the best way to study can seem complicated and yet if you watch what people do when they are trying to learn and ask the right questions there is much to see.

For example, watch a group of students in class or a lecture, (remember that pre-Covid) what do they do? Where are they looking, what are they concentrating on and most importantly what activity are they engaged in? The answer to this last question is easy, they will all be making notes. Going forward these notes will become the single most important learning resource the student has.

Why is note making important
There are two basic reasons why you make notes, firstly it improves concentration and cognition, making notes gives you something to do that requires attention, you become more focussed. Secondly you will have created a permanent record of what was said to review later. Interestingly if you asked students, they probably think capturing the information is the sole reason for notes, when in reality it’s the effort involved in making them that mattes in terms of learning.

Its worth adding that making notes works just as well from a book as it does a lecture.

How to make notes?

Blank paper notes – The simplest form of note making is to start with a blank piece of paper. Unfortunately, research tells us that most students notes are incomplete, on average they only capture one third of what was deemed to be important. In addition, they are often inaccurate, in one study, Crawford (1925) found that only 53% of noted information was fully correct, 45% was vague, and 2% inaccurate.

Conclusion – making notes in class is a good idea but if you use those same notes afterwards, not only will you be missing some important information but some of what is there may well be wrong.

Full notes – An alternative to a blank piece of paper is to give students a full set of notes. In 1987 a study by Kiewra and Benton showed that students who reviewed full notes achieved 17% higher scores than students who reviewed their own. This of course may not be surprising given the lack of information captured by students in the first place. Interestingly there is even some evidence to show that reviewing a full set of notes is better than attending the lecture!

Just to be clear, the best way of learning is to attend the lecture, make notes but then review a full set of notes not your own. Unless of course there is another way….

Partial, Scaffolded, Skeletal and Gapped notes
Partial notes may offer the best solution, helping keep the student engaged when in class but providing them with a sufficiently complete set of notes from which to study later. Partial notes contain the main ideas but leave blank spaces for students to complete, for example producing or labelling a diagram, adding in key definitions, working calculations etc. More research in 1995 from Kiewra and Benton but this time in collaboration with Kim, Risch, and Christensen showed a marked increase in completeness from 38% for those who used a blank piece of paper to 56% for those that were given partial notes. What we don’t know from this research is the level of detail that was missing, but it proves the point.

Note taking cues – One tip for teachers, the more cuing or signposting that is deployed the better. This might involve pausing and telling students they must pay attention to a particular point or simply writing out a key phrase or definition on the whiteboard. In one study, students recorded 86% of the information written on a blackboard (Locke, 1977).

Handwritten or typed?
This is a difficult one to answer, with some research to support both forms. We know that most students can type more quickly than they can write and as a result they should have more comprehensive notes to study from. But in 2014 Mueller & Oppenheimer cast doubts on the viability of laptop note taking. They concluded that “whereas taking more notes can be beneficial, laptop note takers’ tendency to transcribe lectures verbatim rather than processing information and reframing it in their own words is detrimental to learning”. In addition, laptop users did not capture diagrams that well, this was thought to be the result of the difficulty of doing this digitally. Copying and pasting certainly captures information but is a relatively mindless activity and leads to a certain amount of unnecessary information being recorded which is off little value.

Conclusion
It would be wrong to conclude that making notes on a computer is worse than writing them out by hand. Its more that a computer makes it easier for students to disengage or become distracted, and if that happens, the learning is less effective. To a certain extent learning has to be difficult, it’s all about the effort, the more you try the more you learn.

We can however say that partial notes are a very good compromise, offering the best of both worlds, helping students capture sufficient information to review later but requiring them to concentrate whilst sitting in class.

I’m now off to — in the —— and have a cold —-

For more links to the research, here is an excellent summary, Note-taking: A Research Roundup by Jennifer Gonzalez – The cult of Pedagogy