Author Archives: Stuart Pedley-Smith

Revising Revision – and exam proximity

Posted on by

Several years ago, I was asked a very interesting question, why do students’ revise just before the exam. At the time I thought it odd that anyone would even ask, but I realised I hadn’t thought much about it, partly because that’s the way it had always been.

The alternative approach was, rather than having one big revision session at the end of the course, we should have two or three shorter ones at appropriate points during the course. This would avoid the need to revise so much all at once and as a consequence reduce the effort required. It was a good question…….

What is revision?
Lets start with a definition, the word revision can be traced back to the Latin “reviser” which means to look at again, visit again, look back on.

In learning it can be thought of as the process of reviewing and re-examining previously learned material to reinforce understanding, improve retention, identify gaps in knowledge and be well prepared for the test, exam or assessment.

To better understand what revision is, let’s take a closer look at some of those objectives.

  • Reinforcing understanding – people tend to think of understating in binary terms, that is you either understand or you don’t. But understanding has several different levels, starting with the most basic, can you explain something? For example, I can explain to some degree, how a combustion engine works but could I apply that knowledge to how it might work in F1, I don’t t think so. Being able to apply your knowledge in different ways is a higher level of understanding. At the opposite end of the spectrum to being able to explain something is what is called self-knowledge. This is the highest level of understanding and is where you are so good, you can challenge your own thinking by asking, what are the limits of my understanding, identify prejudices and ultimately become aware of what you don’t really understand, which is kind of ironical when you think about it! The point being that when you look back and reflect on what you have already studied there may be an element of reinforcing or reconfirming your understanding of a particular topic but you will also be deepening your understanding, effectively moving it to another level.  

“I know only one thing: that I know nothing”. Socrates

  • Improving retention – we have to be careful with this one, although the act of looking back improves retention, the secret lies in how you do it. For example, re-reading notes, even with the use of a highlighter may feel that its helping but this is a well-researched area and the evidence tells us in terms of retention, it doesn’t really work. This is in contrast to retrieval practice, a study method that I have written about in several previous blogs. Here the learner is forced to engage with the material in an active way rather than a passive one, most often by asking them to complete a test or answer a question, in fact it’s often referred to as the testing effect. The very process of making the learner think about what they know, strengthens the connection with the material they are trying to learn, and moves it from short term memory into long term memory, which is how learning happens.
  • Identify knowledge gaps – this is perhaps the most obvious one, looking back on a subject will reveal areas that you might not even remember studying at all. The implication is that there will be a certain amount of learning taking place for the first time. Of course, gaps in knowledge should be kept to a minimum by ensuring that the subject coverage is as comprehensive as possible, or at the very least focused on the most important areas. However, do not expect to have a complete grasp of everything, this is especially true as you move up that academic ladder, even experts have gaps in their knowledge.
  • Preparation for the test – this is not really about learning, its preparation for the challenge ahead, effectively making sure you are match fit.  One of the best things you can do in the revision period is practice past questions, including the completion of a mock exam. Not only will you be benefiting from retrieval practice, you will also be developing what researchers in 2016 called “question literacy”, the ability to know what the examiner is asking because you have seen similar questions before. Attempting a mock under exam conditions can also help you better manage time and be prepared for the way you feel under pressure. It’s no good having worked hard to understand the subject matter if you can’t answer the questions in the time available. Equally you need to practice leaving questions you want to answer in favour of those that you don’t, remember its always easier to get the marks at the start of a question than at the end.   And finally, when the exam is just around the corner, although you may feel more anxious your levels of motivation, concentration and work ethic will almost certainly rise.  

Preparing for the test doesn’t help you pass; it stops you failing. SPS

Why revision should be just before the exam
Whilst it’s possible to improve retention and identify knowledge gaps during your studies, you can’t effectively prepare for the exam until its close enough that the reality of how little time you have left is clear. Why do people suddenly become motivated, well its partly because the challenge is no longer distant, it’s no longer at some point in the future, its next week. It’s a variation on something called myopic discounting. For example, it’s very difficult to motivate yourself to work over a weekend in September if you know the exam is in June the following year. Also, the way you are learning changes when the exam is very close, you are no longer sitting in lectures or reading books but practicing past questions, improving your question literacy whilst building up your levels of resilience and learning new exam skills such as time management.

And one final thought, although some of what is memorised, rather than understood in the revision period may be forgotten, it can still help you pass on the day. Poor learning perhaps but good exam technique.

I Do, We Do, You Do – The importance of Scaffolding

Posted on by

It’s not a bad analogy to think of learning as if you were building a house.

Although you’re going to need help, when the house is finished it will all be yours. Firstly, it’s important that the foundations are strong, if not what follows may be unstable and at worst collapse. Then slowly but surely, you place one brick on top of another. The whole process requires planning, time, motivation and a significant amount of effort. But when the roof is finally on and you move in, you should feel rightly proud of what you have achieved and hopefully believe it’s all been worth it.

Although the house now looks strong and well-built, a short while ago it was covered in scaffolding, which was essential if the house was ever to be finished.

And that’s a nice introduction (hopefully) to this months’ blog, something that helps make learning possible but at the end can no longer be seen – Its name scaffolding!

Scaffolding (background – bear with me)
The term scaffolding first appeared in the work of Jerome Bruner in the 1960s and more formally when he published his ideas in the early 70’s. According to Bruner when a learner first encounters a new concept, they need help from an expert or teacher but as the learner becomes more independent in their thinking and acquires new skills and knowledge, the support can be gradually removed. The implication is that the learner will be able to achieve far more with scaffolding than would have been possible on their own.

Bruner’s ideas were not his alone and were an extension of some of the work of Lev Vygotsky and his thoughts around the zone of proximal development (ZPD). The diagram shows what a learner can achieve on their own compared to what is possible with guidance.

Direct instruction – I do- we do – you do
Its very easy to be underwhelmed by both Bruner and Vygostky, in simple terms all they are saying is that, people can learn more if they are supported and helped by an expert, Wow! But their work underpinned a popular and very practical technique, a form of Direct Instruction, called, I Do – We Do – You Do.

As you might know from previous blogs, I am a big fan of Direct Instruction, largely because there is evidence that proves it works. But sometimes it’s hard to convince others as to its merits because the term “instruction” sounds like you are telling the learner what to do, which some believe in particular Constructivists that this is not the best way to teach. Yet few would argue with this model, partly because it seems sensible, is practical and effective.

In addition, it’s one of the most popular techniques used in Professional Education, this is because of the very tight time constraints, levels of technical detail that have to be learned and the high stakes nature of the exam.

Here’s how it works.

  • I Do – In this phase the teacher should model the new learning having broken the content into small chunks, using worked examples and step by step instruction. The learners should have their pens down (Tablets, PCs closed) so they can focus on what the teacher is doing. Pace is important, the modelling should not be rushed, questions can be taken at the end.
  • We Do – This is when the scaffolding starts to take effect. In this phase the learners have a go on their own or at least attempt part of the task before stopping to check if they are on the right track, maybe confirming their understanding. The teacher needs to remain alert and might have to step in to clarify an area that seems to be holding everyone back. It may prove necessary to stay at this stage for some time, there is little point moving on until everyone is happy to do so.
  • You Do – Finally, once the learners are confident with the steps required, they are ready to have a go completely on their own. The whole process is effectively a gradual release of responsibility, giving the learner more and more control over their own learning until they become independent. There could also be a need for some levels of personalisation because some learners will take longer than others to master the new content.

This is not the only way you can use scaffolding, there are many other techniques but I hope that you can see its one of the most effective.

Video – don’t be put off by the simple nature of this video, it explains it very well.

Podcasting for Learning “Podagogy”

Posted on by

(Not written by ChatGPT) 

There are over 4 million Podcasts registered worldwide. South Korea boasts the biggest podcast listenership, with the UK sitting just outside the top 10. Over 19.1 million Britons listen to podcasts and 40% of them are aged between 26 and 35.

The most popular podcast in the world is the Joe Rogan Experience, with 11 million listeners and although this show is 2 hours long the average length is between 20 and 40 minutes.

Whatever way you slice or dice the data, podcasting has become hugely popular, but does it have a role to play in helping us learn?

What is a podcast?
Simply put, a podcast is a digital audio file that can be downloaded via the Internet to a computer or mobile device for listening. It’s similar to radio in that it has an auditory modality but that’s where the similarity ends, podcasts are on demand, pre-recorded, broken down into episodes and the subject matter is targeted at niche audiences rather than mass appeal.

The growth in podcasts suggests they must be offering something their audience wants, maybe it’s just the convenience, easily listened to on a mobile device and short enough to be consumed whilst walking the dog or working out at the gym. This is certainly a factor but there is more to it than that.

Impact on Learning
When asked, people provide a whole host of reasons why they listen to podcast, for example, entertainment, to keep up to date, to relax, and for inspiration. But one of the biggest areas often quoted, is to learn something new. But the question is, how good are podcasts in helping people do this?

Let’s look at some research – In 2007 Kurtz, Fenwick, and Ellsworth produced a paper called,” Using podcasts and tablet PCs in Computer Science”, there conclusion, although podcast learners didn’t perform any better in the exam their project grades were substantially higher. But these were video podcasts, effectively recorded lectures with slides which is not really what we are talking about here. A far more relevant and conclusive result came from Abt and Barry (2007), “The Quantitative Effect of Students Using Podcasts”. One group of learners listened to six podcasts over six weeks, while the other group were provided with an exact transcript of the podcasts in printed form to ensure both groups had the same content. After six weeks, the groups were re-examined both taking the same test. The results were the same, the podcast group were no better, leading to the conclusion that podcasts provide little quantitative benefit over and above written text.

However, learners like them and when asked often say, they make content easier to understand and are very engaging. But it’s hard to conclude anything from the empirical evidence other than podcasts have a positive effect on learner satisfaction but little or no impact on performance. Even where some benefits have been shown they are more likely the result of encouraging better study habits than providing something valuable in terms of learning.

Visual and auditory memory
The above is not entirely surprising especially when you consider how memory works. Researchers at the University of Iowa found that when it comes to memory, we don’t remember things we hear nearly as well as what we see or touch.

“As it turns out, there is merit to the Chinese proverb ‘I hear, and I forget; I see, and I remember,” James Bigelow, lead author of the study at UI

The researchers found that although learners memory declined across all modalities when time delays grew longer, the decline was much greater for sounds, and began as early as four to eight seconds after being exposed to them.

Podcast are good for learning!
However this doesn’t mean podcasts have no role to play in learning, they do, but they need to be used alongside evidence-based techniques such as spaced and retrieval practice, interleaving etc as well as good teaching practices, for example using projects and group work. Imagine a 15m podcast in the form of an interview between two people debating the merits of putting jam on the cream or cream on the jam when eating a scone. If at the end of the podcast a task was set, maybe asking the learner to summarise what was discussed or prepare a short presentation of the key points, this would force the learner to listen several times, think more deeply about the task and what was being said, the result of which would be learning.

They can also be beneficial in the revision phase when the exam is just around the corner, for example, you could listen to key definitions supported by proven memory techniques such as visualisation, repetition and the use of rhyme. Talking out loud along with the podcast would also help. Why not produce your own podcasts, perhaps with another learner that can be listened to in the car or ask ChatGPT to write you a podcast script based on what you are trying to learn.

Podcasts do have a role to play in learning, they can help develop critical thinking by listening to a debate with counter arguments, the key is to engage, don’t be passive. However, audio as a modality on its own is not the most effective method of learning, but as another tool in the box, it’s worth having.

Kaplan – Learn better podcast
I have been hosting a podcast for the last two years for Kaplan and we are now in season three, in fact episode 22 was released this week. It is for a relatively niche market as is the case with podcasts but if you work in finance and would like to listen to some inspiring people, click here – enjoy.

Mobile phones for learning – The world in your pocket

Posted on by

The statistics are striking, there are 5.44 billion mobile phone users in the world, that means that 68% of the world’s population have one. 92.3 % use their phone to go online at least some of the time, and mobile phones now account for more than 56.9 % of our online time.

This is according to Datareportals Digital around the world report 2023. It means that pretty much everyone in the West will have a mobile, as will most people studying over the age of 10. I say 10 because a recent BBC report stated that in the UK smartphone ownership rises from 44% at age 9 to 91% by the age of 11.

This means we have access to the world in our pocket and as a consequence the worlds knowledge.

“Mobile phones are misnamed. They should be called gateways to human knowledge. Ray Kurzweil, computer scientist.

Mobile phones and learning
We might have access to the worlds knowledge but as readers of this blog will know, having knowledge is not the same as learning. To solve this conundrum we need to start thinking of the mobile phone as a domain, a place to go when you want to learn, and less as somewhere that simply stores knowledge. As an analogy, If a book is knowledge, the library is the domain. But as a learning domain the mobile phone has limitations in particular in terms of screen size, the implication being learning has to be designed to be effective on a small screen.

But aren’t mobile phones bad? – Before exploring how we might improve the way we use mobile phones for learning we should probably address some of the concerns many have about them. They can become additive which perhaps unsurprisingly has been proven to result in lower grades. In addition they are a distraction, this study concluded that there was “a significant negative relationship between total time spent using smartphones and academic performance”. However, the researchers went on to say that having a mobile in class was not in itself the problem, it’s how and when it was used. The learning loss is more a result of us not being wired to multi task, and whilst we may think we can check a message on our phone and pay attention, we can’t.

“Smartphone is definitely smarter than us to be able to keep us addicted to it.” Munia Khan, author.

This brings us to one of those often-quoted statements, that technology is neither good or evil, its how people choose to use it. Also, I’m talking here not so much about a mobile devise used in and around the classroom but very much outside of it. Even to the extent where there is no classroom and studying is completely remote and online.

Mobile first learning
Luke Wroblewski who is now a Product Director at Google came up with the idea of mobile first in 2009. The concept is simple, you should design for the mobile platform first and then scale the experience for use elsewhere. It has led to a whole series of instructional design ideas:

  • Keep content short and focused (microlearning) – We have come across the concept of chunking before and it is implicit that if you want content that is short and focused it has to be chunked. The idea is that by keeping each segment short it allows the learner to complete some of the lessons in just a few minutes as well as reducing cognitive load.
  • Design for the small screen – Content layout, graphics, and text should all be imagined in terms of what they will look like on a mobile devise.
  • Build in social features – Mobile is dominant in the social space, very few people use anything other than a mobile to communicate with friends, think Snapchat, What’s App and Instagram. Any learning domain should certainly include a space where learners can share ideas and keep in touch.
  • Gamification/Game Mechanics – One of the problems with online learning in general is maintaining engagement, but games and gamification, the use of points, badges and leader boards are excellent in terms of holding attention and were made for mobile devises.
  • Virtual and Augmented Reality (VR & AR) – In the last three or four years, VR and AR have found their way onto mobile devices and into the wider online learning space. And although VR works best with a headset, AR is a good fit with mobile, allowing us to view the real world through a mobile screen whilst the technology augments what we see, bringing in new information and ideas. Examples would include Pokémon but more recently IKEA have developed IKEA place where you can overlay pictures of furniture into your own home and in education, look directly inside the human body to learn more about the anatomy.

 Learning in the flow of learning…….

“You can’t teach people everything they need to know. The best you can do is position them where they can find what they need to know when they need to know it.” Seymour Papert, mathematician, computer scientist, and educator.

Lessons for learners
A mobile phone is an amazing technology, its effectively a wearable devise that you take everywhere. It makes it possible to access huge amounts of knowledge that if structured properly using good instructional design can be a very effective way to learn. There are also so many different ways in which this knowledge can be consumed in addition to a full course for example podcasts, videos, specific apps such as Duolingo, short tests, and quizzes. However not everything works well on a mobile, reading large amounts of text on a small screen is difficult, takes more time, is not especially engaging and there is some evidence to prove it lowers reading comprehension.

Your mobile can be used to learn outside of the classroom ultimately because it makes learning both convenient and accessible, but one word of warning, don’t forget whose in control!

“It is okay to own a technology, what is not okay is to be owned by technology.” – Abhijit Naskar, Mucize Insan, Neuroscientist and author.

Top Gun: Maverick or a Study With Me Video?

Posted on by

I like to think I’m reasonably up to date with what’s happening, especially when it comes to studying and learning but I have to confess I have only recently come across what are called “study with me videos”, which have actually been around for more than 5 years. Study with me videos are exactly what they say they are, a type of video in which people prepare for an exam on camera, while others watch and study at the same time, it’s literally a video of someone studying, either live streamed or recorded.

Before we go any further its worth taking a look at some of these videos.

Firstly, Thomas Frank who describes himself as a video creator and writer with a focus on productivity, learning, and personal development. Thomas has a huge following on YouTube with nearly three million subscribers, although he offers far more than just study with me videos, here is one of his, a  25-Minute Pomodoro Session.

Secondly a Korean YouTuber who broadcasts under the name of “the man sitting next to me”. In Korean they call making these video gongbang, which translates to “study broadcast”. Normally the man sitting next to me live streams but here is a recording with a background rain sound effect thrown in for good measure.

And thirdly Jamie Lee, who lives in New York and has a YouTube channel called “The Strive to Fit.” She started her channel when she was in medical school but even though she has now qualified as a doctor she continues to broadcast. Unlike The Man Sitting Next to Me, Jamie’s “study with me” video are pre-recorded. Two clips from Jamie, the first a typical study session, with background music, its already had 1.3 million views, and secondly a get to know me video where Jamie answers questions.

What purpose do they serve?

As you can see from these videos each person has their own individual style with some streaming live whilst others are pre-recorded and slightly more professional with music, the sound of rain or pen on paper etc. As a slight aside if you just want the background noise and a relaxing scene, here are a few more videos, an ancient library with a roaring fire, a cosy library with jazz playing in the background and heavy rain that will apparently help you throw away that stress.

But what’s the point of these videos, why do people find them helpful?

  • Motivational and help with feelings of isolation – the YouTubers who make these videos are all students, they are therefore by definition the same as the people watching, and if they can sit down for two and a half hours and study, I guess you can do the same. Rather than getting in with a “bad crowd” you’re in with the good guys, they are hardworking, studious, and ambitious, their behaviour and attitude can and does rub off. This is consistent with Albert Banduras social learning theory, where he discovered that when people observe others they begin to model and imitate their behaviours. In addition, these are communities, comments are made underneath the videos by the many students that watch them, reminding you that you are not alone, and that others are feeling the same pressures. These YouTubers often connect on a personal level, by explaining why they work so hard and sharing details of their personal lives, successes and failures. To all intents and purpose, they are your study buddy.
  • Excellent for time management – the Pomodoro technique, which was mentioned above is where you break your studying down into short 25-minute sessions, these videos work very much in the same way by helping manage your time.  In fact, as you saw in the Thomas Frank video, he actually studies for exactly 25 minutes. There is also some evidence to show that studying like this in short bursts helps with memory and improved attention.
  • An inspiring learning environment – environment plays an important when it comes to learning, having a physical location where you study can get you into the right mood as soon as you enter it. It’s one of the reasons people go to a library, you know that before you walk through those doors what you are there for and need to do. As a result, when you sit down at your desk open up your laptop and put on your study with me video, it’s time to start work.
  • Good study practice – in addition to producing the study with me videos many YouTubers will offer up study tips such as how to use mind maps, memory skills, effective note taking etc.   
  • But the research shows that silence is the best – it may be that the sound of rain or the scribbles of a pen on paper help you feel less isolated, almost all of the research in this area has shown that problem solving and memory recall tasks are performed better in silence. As a result, there may be a time when you would be best just turning the sound down.
  • They help the YouTuber as well – most of those making these videos acknowledge that because they feel a responsibility to their fellow students it motivates them to study as well.

One final observation about these videos they are not collaborative in the sense that students work together in order to solve a problem, that’s just not what they are trying to achieve.  

But which one is best, Top Gun or study with me videos?

In the interests of balance, here is the trailer for Top Gun: Maverick for you to decide for yourself.  

Let’s chat about ChatGPT – WOW!

Posted on by

If you have not heard of ChatGPT, where have you been since November 30th when it was launched by OpenAI the company that developed what is fast becoming a groundbreaking technology. Since then, it’s been making waves, everyone is talking about and using it. In the first week alone over 1,000,000 people had subscribed to what is for the time being at least, free. OpenAI was founded in 2016 by Elon Musk, Greg Brockman, Ilya Sutskever, Wojciech Zaremba, and Sam Altman, although Musk stepped down from the board in February 2018 to avoid any conflict with Tesla.

Originally a “not for profit”, in 2019 it became a “capped for-profit”, meaning in this instance that investors can’t earn more than 100 times their investment. And just to give some idea of scale, OpenAI expects to generate $200 million in revenue next year and $1 billion by 2024.

Its mission is simple, yet as you might imagine ambitious – to ensure that artificial general intelligence benefits all of humanity.

In contrast here is Googles mission – to organise the world’s information and make it universally accessible and useful.

But what is ChatGPT? – To find an answer to this question, we can actually ask ChatGPT, however before we do there are some points worth noting. ChatGPT is not a search engine unlike Google, it’s not even connected to the internet, in fact the data sets used to train it haven’t been updated since the end of 2021. You will find this out if you ask anything relatively topical, for example, who won the World Cup this year, it will say….

“I’m sorry, but I am not able to provide information about events that have occurred after my knowledge cut-off in 2021”.

The answers appear in real time in a suitably bot like fashion, but what makes it really interesting is that it uses Generative AI, which enables it to start with existing content but from that produce something new and original, let me clarify, its not simply taking content from somewhere else, its creating new and original stuff.

ChatGPT is a variant of the GPT (Generative Pre-trained Transformer) language model developed by OpenAI for use in chatbots and conversational systems. It is able to generate human-like text in real-time and understand the context of a conversation, allowing it to generate appropriate responses based on the topic being discussed. ChatGPT is also efficient and fast, making it ideal for use in chatbot applications where fast response times are important. It is able to handle a wide variety of tasks, including answering questions, providing information, and engaging in casual conversation.

The above was the answer provided by ChatGPT when asked for a definition within 90 words. In fact everything in purple and italics in this blog has been taken directly from ChatGPT.

How does it learn?
Once again let’s ask ChatGPT, after all why should I do all the hard work.

ChatGPT uses a type of machine learning called supervised learning. In supervised learning, the model is trained on a labeled dataset, where the correct output is provided for each input. The model is then able to make predictions for new, unseen data based on the patterns it learned during training. too train ChatGPT, a large dataset of text is fed into the model, and the model is then trained to predict the next word in a sequence based on the words that come before it. Through this process, the model learns to recognize patterns in language and generate coherent text. The more data the model is trained on, the better it becomes at generating natural-sounding text and understanding the relationships between words and concepts

In summary, the model is initially trained by humans (The labeller), this is the supervised stage. It is then able to provide multiple answers to a question of which the trainer ranks in terms of quality, this is the reinforcement stage which provides more data for the model. And lastly, reward models are created that automatically reward the model for getting it right, the unsupervised stage.

It might be easier to think of it in the same way as you would if learning to ride a bike, for example firstly someone shows you how to ride a bike, (supervised) secondly you have a go and are given feedback in order to improve (reinforcement) and finally, if you ride for 5 minutes, you will be rewarded with £5.00, fall off and you get nothing. (Reward model – unsupervised).

Clever… but what are the implications?
We are at one of those “genie out of the bottle” moments, when something that you thought might happen in the future becomes a reality today. As a consequence, we start to ask questions such as, is this technology good or bad, what will it mean for jobs and the future of work? If it can produce high quality answers to questions, how can we tell if it’s the student’s work or simply the result of an exercise in cut and paste? And because it can write poems, stories and news articles, how can you know if anything is truly original, think deep fake but using words. By way of an example, here is a limerick I didn’t write about accountants.

There once was an accountant named Sue
Who loved numbers, they were her clue
She worked with great care
To balance the ledger with great flair
And made sure all the finances were true

Okay it might need a bit of work but hopefully you can see it has potential.

We have however seen this all before when other innovative technologies first appeared, for example, the motor car, the development of computers and more recently mobile phones and the internet. The truth is they did change how we worked and resulted in people losing their jobs, the same is almost certainly going to be the case with ChatGPT. One thing is for sure, you can’t put the genie back in the bottle.

Technology is neither good nor bad; nor is it neutral. Melvin Kranzberg’s first law of technology

And for learning
There have already been some suggesting that examinations should no longer be allowed to be sat remotely and that Universities should stop using essays and dissertations to asses performance.

However, ChatGPT is not Deep thought from The Hitchhikers Guide to the Galaxy nor Hal from 2001 a Space Odyssey, it has many limitations. The answers are not always correct, the quality of the answer is dependent on the quality of the question and as we have already seen, 2022 doesn’t exist at the moment.

There are also some really interesting ways in which it could be used to help students.

  • Use it as a “critical friend”, paste your answer into ChatGPT and ask for ways it might be improved, for example in terms of grammar and or structure.
  • Similar to the internet, if you have writers block just post a question and see what comes back.
  • Ask it to generate a number of test questions on a specific subject.
  • Have a conversation with it, ask it to explain something you don’t understand.

Clearly it should not be used by a student to pass off an answer as their own, that’s called cheating but it’s a tool and one that has a lot of potential if used properly by both students and teachers.

Once upon a time, sound was new technology. Peter Jackson filmmaker

PS – if you are more interested in pictures than words check out DALL·E 2, which allows anyone to create images by writing a text description. This has also been built by OpenAI.

What the heck is Neurodiversity?

Posted on by

Firstly a few definitions, Neurodiversity is a term used to describe the spectrum of differences that exist as to the way brains function differently from each other. Neurodivergent refers to an individual who processes information differently to what might be considered standard or typical.

“I am a very slow reader. I have to have things written in a pithy way.” Matt Hancock, Dyslexic.

Most people are classed as Neurotypical, meaning they process information in a manner that would be considered typical. In terms of behaviour, they tend to learn skills and reach developmental milestones around the same time as others. These words are chosen carefully to avoid using ‘normal’ and as a consequence ‘abnormal’. This is not about being politically correct but highlights that the differences can result in both positives and negatives depending on the circumstances.

By way of an example of what processing differently looks like watch this video of Stephen Wiltshire, MBE, the British architectural artist who was diagnosed with autism when he was 3.

Neurodiverse conditions
There are a whole range of different Neurodiverse conditions, they include Dyslexia, Attention-deficit/hyperactivity disorder (ADHD), Autism spectrum disorder (ASD) and Dyspraxia. In terms of how diverse we are as a nation it is estimated that more that 15% of the UK population are Neurodivergent in some way with the most common being dyslexia at around 10%, followed by ADHD.

“Being dyslexic, I was told that I was an idiot all the time.” David Bailey (Photographer), Dyslexic.

I am going to focus on dyslexia because it’s the one most people have heard of but for completeness here are further details of the Neurodiverse conditions mentioned above.

  • Dyslexia, primarily affects the skills involved in accurate and fluent reading of words and spelling.
  • ADHD is behavioural resulting in people being restless, struggling to concentrate and having a tendency to be impulsive.
  • ASD, as the name suggests is a spectrum, with people experiencing a wide variation in the type and severity of symptoms. The main ones being difficulty with social communication and interaction, and restricted, repetitive behaviours or interests.
  • Dyspraxia affects movement and co-ordination.

“I had to train myself to focus my attention. I became very visual and learned how to create mental images in order to comprehend what I read.” Tom Cruise, Dyslexic.

What’s happening in the dyslexic brain
Like many other Neurodiverse conditions dyslexia results from the way in which the brain processes information. Magnetic resonance imaging (MRI) has provided us with a unique picture as to what is happening in the dyslexic brain, for example we know that when people who are dyslexic read, a different part of their brain is activated. The main problem with the commonest form of dyslexia, phonological dyslexia is that the brain finds it difficult to recognise phonemes, these are the basic sounds of speech, for example the C in Cat is a phoneme. The impact is that it’s hard for the brain to connect the sound with the letter which in turn makes recognising words problematic. Unfortunately, in the time it takes to make the connection, comprehension is lost and the learner falls behind, creating the impression that they are slow and not very clever!

“Being diagnosed with dyslexia at age 60 was like the last part of the puzzle in a tremendous mystery that I’ve kept to myself all these years. “Steven Spielberg,” Dyslexic.

What causes Dyslexia
Knowing what is actually happening inside the brain of someone with dyslexia is interesting but there is perhaps a more pressing question, why do some people have it and others do not? Most of the evidence points to a genetic connection with some suggesting that if a parent has dyslexia there is a 40% to 60% chance of their children also being dyslexic. The risk is increased if the condition is known to exist in the wider family. That said the degree to which anyone is impacted is less well known and it may be relatively mild and as a result will go undetected. Environmental factors are also believed to play a part, these include the mother’s health during pregnancy and poor diet.

“Both my sons are dyslexic, and so, too, in a much milder form, is one of my daughters.” Theo Paphitis, Dyslexic.

At this point I did intend to add that dyslexia is two to three times more prevalent in males, however this is not universally accepted and there seems to be some contradictory research so I will leave that one for now.

“I suffer from severe dyslexia. I was the only child on my block on Halloween to go ‘trick or trout’ … Here comes that young William’s boy. Better get some fish. ” Robin Williams, Dyslexic.

What can you do?
Should you get a formal diagnosis, well maybe and it could be necessary especially if you want to get extra time in an exam. A diagnostic assessment for dyslexia is carried out by experienced specialist teachers and psychologists across the UK. The British Dyslexic Association (BDA) quotes an average fee for a specialist teacher of £515 and for a Psychologist £670 although there are cheaper options available. But if you just want to know a little more there are many free checklists or screening options, here is one from the BDA.

However, if you are a slow reader, have difficulty spelling, need to re-read paragraphs to better understand them and confuse similar words such as dog and dug then maybe you have enough information. Whatever route you choose for diagnosis, below are some positive steps that can help improve how you learn.

  • Do not use dyslexia as an excuse, it’s not who you are, nor a reason as to why you can’t succeed.
  • Recognise that dyslexia has nothing to do with intelligence, it’s a processing of information problem.
  • You may find that podcasts and other forms of audio recordings are an easier way of taking in information. You can also listen to them several times.
  • Ask for and use dyslexic friendly fonts. In a classic study, fonts that were found easier to read were Sans Serif fonts, such as Arial and Comic Sans with a font size of 12-14 point, another key takeaway was that italicising words severely decreases its readability.
  • Make lists and produce notes in a bullet style format. Also consider using more visual techniques such as mind maps and diagrams.
  • Allow for the fact that it will take you more time, tell yourself that slow is better.
  • Consider dyslexic tools such as coloured overlays, there are also many great apps out there that can help such as Voice Dream Reader which lets you listen to any document and ebook using text-to-speech.

The overall message is that we all process information in different ways, but a traditional school environment does not favour those with Neurodivergent traits. However, take full advantage of all the support and remember school may not be your best event in the “decathlon of life” but there will be other events at which you can and will excel.

I would like to thank two of my Kaplan colleagues Abbi Nolan and Kirsty Gibson for sharing their expertise and inspiring me to find out more about this fascinating subject.

The Metaverse and Learning – Blue or Red pill?

Posted on by

Getting to grips with the Metaverse is one thing, attempting to figure out if you should take the blue or red pill and enter it as either a learner or educator is another. Which is my way of saying, this is a big, complicated gnarly subject and getting a definitive answer highly unlikely, partly because the Metaverse doesn’t exist just yet and as a result we have little or no evidence to prove its effectiveness either way.

However, maybe we could get some insight by looking at the component parts and imagining its potential.

A Virtual world
Although we need to define the Metaverse, to help better understand it let’s start with what a virtual world is. Here is what Stanford University have to say “A virtual world is a computer-simulated representation of a world with specific spatial and physical characteristics, and users of virtual worlds interact with each other via representations of themselves called avatars.” In 1994 Paul Milgram and Fumio Kishino explained how you get from a real environment (world) to a virtual one in four stages, firstly, the real one followed by Augmented (AR) then Virtual (VR), finally ending up in the virtual environment.

Reality may not be the best of all possible worlds, but it’s still the only place where you can get a decent steak. Woody Allen

The Metaverse is a virtual world that has transitioned from the real one using technologies like AR and VR but has as a result become something more. *The Metaverse does not simply combine the physical and virtual worlds, instead it is a continuity of the physical world in the virtual one, to create an ecosystem that merges both (Physical and virtual). In other words, it is a brand-new world that is as engaging and important as the real one. Mark Zuckerberg (Meta) says that it is a world of endless and interconnected virtual communities, where people can meet each other, work together, play games and more. He sees it as the successor to the internet, an invention that changed all lives by allowing people to be online (in a virtual world) from anywhere and for as long as they would like.

“In simplest terms, the Metaverse is the internet, but in 3D” – Ed Greig, Chief Disruptor, Deloitte Digital

Take a look at how Meta see education in the Metaverse and check out the original promotional video in which Mark Zuckerberg “appears” in order to introduce the world to his new creation.

Changes in the environment change behaviour
There is of course another aspect to being in a virtual world, it is a different environment, and because of that it can have an impact on what you do and how you feel. It is well recognised that spending time in nature, a different environment to the one I am in just now as I write this blog, helps with mental health problems such as anxiety and depression. We also know that in some instances the brain finds it difficult to differentiate between what is reality and what is imagined. When these two ideas are combined it becomes possible to understand how a realistic virtual immersive environment could change levels of motivation, confidence and even beliefs. After all, don’t people behave differently online when using social media tools such as Twitter, being unknown in a virtual world is like a cloak of invisibility, you can be whoever you want and say and do whatever you like without any consequence!

Learning in the Metaverse
In terms of learning, the Metaverse like many technologies or learning environments, is neither good nor bad. Whilst some are sceptical and express concerns about loss of identity, hate and cybercrime, security, and privacy, others are excited and want to take advantage of the learning opportunities, here are a few.

High levels of engagement – Much is made of the term “immersive” when talking about the Metaverse, it means that you are surrounded by and become part of the environment. This can be incredibly powerful when it comes to learning resulting in high levels of excitement, motivation and engagement.

Real life skill development – The metaverse provides a safe environment in which you can practice skill development. This is particularly valuable where mistakes can be made that might be upsetting or result in significant cost and even death. Here are a few examples from an article by the World Bank. Note this is not the Metaverse but examples of VR and games-based simulations that would be part of its ecosystem.

High risk – Pharmaceutical industry leader Novartis had to quickly train 100’s of people on best practice production and procedures for a new leukaemia treatment. They had limited physical training labs and subject matter experts to train people in skills where mistakes have life and death consequences.

Not so much life and death but perception, how to see the organisation through your customers eyes. This was the challenge facing Fortune 200 healthcare leader DaVita.

Developing soft skills – Practising communication, decision making and emotional intelligence.

A virtual University campus – A virtual campus has the potential to make a university experience available for everyone around the world. Meet likeminded people in the virtual world, discuss ideas and share ambitions, just like you would in the real world. Virbela have developed a Virtual campus that can be used for both education and or work-based interactions. The pandemic has shown that people can easily work from home, the Metaverse may have a significant role to play in the future of work as well as learning.   

Takes the learner into the world – I was going to say that the Metaverse has the ability to bring the world to the classroom when in fact it’s the opposite. Although human imagination is a powerful tool think how impactful it would be if you could begin by explaining in a classroom that T Rex roamed the planet during the late Cretaceous Period 65 million years ago and that they could be up to 12m long and 6m tall, but then ask your learners to come and meet one, made possible by VR – Click here to see how the American Museum of Natural History has brought T Rex to life.

The social dimension – Social media allows people to interact, transact, and share interests with others virtually (pun intended) regardless of where they live. The metaverse is social media but in 3D, for better or for worse.

Conclusions
The Metaverse could end up being the biggest white elephant of all time. Reality Labs, the division building the metaverse, lost £3.16bn between July and September this year. Mark Zuckerberg has said that he would invest $10 billion to $15 billion per year, but that it may take 10 years before it yields results. That’s an estimated $100B+ investment into an unknown future.

BUT it might be as Zuckerberg predicts become the next iteration of the internet, personally I would like to give it a chance because it has the potential to contribute to a new and exciting next chapter as to how we help people learn.

That said, I don’t think I would be putting any money into it just yet.

And for a more in-depth explanation, Donald Clark in discussion with John Helmer   VR & Metaverse with Donald Clark

The picture is obviously From the matrix – the blue pill will allow the subject to remain in the fabricated reality of the Matrix; the red serves as a “location device” to locate the subject’s body in the real world and to prepare them to be “unplugged” from the Matrix. Once one chooses the red or blue pill, the choice is irrevocable.

*Is Metaverse in education a blessing or a curse: a combined content and bibliometric analysis

Beam me up Kirkpatrick – evaluating learning

Posted on by

One of the most difficult questions to answer for both the learner and teacher is, “how do you know you or they are learning”?

On the face of it, the answer might seem simple, you are learning if you think you are, if what has been said makes sense and that you are happy with the way it’s being taught. But what does “make sense” actually mean? Presumably the process was logical and you understand it, you might even have found it interesting. However just to make sure you understood it, maybe we should ask some questions in the form of a test, and if you pass the test then that must mean you have learned it? But passing a test doesn’t mean you could apply it in a practical situation, isn’t that the best way to decide if it has been learned?

Each of these questions is doing something different, they are evaluating learning from a different perspective and if that seems the right approach you will probably very much like the Kirkpatrick model.  

The Kirkpatrick Model
In the 1950’s Donald Kirkpatrick developed the model that carries his name when he used it as the basis for his Ph.D. dissertation entitled, “Evaluating Human Relations Programs for Industrial Foremen and Supervisors.” But don’t let that put you off, the main point is, it’s a practical model designed to evaluate training not necessarily learning in a wider context or education. However as discussed in a previous blog, “Training V Education”, may not always be that far apart.

The model has four levels.

Level 1: Reaction – this measures the degree to which participants find the training useful, engaging, and relevant. Its focus is on the learner’s perception and as such is an opinion, which leads to the criticism that people may be happy but have learned nothing or vice versa. It is commonly evaluated using so called “happy sheets”, offering a range of smiley faces for the participant to indicate which one they think best captures how they feel, but they can be more sophisticated, with detailed questionnaires pre and post learning. This is the most popular method of measuring learning, with some suggesting around 80% of organisations use them.

Level 2: Learning – this is about the degree to which learners acquire the intended knowledge and skills and is most often evaluated using exams or tests. Critics will argue these only measure short term memory and not the longer-term deep learning that is required. Also, in practice the actual assessments are not always well written, partly because the expertise is not available to question the reliability and validity of the test.  

Level 3: Behaviour – this relates directly to how much the learners can apply in practice what they have learned. In the workplace this would be the application of what was learned reflected in improvements as to how the individual does their job. But it can also be assessed using assignments, case studies and real-world projects.

Level 4: Results – the last level is a measurement of the impact the training has had on the learning outcomes. Has the training achieved what it was originally designed to do. This is the least measured largely because of the difficulty and costs involved. Which is unfortunate because in many ways its the most important measure of success.

Kirkpatrick is far from perfect but the biggest criticism is probably in its application, with most organisations stopping at level 2 because 3 and 4 are too difficult. There are other models of assessment that some consider to be superior for example, the Philips model (ROI Methodology), the Kaufman model and Rob Brinkerhoff’s success case methodology, but obviously they are have critics as well.

Why does this matter?
Learning evaluation is clearly hugely valuable for educators, given the amount of time, energy and money that goes into training, it’s essential you know how effective it is. In addition, the Kirkpatrick model serves another purpose by helping with course design, just spin it around and ask the following questions. Starting with level 4, what do you want the training to achieve, what is the learning outcome? Then moving to level 3 ask, what behaviour will you see if learners are doing what is needed? Level 2, what knowledge and skills do learners need to do this? And lastly level 1, how do I want learners to feel, to help make the experience as effective as possible.

But it also has some value for learners, enjoying a course is important because it helps with concentration and to a certain extent motivation but the evidence shows, learners are not very good judges as to the effectiveness of learning. That’s not to say if something doesn’t’ make sense you shouldn’t challenge, just that sometimes you might find a particular exercise difficult, begin to question your level of intelligence and worry you’re not learning, when in fact the difficulty is a necessary prerequisite to embed the learning in the first place.

Lastly – What the Kirkpatrick model does is shift the perspective from measuring learning in terms of an emotion and the ability to answer a question, towards creating new improved behaviours and ultimately getting the results you want.

Footnote – the famous quote “Beam me up Scotty” is of course Captain or latterly Admiral Kirk speaking to Scotty his Chief Engineer. But Montgomery Scott to give him his full fictional name may have been a wizard with the Enterprise but unfortunately, he didn’t come up with a framework for evaluating learning.

Flash Ah, Ahhhh……..Cards

Posted on by
y

I can’t believe I have not written about flashcards before. They are an incredibly popular learning tool and have moved relatively seamlessly to digital in recent years. Research published earlier this year found that 78% of students said they had used digital flashcards and of those who used both the digital and paper version, 60% preferred digital, largely because of their convenience and ease of use.

What is a flashcard? – essentially its a card with a question on one side and the corresponding answer on the other. You pick up the card and read the question, maybe it says, who was the 77th Prime minister in the UK? you then attempt to recall the answer in your head before flipping the card over to reveal the name “Boris Johnson”. Interestingly, in that same survey only 53 % of learners turn the card over to check if they were right, something we will discover later is not a particularly good idea. Which highlights another problem that might be happening, students are using flashcards, just not correctly.

Why do they work?
Of course, it doesn’t follow that just because lots of students use flashcards, they are good, but in this instance they are. Flashcards force students into doing things that we know are good for learning. For example, they are excellent for retrieval practice, spaced practice and interleaving, in fact, they support most of the evidenced based learning techniques. Let’s take a look at some of these in more detail.

Retrieval practice – The process of reflecting back and having to retrieve a memory of something previously learned is very powerful. When you look at the card and attempt to recall the answer the brain is working hard, this will result in the reinforcement of neural pathways, in simple terms you are learning. And of course, it requires effort, that’s the reason it works, don’t do as it would appear 47% of all learners and not check if you were right or flip the card over too soon.

Spaced practice – Spaced practice is the exact opposite of cramming, you effectively take the same amount of time to study, just do it over a longer period. The evidence shows that if you revisit what you have studied over time it boosts what is called retrieval and storage strength but if you study in a short period of time, your retrieval strength improves but your storage strength reduces. Flashcards can be used intermittently, effectively spacing out you’re learning, a good way to do this is to use something called the *Leitner system. Let’s assume there are three envelopes and on the first is written, “every day”, on the second, “every other day” and on the third, “once a week”. All flashcards initially start in envelope one, if you answer a flashcard correctly it moves into envelope two, if incorrectly it stays in envelope one. Each time you get a card correct, you move it to the next envelope but if you get it wrong, you move it back to the previous one. Eventually, in theory at least, all cards will end up in envelope three. Here is a video that shows exactly how it works.

*The Leitner system was developed by the German science journalist Sebastian Leitner in the 1970s.

Interleaving – Interleaving is simply studying different topics as opposed to studying one topic very thoroughly, this latter process is called blocking. Repetition is one of the main benefits of using flashcards, the process takes place naturally as you go through the pack several times, however that same repetition can make the process easier, because the brain will begin to remember cards by association with each other. This is not the same as remembering the information on the card, because if you change the order then the association is broken and you will forget. A simple technique is to shuffle the deck each time you go through it.

Paper based or digital
The evidence to support using paper-based flashcards or the digital version is mixed with some suggesting that digital is better, Azabdaftari & Mozaheb, 2012 and others Gilbert Dizon and Daniel Tang concluding that there is no significant difference. Although they do acknowledge as our earlier research did that students prefer digital when asked.

The arguments are that digital is more convenient, for example everyone carries a mobile and they easier to create and use due to the sophistication of some of the Apps available. However, in contrast producing your own papers-based cards, deciding what to put on them or how they should look, together with their tactile nature makes the learning more effective.

My advice, do whatever works best for you. Perhaps using an app such as Quizlet, Brainscape or the very popular AnkiApp for one subject and produce your own paper based cards for another.

Conclusions
I should have written about flashcards before, they are a hugely effective tool that utilise many of the best evidenced based strategies. Don’t worry about the, “should I use digital or paper” debate, it really doesn’t matter, try both.

And one last tip, don’t leave the use of flashcards until the end of your studies. To maximise their value start using them about a month before the exam, not the night before! Oh, and why not rate yourself in terms of confidence in getting the correct answer before turning the card over, it’s just another way of deepening learning through reflection.

You might find this helpful, it shows 5 ways to use flashcards, although in fairness some are just good note making skills, but then what’s wrong with that.