Let’s chat about ChatGPT – WOW!

If you have not heard of ChatGPT, where have you been since November 30th when it was launched by OpenAI the company that developed what is fast becoming a groundbreaking technology. Since then, it’s been making waves, everyone is talking about and using it. In the first week alone over 1,000,000 people had subscribed to what is for the time being at least, free. OpenAI was founded in 2016 by Elon Musk, Greg Brockman, Ilya Sutskever, Wojciech Zaremba, and Sam Altman, although Musk stepped down from the board in February 2018 to avoid any conflict with Tesla.

Originally a “not for profit”, in 2019 it became a “capped for-profit”, meaning in this instance that investors can’t earn more than 100 times their investment. And just to give some idea of scale, OpenAI expects to generate $200 million in revenue next year and $1 billion by 2024.

Its mission is simple, yet as you might imagine ambitious – to ensure that artificial general intelligence benefits all of humanity.

In contrast here is Googles mission – to organise the world’s information and make it universally accessible and useful.

But what is ChatGPT? – To find an answer to this question, we can actually ask ChatGPT, however before we do there are some points worth noting. ChatGPT is not a search engine unlike Google, it’s not even connected to the internet, in fact the data sets used to train it haven’t been updated since the end of 2021. You will find this out if you ask anything relatively topical, for example, who won the World Cup this year, it will say….

“I’m sorry, but I am not able to provide information about events that have occurred after my knowledge cut-off in 2021”.

The answers appear in real time in a suitably bot like fashion, but what makes it really interesting is that it uses Generative AI, which enables it to start with existing content but from that produce something new and original, let me clarify, its not simply taking content from somewhere else, its creating new and original stuff.

ChatGPT is a variant of the GPT (Generative Pre-trained Transformer) language model developed by OpenAI for use in chatbots and conversational systems. It is able to generate human-like text in real-time and understand the context of a conversation, allowing it to generate appropriate responses based on the topic being discussed. ChatGPT is also efficient and fast, making it ideal for use in chatbot applications where fast response times are important. It is able to handle a wide variety of tasks, including answering questions, providing information, and engaging in casual conversation.

The above was the answer provided by ChatGPT when asked for a definition within 90 words. In fact everything in purple and italics in this blog has been taken directly from ChatGPT.

How does it learn?
Once again let’s ask ChatGPT, after all why should I do all the hard work.

ChatGPT uses a type of machine learning called supervised learning. In supervised learning, the model is trained on a labeled dataset, where the correct output is provided for each input. The model is then able to make predictions for new, unseen data based on the patterns it learned during training. too train ChatGPT, a large dataset of text is fed into the model, and the model is then trained to predict the next word in a sequence based on the words that come before it. Through this process, the model learns to recognize patterns in language and generate coherent text. The more data the model is trained on, the better it becomes at generating natural-sounding text and understanding the relationships between words and concepts

In summary, the model is initially trained by humans (The labeller), this is the supervised stage. It is then able to provide multiple answers to a question of which the trainer ranks in terms of quality, this is the reinforcement stage which provides more data for the model. And lastly, reward models are created that automatically reward the model for getting it right, the unsupervised stage.

It might be easier to think of it in the same way as you would if learning to ride a bike, for example firstly someone shows you how to ride a bike, (supervised) secondly you have a go and are given feedback in order to improve (reinforcement) and finally, if you ride for 5 minutes, you will be rewarded with £5.00, fall off and you get nothing. (Reward model – unsupervised).

Clever… but what are the implications?
We are at one of those “genie out of the bottle” moments, when something that you thought might happen in the future becomes a reality today. As a consequence, we start to ask questions such as, is this technology good or bad, what will it mean for jobs and the future of work? If it can produce high quality answers to questions, how can we tell if it’s the student’s work or simply the result of an exercise in cut and paste? And because it can write poems, stories and news articles, how can you know if anything is truly original, think deep fake but using words. By way of an example, here is a limerick I didn’t write about accountants.

There once was an accountant named Sue
Who loved numbers, they were her clue
She worked with great care
To balance the ledger with great flair
And made sure all the finances were true

Okay it might need a bit of work but hopefully you can see it has potential.

We have however seen this all before when other innovative technologies first appeared, for example, the motor car, the development of computers and more recently mobile phones and the internet. The truth is they did change how we worked and resulted in people losing their jobs, the same is almost certainly going to be the case with ChatGPT. One thing is for sure, you can’t put the genie back in the bottle.

Technology is neither good nor bad; nor is it neutral. Melvin Kranzberg’s first law of technology

And for learning
There have already been some suggesting that examinations should no longer be allowed to be sat remotely and that Universities should stop using essays and dissertations to asses performance.

However, ChatGPT is not Deep thought from The Hitchhikers Guide to the Galaxy nor Hal from 2001 a Space Odyssey, it has many limitations. The answers are not always correct, the quality of the answer is dependent on the quality of the question and as we have already seen, 2022 doesn’t exist at the moment.

There are also some really interesting ways in which it could be used to help students.

  • Use it as a “critical friend”, paste your answer into ChatGPT and ask for ways it might be improved, for example in terms of grammar and or structure.
  • Similar to the internet, if you have writers block just post a question and see what comes back.
  • Ask it to generate a number of test questions on a specific subject.
  • Have a conversation with it, ask it to explain something you don’t understand.

Clearly it should not be used by a student to pass off an answer as their own, that’s called cheating but it’s a tool and one that has a lot of potential if used properly by both students and teachers.

Once upon a time, sound was new technology. Peter Jackson filmmaker

PS – if you are more interested in pictures than words check out DALL·E 2, which allows anyone to create images by writing a text description. This has also been built by OpenAI.

The 5 top EdTech trends – summer of 2017

Glastonbury a marginally more interesting gathering….but only just.

We are in the season when many learning and technology leaders gather to discuss what’s new and what’s trending in the world of education. And at two recent conferences, Learning Technologies and EdTechXEurope there was plenty to see. Generally, the role of technology in learning seems to have found its place with many acknowledging it should support learning not drive it. However it’s still very easy to look at the latest shiny new offerings and think, this is great how can I use it, rather than, what learning problem does it solve.

Here are a few of the most notable developments.

1. Video is getting even better – fuelled by the YouTube generation of learners, those who would rather watch a video than read a book as a means to consume knowledge, we have some new developments.

Firstly, using video to deliver micro learning.  Not just small chunks of video but untethered, JIT, 3 minute courses that offer the learner digestible easy to remember information. Think of micro learning as a series of very short courses that could be linked to each other or not, and can even include assessment.

Secondly, interactive video. TV is no longer the all commanding medium it once was, it like other technologies has had to evolve. In recent years the shift has been towards better engagement, offering spin off programmes where there is a live audience, web sites that showcase the backstory to the characters and programmes that require the audience to vote and so influence events. Now we have interactive video, where the individual can choose what they would do and so change the future. Check out this amazing example, used by Deloitte to attract new talent.

2. Gamification is becoming better understood. For the uninitiated gamification is the use of game based principles to improve motivation, concentration and more effective learning. Gamification uses Points (P) as a measure of reward, Badges (B) as a visual record of success, and leader boards (L) to create competition.

We now believe Dopamine, the pleasure induced neurotransmitter (chemical) is not created as a result of a reward e.g. by being given a badge, it is the challenge and subsequent achievement that releases the dopamine which in turn leads to pleasure. This might seem obvious, with hindsight, no one gets pleasure from being top of a leader board, if they did nothing to get there.  In addition, dopamine is released when you have a new experience, so think about changing pathways, setting different questions and tasks, it’s certainly not very motivational to go over the same content again.

3. Information overload is leading to a need for Knowledge Curation – we are living in an age where  information is abundant. You can learn anything from the internet. But there lies the problem, we have too much information, we suffer from information overload. Curation is the collecting and sorting of meaningful content around a theme, and it is now in some instances being thought of as more valuable than the content itself.

Arguably curation is not so much about what you curate and share but what you don’t share. In addition to the organisation of content the curators need to have an expertise in the subject and an understanding of their audience and what they want.

Steven Rosenbaum in his book Curation Nation, offers up a good summary. “Curation replaces noise with clarity. And it’s the clarity of your choosing; it’s the things that people you trust help you find.”

4. The market is becoming more accepting of user generated content (UGC) – organisations are beginning to see the benefits of UGC for a whole host of reasons. It’s a very fast way of generating content, there is a lot of expertise that can be uncovered by allowing individuals to share what they know, it’s often user friendly, and importantly its cheap. It is of course not perfect, and there are concerns about quality, but by allowing the users to rate the content, the quality might just look after itself.

5. Virtual reality (VR), Augmented Reality (AR) and Artificial intelligence (AI) – not that these are all related, but just a simple way of me summarising three areas to keep an eye on in the not too distant future. All of these technologies are becoming cheaper, largely because of the investment made and experience being gained in the gaming industry.

By way of a footnote Google have released an open source software called Tensorflow which can help with machine learning, something that they believe will help drive new initiatives in AI.

Appy Christmas – Apps for learning

appsIt’s always interesting writing a Blog in the holidays, maybe it’s because you have more time than normal so think you should come up with something different, dare I say original. The reality is that when you have such a large canvas on which to think, you can’t think of anything!
The answer is to narrow it down, give yourself something specific to think about. So whilst staring at my ipad for inspiration, I stopped thinking about “everything”, focused on what was on my ipad and then it happened, an idea… ..Why not write about the apps I use most and how you might use them to improve your studying, so here goes.

It’s not about the technology stupid
First a disclaimer, although technology can be all absorbing, learning is a human quality, technology in many circumstances only makes learning more convenient, you still have to work at it. What it does do is provide you with the ability to study when you want and where you want. Time that would be wasted waiting for or actually on a train/bus etc can be much more effectively used learning. How good would it be if you had finished studying before you got home?

Google CalendarGoogle calendar – Helps plan your studies
I have written before about the importance of timetables and calendars. Sitting down and planning what you will study and when not only helps you become more organised it is essential for setting targets and challenges. And remember target setting is key to motivation.

Evernote Evernote – Organise and store notes
I am finding that I am using Evernote more and more. It is in effect a cloud based folder system. Consider setting up a folder for each subject you are studying. Then within each subject folder you can type notes, attach PDF’s, photos, maybe of places/objects/people relevant to that subject. You can even attach video. And if you want to collaborate with others just share the link. Maybe have a folder for revision with the questions you want to attempt linked via PDF, comment on what you found difficult and share with your friends. Evernote has so many uses.

PenultimatePenultimate – for making hand written notes and drawing mind maps
If you prefer to write rather than type, penultimate is for you, although I don’t think there is an android version at the moment. It is part of the Evernote family and links with Evernote so is easy to use. It is just like a paper based note book with a front cover showing the subject, page numbers and has a nice page turning feel. Unlike a paper based note book however, you can change the paper, plain/lined etc, save your work, add photos, and share with others. It also has a very clever way of making sure your hand when resting on the screen does not interfere with what you are writing.

Put simply it’s the best handwriting software I have come across, and comes close to replacing paper, close but not just yet….

DropboxDropbox – for file storage, back up and file sharing
Many of you will already be familiar with dropbox, it is free simple to use cloud based storage. Dropbox is great for saving/backing up all your files. This means that as long as you can get electronic versions of your text books and question banks you will be able to have them with you anywhere…

And you can share folders with friends.

Adobe ReaderAdobe reader – keep all PDF notes in one place and you can write on them!
This is just for Adobe PDF’s but as most documents can be turned into a PDF format that should not be a problem. Imagine having your notes in a PDF file, opening them up wherever you are and then updating them either by typing or writing on top of the PDF. You can also make margin notes that open up in a speech bubble, little reminders of what you were thinking, or additional work you need to look at.

Explain-EverythingExplain everything – become a teacher and teach yourself
Explain everything is a white board that you can add in pictures, shapes etc, and then the really clever part, record what you are doing in a high quality video. What makes this so good is how easy it is to use.

This would be ideal for working through a question, talking out loud explaining your thoughts (Explain everything will record your voice and your white board actions) and then when you get to the part that is difficult or simply don’t understand, ask your question out loud….? Then send the Mp4 file to your tutor/teacher or study colleagues for an answer. Unfortunately as with Penultimate I don t think there is an android version just yet.

twitterTwitter – limitless knowledge and support
Twitter can get a bad press when it comes to studying, it can be very distracting! But if used properly it can be great. The key is to follow people that have answers to your problems or are like you. If you are studying accountancy for example you will find lots of tweets from experts providing you with up to date news and information often linking to more in depth guidance, websites/PDF’s etc. Twitter is the most up to date text book you can get.

Okay a word of warning; just make sure you are not too far ahead of you teachers and the exam. Also that the people you are following are credible.
The other use is to follow fellow students who are studying the same subjects as you, it can be very reassuring that you are not the only ones who doesn’t understand something.

The big secret to twitter is is very selective who you follow, delete people that are not helping and keep the list down to about 200.

Mobile
Most of these are accessible on all mobile devises and for me that is the real benefit of the technology.

Happy 2013 and more apps
Hope you are all having a good Xmas and here’s to 2013, what will be new this time next year I wonder?

Related articles