Tag Archives: Test preparation

Test obsession and Test Anxiety

Posted on by

Tests anxiety

“We live in a test conscious and test giving culture in which the lives of people are in part determined by their test performance”

Sarason, Davidson, & Lighthall

What’s interesting about this statement is, it was first published in 1960 and was based on students in the US, yet would not seem out of place in describing the situation in the UK.  The UK, as with so many other things has unfortunately caught up with the US and become a nation that tests and measures…everything.

Where a person’s worth is judged only by the tests they have passed it is perhaps not surprising that examination success has become so important and test anxiety increased.

But it’s not just the UK, this is a global obsession, take China for example where the pressure to succeed has become so intense that cheating in the Gaokao, the nation’s A-Chinese-invigilator-sca-010university entrance exam is a major problem. The government has not been slow to react and for the first time anyone found cheating will face a possible seven year jail sentence. In Ruijin, east China’s Jiangxi Province, invigilators use instruments to scan students’ shoes before they entered the exam hall, while devices to block wireless signals are also used to reduce the opportunity to cheat.

Test anxiety or stress

Stress is a broad term that is experienced when you find yourself in adverse or demanding circumstances, sitting an exam perhaps. Test anxiety is a situation specific type of stress, experienced by people who find examinations threatening. Recently, there has been an increased interest in exam stress and test anxiety in the UK and a need for it to be given closer academic scrutiny.

The research so far shows that test anxiety can actually impair learning and hurt test performance. And this is the issue, are students underperforming in examinations, which as stated above can have a significant impact on their lives not because of their lack of knowledge or even their ability to apply knowledge, but simply because the medium used to assess them is an exam.

In simple terms test anxiety effects exams results and exam results play a major part in people’s lives.

There are three components of test anxiety (Zeidner 1998)

  • Cognitive – the negative thoughts you can have during tests e.g. “if I fail this I will fail all my examinations” and the performance limiting difficulties experienced as a result of anxiety e.g. inability to read questions clearly or solve problems.
  • Affective – physical symptoms e.g. trembling, tension etc.
  • Behavioural – test anxiety creates an environment that encourages students to avoid studying or best delay it.

The reason people develop test anxiety is thought to be rooted in certain social issues e.g. how you are judged by others and the fear of failure in the public domain. It may also be related to the type of anxiety people experience when they have to make a best man’s speech, for example. Another aspect is that it is not always what others think, but what you think of yourself that is the issue and so the expectation of exam failure could impact on an individual’s ego and self-esteem.

Phase one is OK BUT

I think in the UK we are through the worst part of this, let’s call it phase one, and by that I mean we know that examinations and testing are not the answer, and that people are not their exam result. We have learned this the hard way by producing groups of exam qualified students, releasing them into the world of work, ill prepared to cope with the demands of the workplace. In addition, we have developed helpful techniques that enable people to better cope with test anxiety. Some of these I have discussed in previous blogs, Stress or Pressure – Don’t let the bridge collapse, Exam stress – Mindfulness and the “7/11” to name but two.

BUT………we still have some way to go with phase two, which involves answering the question, what do we replace exams with if they are so bad? And until we solve that, helping good people perform in the system we have just now is the best we can do.

 

The tip of the iceberg – exam tipping is becoming obsolete

Posted on by

tip1

Assessment is changing, there was a time when all examinations were sat in a room, the answers would be hand written on a piece of paper and a retired English teacher would stand at the front reading out instructions as to what you could and couldn’t do in the next three hours.

Not any more…….you request a date that is convenient, turn up at the exam center, no longer is this a sports hall, it might be a driving school test center or the college you studied at. Then you log onto the PC and answer questions on the computer screen in front of you. The results may be immediate; it depends on if it is “human marked” or computer marked.

But in some ways these changes are only the tip of the iceberg!

What no past exam papers.

As examinations move into the digital world we are seeing other changes as well. There is a move towards objective testing, scaled scoring and examining bodies no longer providing past exam papers, what did you say, no past exam papers……!

This is partly down to the nature of the test i.e. you can’t provide an exact replica of a past exam question if it is an objective test. Remember objective test questions are randomly selected from a pool, and are different for each student. But there is also a shift towards some examining bodies only providing an example of the type of questions that could be set rather that a continuous flow of, the last exam papers.

If the test changes – how you study (and teach) has to change

Now for someone who has advocated that students analyse past exam questions in order to identify key areas so as to better direct their studies, this is a bit of a blow. It has also been the method I have used in the past to focus my own delivery in class and on line. Of course using past exam questions has always been much more than just spotting key areas, it is about focus, providing a place to start, showing content in the right context, helping with writing style etc.

There will still be past questions, sample questions will be provided. What we don’t know is how representative they will be of the examination. Or will it be as we have seen in the past with pilot and specimen papers, they change over time, drifting away from the original in terms of style and emphasis. Although I can see the logic in examining bodies not releasing papers, I hope they will continue to keep the sample papers fresh, in keeping with current thinking about the subject and how it will be examined.

What to do?

Students and tutors still need focus, there has to be emphases on key areas in order to chunk the content so that it can be more easily learned, it’s just that we won’t be able to use past questions or at least as much as we have in the past. That emphasis will now have to come from articles written by the examiners, examiner reports and syllabus weightings. If faced with a new subject where there is only one sample paper, it will be necessary to read the guidance from the body closely, noting reference to “this being a key part of the subject” or “one the examiner thought was answered badly in the past.” These together with the syllabus weightings and specific learning outcomes will have to be your guide. It is of course possible that the subject has not changed much from before and so some of the older past question can be used. As far as questions style is concerned then that will have to come from the questions and answers that are published, it may not be ideal but it’s the best we can do.

The overall impact of these changes is that students will have to know more, something that is hard to argue with. Students and tutors alike will have to devote far more time to the subject, which is fine if students have the time and can afford the extra costs involved in longer periods of study.

But it’s not all bad news, new technologies can help students make the most of dead time, studying on the train using their mobile phone for example. Also knowledge is more freely available than ever before as many top institutions provide a huge amount of free easy to access content online.

One final thought, examinations may change and they may not be fair but on the whole they are equal, everyone as before is in the same boat, and someone will always pass, wont they!

The future – Sitting the exam at home?

On line exams

An online student, all be it a mature one shows his ID to the online assessor

And maybe even the exam room will become obsolete. Proctur U is a US based company that also has a presence in the UK offering online invigilation. Watch this video to see how it works and judge for yourself

 

 

Are exams fit for purpose (part two) – what are the alternatives?

Posted on by

You dont fatten pigs 2

Last month’s blog came to the conclusion that examinations* are fit for purpose or at least “a purpose.”

They provide the student with a clear objective to which they can direct their efforts and focus attention and are a transferable measure of competency that can be assessed at scale. The “at scale” point is important as there are many ways of assessing competence but few that can cope with the need to test thousands of students all at the same time.

The main problem with examinations is that they don’t always examine what is most valued; the method of assessment often has significant limitations as to what it actually tests and the results are presented in league tables that give a far too simplistic view of success.

I am not sure we can resolve all of these but it might be worth exploring other options, specifically alternative methods of assessment. For example If you change the method of assessment from a formal, often timed written exam to say a portfolio of work, not only do you change the method of assessment but you will change what is being examined, two birds with one stone perhaps.

Different methods of assessing competence

Open book exams

Open book assessment offers a way of testing application rather than memory. Students have access to a text book that contains information relevant to what they are being asked. It’s the use of knowledge that is important, not the knowledge itself. The idea of open book could easily be adapted, why not allow students access to the internet during the exam, they could look up anything they wanted. Is this not more representative of what happens in the real world?

Take out exams

Similar to the above the so called “take out exam” allows the student to take the exam away to work on at home using whatever resources they prefer, books, internet etc. They return the next day with a completed answer. This can work better than you might at first think so long as you have a robust mechanism to detect plagiarism. There are several very good software packages that can spot the most sophisticated types of copying.

Case studies/simulations

A case study provides an environment for the student to demonstrate they can use their knowledge to solve problems and or offer advice in a virtual world. Most case studies tend to be written but this is one area that we could see some clever and affordable use of technology to better simulate the real world.

Performance tests

In a performance test students are required to demonstrate a skill/process, create a product etc while being observed by the assessor who will evaluate the performance. A great example of testing ability to apply knowledge but suffers from the subjectivity of the assessor and has limited application at scale.

Portfolios

Portfolios are most often collections of the student’s work that demonstrate their ability to perform a specific task. These can be simulations of the real world or portfolios of work actually undertaken on the job. A portfolio can include written documents, emails, audio or video recordings, in fact anything that provides evidence as required by the assessor.   Portfolios are perfect for assessing application but the process of assessment is expensive and not without bias.

Viva Vocal – (living voice) Oral exam

Often used to test PhD students, an oral exam gives the assessor chance to question the student. This is a very effective method where you are looking for higher level skill and depth of understanding. As identified last month it’s probably one of the oldest forms of assessment.

Digital badges – capturing the learning path

Being awarded a badge as recognition of achievement is something many will be familiar with especially if you were a boy scout or girl guide. But digital badging is new and becoming increasingly popular because of the internet. A good example would be linkedin and the badges awarded to you by others as recognition of certain skills.  Many of the assessment methods above provide a first past the post type of assessment, you pass and that’s it. Digital badging on the other hand is a form of lifelong assessment that evolves along with your career.

Digital badging for me is one of the most exiting forms of assessment and I am not alone Nasa have been using digital badging since 2011. Read more about digital badging.

Assessment in the future

Scanning for competenceThe list above is far from comprehensive and many other equally valid types of assessment exist e.g.  Role plays, Slide presentations, Assignments etc but what might assessment look like 15 years from now. Well how about using MRI scans to identify which parts of the brain are being used?  Not sure it will catch on but it would provide some interesting evidence as to how the student is getting to the answer, simple memory or a genuine and deep understanding .

*Examinations defined as a written test administered to assess someone’s level of understanding, knowledge or skills

Are exams fit for purpose? (part one)

Posted on by

take-the-same-testI have written in the past about what passing an exam proves but have never questioned if exams achieve what they were originally designed to do, are they fit for purpose?

Firstly let me define what I mean by an exam. A written test administered to assess someone’s level of understanding, knowledge or skill that results in a qualification if successful. This is in contrast to a test which is a method of assessing someone’s level of understanding, knowledge or skill often as part of a course in order to provide feedback. A test does not have to be written. Although exams don’t have to be written either, many are and initially at least I would like to keep the definition as narrow as possible.

In order to answer the question, are exams fit for purpose we must first take a step back and look at how we got to where we are now.

 

A brief history of examinations

The first standardised test is believed to have been introduced by the Chinese in 606 AD to help select candidates for specific governmental positions. However most examinations around this time would have been oral, requiring the candidate to recite a dissertation or answer questions. Although there is evidence of written exams being used as early as 1560*, it was not until the 1820’s that many Universities began to adopt the practice. From 1850 onwards the written exam became the norm in most UK Universities. In 1854 under the Gladstone government selection of Civil servants was based on their ability to pass an exam, this time however it was written.

Bureaucracy – In 1917 to help bring some order to what had been described as chaotic the Certificate and the Higher School Certificate were introduced. Then in 1951 we had the General Certificate of Education (GCE) examinations, more commonly known as Ordinary ‘O’ level and Advanced ‘A’ level , these were normally taken at 16 and 18.

In the 1960’s the CSE (Certificate of Secondary Education) was born, opening up qualifications for all, not just those that went to Grammar school. However this two tier system was thought divisive and so in 1988 under the guidance of the then Education Secretary Sir Keith Joseph both sets of examinations were replaced by the GCSE. The GCSE was graded and contained credit for course work.  In 1991 the General National Vocational Qualifications, (GNVQS) were established intended to incorporate both academic and vocational elements, by 1995 these were accepted as ‘equivalent’ to GCSE.

In 2014 we find change again, gone is the course work and written examinations once again become the main method of assessment, although there will be grading, 1 to 9 with 9 being the higher mark. The exams will still be called GCSE’s, although officially they are known as GCSE (England). This is to avoid confusion with Wales and Northern Ireland, who are not changing.

Yes they are

Historically at least it would appear the purpose of the exam was to provide a recognised and transferable measure of competency in a given subject or discipline. The lack of transparency and consistency of the oral exam resulted in them being replaced with written ones and a more formal bureaucratic structure was developed to administer the process.

And in many ways there is very little wrong with this.

The problem is not with the exam itself, but with what is being examined. If as a society we value “thinking and creativity” for example, then should we not be examining these rather than subjects that require the candidate to do little more than rote learn facts.  Perhaps we should explore different methods of assessment, the written exam has its uses but hand written papers are looking increasingly outdated in a world that communicates electronically not only in short texts and tweets but with video and photos . In addition the way exam results are used in league tables to show winners and losers is divisive. It looks like a measure but has in fact become a target that schools and teachers must hit or be considered failures.

Please watch this it’s very funny…..and thought provoking

Not on the test

 

 

 

 

 

In the second blog about exams I want to look more closely at some of these points, in particular what other ways we can assess what people know.

*Assessment around this time was through debate between a number of learned people all at the same time and lasting for two hours or more.

Teaching to the test – Interesting research but the fat lady is still in good voice

Posted on by

Fat lady still singingThis week researchers from the University of East Anglia released some very interesting findings that resulted from testing 594 bio-science students in their first week of term at five universities.

The students selected would be considered by many more than competent in their subject, almost all had a grade A*, A or B in biology at A-level. Yet when they were given 50 minutes to answer 38 multiple choice questions on cells, genetics, biochemistry and physiology from their A level core syllabus, they only got 40% correct. The period of time between the students sitting their A levels and the test was three months.

Lead researcher for the study, Dr Harriet Jones, said: “What our research shows is that students are arriving at university with fantastic A-level grades, but having forgotten much of what they actually learned for their exams.”  She went on to say that the trend to teach to the test, to ensure good results for schools’ reputations, was the problem.

The schools are to blame then

The facts of the research are clear, students who had successfully passed a test, were unable to pass a similar test three months later. The conclusion reached is that the students did not understand (see my blog on understanding) their subject well enough and passed their A levels probably using little more than memory. And who is to blame, the schools of course, for teaching to the test. Why the school do this is worthy of further debate, but government pressure and the impact of league tables will certainly be in the mix.

But do employers not accuse Universities of delivering up similar ill prepared students. The test is different but from the employers perspective the result is the same. A University student who professes to know something but when tested “in the real world” doesn’t.

Does this mean that Universities are also teaching to the test!

It’s about the test etc

The problem is not in teaching to the test; the problem is with the test, the pass mark and possibly the marking. If the test was more Testing but for what!aligned to what the student needs to know/do at a fundamental level, the pass mark sufficiently high and the marker having some degree of autonomy to form judgements, then the results would probably be different. It could of course be that the exams are easier – Exam chief: ‘you don’t have to teach a lot’ for our tests.

The big criticism of teaching to the test is, it results in a narrowness of understanding, little in the way of depth and does not push students to think in abstract and creative ways. But if the test, which incidentally does not have to be in the exam hall or on paper/PC was able to “test” for these qualities then teaching towards it would perhaps be more acceptable.

Bottom line

Teaching to the test is unlikely to change, in fact given the popularity of league tables  in education just now it may well increase, but with more effective testing the results might be better students, happy Universities and even happier employers.

 

 

Twas the night before ………..the exam – but what to do?

Posted on by
keep-calm-and-study-all-night-5 Well not exactly all night

For students May and June are the main exam months. Studying and learning can be enjoyable…. honestly, but the fun has to come to an end and it does, with the exam. It cannot be avoided and so is best embraced, treat the exam as a game and you the player. What you need to do is give yourself the very best chance of winning.

Become a professional exam taker, someone who follows a process of preparation, very much like a top sportsperson. This means you personally need to be in the best physical and mental shape and have a series of exercises that will get you match fit.

Below is your training regime from the night before the exam – good luck

The night before

You should by now have:

  • Read through and reduce your class/tuition notes down to approximately 10 pages (20 max) of revision notes, see March Blog on how to prepare notes. You may have some professionally produced revision notes, but it is still best to make your own.
  • Practiced past questions on the key examinable areas both under exam and non exam conditions.
  • Started the process of memorising the revision notes.

Be realistic – The key to the night before the exam is to be realistic. You don’t have much time, so don’t think you can cover everything. Let’s assume you have 3/4 hours, 6.00pm – 10.00pm maybe.

Put to one side the large folder that contains all your notes taken throughout the term/year, and concentrate only on the 10-20 page revision notes.

Focus and memorise – In the 3/4 hours that you have you want to get an overview of the subject and focus on the areas that need memorising. These should be the key examinable areas and are most likely to be standard formats, definitions, lists, formulas s not given in the exam etc.  Memorising should include some rewriting of notes, but very little, focus on talking out loud, drawing pictures, writing out mnemonics etc. See my blogs on memory, in particular: Thanks for the memories  and To pass an exam do and exam.

Admin – make sure you have set to one side everything you will need the next day. This includes your exam entry documents, calculator, gum, mints etc. You don’t want to be thinking of these in the morning. And of course make sure you know exactly what time you need to leave to get to the exam with about 1 hour to spare.

Physical and mental preparation – Drink lots of water, avoid tea, coffee etc as you will need to get a good night’s sleep. Exercise is an incredibly effective method of reducing tension and stress. So you may want to build into your 4 hours, 30 minutes for a run or brisk walk. This could be at the half way point of your evening, combining a well earned break with the exercise maximises your time.

Getting sleep is important, so avoid reading your notes and then going straight to sleep. Pack you notes away, put them ready for the morning, then physically go into another room if possible or even outside, watch TV for 10 minutes, something trivial or read a book. You need to break the state of mind from that of studying, relaxation leads to sleep not stress.

And finally keep a positive attitude, think about what you know and are good at and not what you don’t know and are bad at. Keep telling yourself that you have done everything possible, and if you follow these steps you will have. Thinking you know nothing and should have done more will not help at this stage, it’s a pointless thought strategy and not what the professional exam taker does.

The morning before

Set your alarm sufficiently early to give you at least another hour of revision. You don’t need to get out of bed, just continue memorising your notes. This is now about little and often, short 10 minute intervals. Don’t worry about falling to sleep in the exam; the adrenalin won’t let you.

1 hour before

What you do after arriving at the exam centre/School etc  is personal. Some will prefer to sit on their own going over the revision notes; don’t bother taking your folder of course notes. This is still very much about short term memory. Others will prefer to talk, chatting about nothing, just to stop them worrying. Both are fine.

After the examExam post it!

Afterwards is also a little personal, most will go home, but some will want to talk through what was in the exam, looking perhaps for some conformation they have not made a complete mess of it. Most importantly, if you have another exam, go home, put your old revision notes to one side, forget everything and start on your next subject.

The American basket ball player Art Williams had a good saying that I will leave you with. I’m not telling you it is going to be easy — I’m telling you it’s going to be worth it”

And although personally I found exams difficult I have never regretted the hard work, it was for me worth it.

And something to watch

How to: Cram the night before a test and PASS

Or you could try this

This blog is for Beth – good luck xx

Just answer the question!!! – but how?

Posted on by

Last month I looked at the best way to tackle a case study, but case study is only one type of exam, what about the more traditional style of exam question?

The world is full of great advice, lose weight, exercise more, stop smoking, just answer the question ….all these statements are very clear with regard to WHAT you should do but terribly unhelpful as HOW to do it.

The reason that students fail exams is simple, every examiner since the beginning of time will have made some of these comments.

Students fail exams because?

  • They don’t know the subject – inexcusable and the only reason you should fail
  • They don’t read the questions properly – and as a result  misunderstand what was being asked
  • They don’t  manage their time – so only complete 50% of the paper
  • They don’t write good answers – true this might be due to lack of knowledge but could also be the result of not knowing how much to write

The last three of these can be overcome with the use of good exam techniques. In this blog I want to share with you two simple techniques that I think will help.

How to read questions properly – Tip one, the rule of AND

Below is an exam question worth 12 marks. You don’t need to know anything about the subject so don’t worry.

Using the information given for DT Co, calculate the adjusted present value of the investment and the adjusted discount rate, and explain the circumstances in which this adjusted discount rate may be used to evaluate future investments. (12 marks)

The rule of AND is simple, where there is an AND in the question simply put a line through the AND then make the next statement the start of a new question.

Now read the question

1. Using the information given for DT Co, calculate the adjusted present value of the investment. and

2. (calculate) The adjusted discount rate, and

3. Explain the circumstances in which this adjusted discount rate may be used to evaluate future investments.                                                                                  

There are now three questions and because we have broken it up, it is so much clearer what you have to do.  If we were really clever we might be able to guess how many marks out of 12 relate to those three questions, a tip for another day perhaps.

How to write a good answer – Tip two, Define. Explain and Illustrate

Define Explain and Illustrate is a technique to help you write more using a simple structure.

Read this question

Discuss the proposal to repurchase some of the company’s shares in the coming year using the forecast surplus cash. Other implications of share repurchase for the company’s financial strategy should also be considered. (10 marks)

Firstly Define the technical words. In this example the technical word is repurchase, so firstly we need to say what a share repurchase is.

E.g.  a share repurchase is where a company buys back its own shares and as a result reduces the number of shares available on the market.

Secondly Explain in more detail.

E.g. the share buy back has to be financed in some way so one implication is that it will result in a reduction in the company’s cash balance. It also means that because there are fewer shares, earnings per share (eps) will increase.

And lastly and in many questions most importantly, Illustrate. This could be by way of a diagram an example or by referencing to the question in more detail. The reason this is so important is that this is how you will demonstrate to the examiner that you can apply the knowledge. If you don’t understand something you will not be able to apply it. The application section of the answer will often carry the most marks.

E.g. in the example above it is clear that the company is forecasting surplus cash, i.e. they have more money in the future than they need. Leaving this money in the bank is not considered sensible partly because the level of return that can be earned from the bank will be less than the shareholders require, it can also be interpreted as a lack of ambition on the part of the Directors. Blah blah blah

Depending on the detail provided in the question this final illustration section can go on and on. How much you write will depend on the marks available.

I hope you have found these two tips helpful, if you want more in the coming months just add a comment to this blog and I will oblige.

Epic exam failure – what not to put on your exam paper

And finally a short video showing students real exam answers – funny

Click here

 

What’s the point of exams – what do they prove?

Posted on by

With many students in the middle of exams right now, working long hours, making huge personal sacrifices and putting themselves under considerable pressure, perhaps we should stop, take a moment to reflect and ask ……….what’s the point of exams?

Why are you doing this, what will it prove when you do pass, what will passing give you that you don’t have now?

 

 

It’s not about knowledge

If you pass an exam, you have proved that you knew the answers to questions set by the examiner at a particular point in time. To be precise you have only really proved you knew enough answers to get a pass mark, in some instances this might be less than half! But you have not proved that you understand everything about the subject or that you could work unsupervised in practice, knowing what to do is not quite the same as doing it.

This is not to say that examinations are easy, they are not or to underestimate their importance, it is just to be a little clearer on what exam success means.

Higher level skills

By passing an exam you are demonstrating many other skills, for example;

Motivation – You have proved that when you set your mind to something you can achieve it.

Concentration – For some people, concentration comes easily for others it might involve removing all distractions by locking themselves in a room. Whatever method you used, you have learned how to cut out distractions and focus on the task in hand.

Prioritisation and Time management – Undoubtedly you have had too much to learn and too little time to learn it. But if you pass the exam you have proved that you got the balance between an endless, or at least what appeared endless set of demands and the overall objective just right.

But most of all exams give you….

A great sense of achievement – You set yourself a target and achieved it.  It is a statement to others that you worked hard and have succeeded. It will remain a tangible and permanent reminder of success that can never be taken away.

Self confidence – It will build self esteem and help you develop a type of confidence that only comes from being successful in a chosen field. Others will congratulate you and as a result, treat you differently.

Choices – it will open doors to opportunities that simply would not have been possible without the piece of paper that says “Congratulations, you have passed”. Exam success will give you choices, it will change how others look at you but perhaps more importantly it will change how you feel about yourself…

So if you have been working hard keep at it, you may not be proving you are the greatest mathematician in the world, but if all goes to plan the end result will make up for all the pain you are going through right now, honest!

But just in case…..everything doesn’t work out check out these Famous A-level flunkers

Related articles