Many awarding organisations and ministries of education are grappling with how to transition from paper-based marking to e-marking. Even though e-marking is used to mark the majority of school leaver exams in the UK and its use is increasing around the world, there are still lots of misconceptions around it. In this article we have dispelled the most common myths surrounding e-marking.
Myth 1: E-marking will create more work for our examiners
It’s a known fact that teacher workload, and especially the workload of marking, is often a challenge even for the most organised individuals. According to a Workload Challenge survey carried in the UK, 53% respondents felt that “the excessive nature, depth and frequency” of marking was burdensome.
Although there is often reluctance and resistance to implement new technology, many awarding organisations have seen their examiner workload significantly reduced by using e-marking.
A survey carried out in 2019 by an awarding organisation in South Africa, prior to piloting e-marking revealed that 25% of their examiners’ time was spent on admin tasks rather than the marking itself. With the help of e-marking, administrative tasks such as the totalling and checking of the marks were automated, resulting in more time for examiners to focus on the marking itself and complete their work faster.
Once the transition to e-marking is made and the training is completed, examiners tend to prefer to mark online. The National Examination Centre in Slovenia found that after introducing e-marking 94%* of their examiners thought that e-marking helps them to organise their work more efficiently compared to paper marking.
“I never thought I would prefer to mark online, but you just go through candidate responses so much more efficiently and you don’t have piles of paper all over the floor.” Principal Examiner at Cambridge International Examinations on transitioning from paper-based marking to e-marking.
Myth 2: E-marking doesn’t seem very secure
In the paper-based assessment process, exam scripts are distributed out to examiners via post and then sent back to a central office. There is no way to track what happens to exam papers once delivered, where they may be left, and if lost or destroyed there is no digital back up with paper.
With e-marking, scripts remain all together until they reach a secure scanning facility, where they are scanned into the system, encrypted and stored online with strict access control. Once they are uploaded in the system, only those examiners with verified log in details and permissions can access scripts, meaning that there is less risk of papers falling into the wrong hands or being seen accidentally by people who do not have permission.
Cloud providers are bound by robust data protection procedures and also have localised data centres with encryption capabilities so you can be assured that your data is safe and compliant.
Myth 3: E-marking won’t be suitable for our exams
E-marking has evolved since its inception and is now one of the most popular forms of marking for a variety of exam and assessment formats. In fact, 79% of examiners are now marking papers online* in the UK, across a range of different papers and exams.
Papers with multiple choice answers, essay questions and coursework can all be assessed online. There is even a way of slicing and dicing exam papers so that each question is assigned to examiners with the appropriate expertise.
Diverse formats, from video and audio to diagrams, infographics and other visuals can also be marked onscreen. This allows awarding organisations to mark both candidate examination responses and coursework in a single system.
There is also provision for the adding of annotations, drawings and tools that can help examiners continue to assess to the same standard and in the same way that they normally would.
* 2018 Ofqual Survey of Examiners
Myth 4: It’s better for us to wait until we can move to full e-testing and e-assessment
A full transition to e-assessment can take years of planning, while e-marking allows awarding organisations to make a more achievable first step in their journey to digital assessment.
By finding out what your suppliers capabilities are (see this guide for help and hints on how to do this) you can get the reassurance you need that if you make a move to e-marking and want to implement full-scale e-assessment further down the line, there won’t be any major problems.
E-marking doesn’t have to rely on you having e-testing in place. It can cater for all different types of exam and coursework, so you don’t have to wait until you’re ready to go completely electronic.
The Institute of Chartered Accountants in England and Wales initially began using e-marking to assess ACA exam papers, using human markers. Focussing on their future and growth, they then decided that a move to e-testing would further enhance their ability to replicate a realistic working environment for candidates. Computer-based testing was introduced working collaboratively so that an integration engine connected e-marking with e-testing and the awarding organisation so that all elements of the assessment process were streamlined.
Myth 5: E-marking will compromise the quality of the assessment we provide
E-marking has a robust quality model that leads to fewer errors and fewer scripts being contested for re-marking. One awarding organisation found that 14% of the paper forms used to manually record marks were filled out incorrectly each year. Moreover, 10% of the traditionally marked exam papers were subject to enquiry and the majority had their marks changed. After the introduction of e-marking, the awarding organisation saw a 70% decrease in the number of re-marking enquiries.
Rather than waiting to see whether examiners are marking correctly, standardisation checks and seed scripts provide information to senior examiners in real-time, allowing for timely interventions. The standardisation checks can analyse everyone in the examining chain, from the individual examiner up to the most senior examiner, making sure the marking scheme is being applied accurately at all times.
Careful measures are put in place to minimise human error during the marking process. Unlike paper-based marking, with e- marking if examiners accidentally miss a question then they will be unable to proceed to mark the next question until they have entered a response. Marks will be auto-tallied, removing the possibility of miscalculating a final score and clear annotations mean that any discrepancies can be identified straight away.
In the case of coursework or work that requires objects and artwork to be assessed, this can also be integrated so that the quality of assessment is not affected nor are the results. Media players, high-quality image viewers and detailed annotation functionality ensures that nothing is lost when assessing work that doesn’t involve a script being marked.
Anonymity is introduced to e-marking which means that candidate and institution details are hidden, so it removes any conscious or unconscious bias leading to results that are truly reflective of the quality of candidate work rather than being influenced by any external factors.
Implementing new technology that has the potential to disrupt your current ways of working is not an easy task, and is normal to have a few concerns. However, a good e-marking supplier will take the time to listen to your concerns and needs, design a solution that meets your specific assessment processes and priorities and carefully plan the transition from paper-marking to e-marking.
Do you have any other concerns surrounding e-marking? Get in touch with one of our colleagues here for a free no obligation chat.