On a Thursday morning in mid-November, thousands of New Zealand students sitting their Level 2 English NCEA exam on the digital platform watched their work disappear or found themselves locked out, as a fault in moving answers between systems left classrooms scrambling. The failure was resolved within the hour, but that hour was long enough to expose how much schools were left to improvise without clear direction, and how thin the margin is between a modern assessment tool and a day of lost effort. Nobody disputes that the students have been wronged; the open question is whether a system that
'Utter chaos': NCEA digital exam outage leaves schools scrambling for fallback plans
Students have been badly let down.
Start with the basics. What actually went wrong on Thursday?
NZQA says responses weren't transferring properly from the exam platform to the marking platform. Level 2 English began at 9.30am, and students lost work or couldn't log on. NZQA says it was fixed by 10.35am.
An hour doesn't sound long, but the teachers describe chaos.
Because schools had to decide things on the spot. Abercrombie says some were photocopying papers frantically, and some sent students home before NZQA had said much of anything.
Careful with that, though. That's Abercrombie's account of what schools did, relayed on Breakfast. The reporting doesn't give a count of schools that sent students home or how many were affected beyond "thousands."
Fair. What about the fix for students?
Grades will use the higher of the exam or practice exam result. NZQA will also look at other evidence from schools and compare results with previous years.
Which means the actual effect on grades is still unknown. "Adjusted" is a possibility Hawkesby raised, not a settled outcome.
And the politics?
Stanford, the caretaker education minister, said students were badly let down and directed NZQA to produce a plan so it doesn't recur.
She also said she was assured no one would be disadvantaged. That's an assurance, not a demonstrated result. And Abercrombie's questions about the vendor are questions, not findings. Nobody has yet said what the root cause was beyond the transfer fault.
Next week's Level 1 English exam will have full paper contingency, so the test of confidence comes quickly.
Der Puls
- Thousands of Level 2 English students lost their typed exam work or could not log on at all just after the 9.30am start.
- Teachers were left to improvise in real time, with some photocopying paper exams in a frantic rush and others sending pupils home before NZQA said anything substantive.
- NZQA's chief executive apologised, blamed a transfer fault with its digital exam provider, and said the platform was fixed by 10.35am.
- Students will be graded on the higher of their exam or practice exam result, while the minister has ordered a plan to prevent any repeat.
- Next week's Level 1 English exam will have full paper backup, but questions about the vendor and the future of digital-first assessment remain unsettled.
On a Thursday morning in mid-November, thousands of New Zealand students sitting their Level 2 English NCEA exam on the digital platform watched their work disappear or found themselves locked out, as a fault in moving answers between systems left classrooms scrambling. The failure was resolved within the hour, but that hour was long enough to expose how much schools were left to improvise without clear direction, and how thin the margin is between a modern assessment tool and a day of lost effort. Nobody disputes that the students have been wronged; the open question is whether a system that promises speed and convenience can still be trusted to show, reliably and fairly, what a young person has learned.
On Thursday morning, Level 2 English students across New Zealand sat down to their NCEA digital exam at 9.30am. Soon after, many saw their work vanish, and others could not log on at all. Teachers watching from the front of their classrooms described the scene as utter chaos.
The New Zealand Qualifications Authority said its platform had experienced issues moving student responses to the marking system. By 10.35am, about an hour in, the problem was declared fixed. But that hour was enough to leave schools on their own. Some were photocopying paper exams in a rush, some sent students home before there was real information, and one teacher said they were learning more from NZQA's Facebook page than from anyone directly. Schools were making big decisions before they had the facts.
NZQA chief executive Christian Hawkesby apologised to students and parents and said the fault was identified and fixed with the help of one of the world's largest digital exam providers. Affected students will be graded on the higher of their exam or practice exam result, and NZQA will look at other evidence and compare results with previous years.
Education Minister Erica Stanford said the students had been badly let down and that she had directed NZQA to produce a clear plan so it does not happen again. Students and parents, for their part, described anger, upset and stress.
Next week's Level 1 English exam will have full paper backup in every school. The larger questions, about the vendor and whether digital-first assessment serves students, teachers and schools well, remain open.
On Thursday morning, Level 2 English students across New Zealand sat down to their NCEA digital exam at 9.30am. Soon after, many found their work had vanished, and others could not log on at all. For teachers watching in classrooms, it turned into what Post Primary Teachers Association president Chris Abercrombie called "utter chaos."
The New Zealand Qualifications Authority later said its digital exam platform had "experienced issues" moving student responses from the exam platform to the marking platform. The problem affected thousands of students. By 10.35am, about an hour after the exams began, NZQA said it had been resolved.
That hour was long enough for schools to be left on their own. Abercrombie told Breakfast that schools had to devise their own responses and make decisions "before they even had the information." Some, he said, were "furiously trying to photocopy in every photocopier in the school" to produce paper copies of the exam. Others sent students home, in some cases before NZQA had released any real information. One teacher told him they were learning more from NZQA's Facebook page than from anything the schools were being told directly. "Just sort of hoping it was the best decision," he said of the choices schools made.
Abercrombie said the failure raises "serious questions." He asked why New Zealand sticks with a vendor that, at the moment, "can't seem to manage the system," and what the next steps are. He also pointed to a wider issue, the push for "digital first" assessment. He asked whether students, teachers and schools actually want it, saying there seemed to be an assumption that they do. A qualification system, he said, has to reliably show what a young person can do.
NZQA chief executive Christian Hawkesby apologised to students and parents while defending the system. He said NZQA partners with one of the world's largest providers of digital exams, and that it worked with that provider to identify the fault, fix it and restore the platform. He said the platform was stable and worked during Thursday afternoon's exams.
For affected students, Hawkesby said grades will be based on the higher of their result in the exam itself or in their practice exam. NZQA will also work closely with schools on what other evidence can be used, and will examine overall results against previous years to judge whether adjustments are needed. He said digital exams bring advantages, including faster marking and quicker results, and that NZQA receives a lot of support for that direction.
Caretaker Education Minister Erica Stanford said the disruption would have been "incredibly frustrating and stressful" for students, and that her main concern is that they are treated fairly and not disadvantaged. She said she had been assured a plan was in place to ensure no student was disadvantaged. She also said she had made her disappointment and frustration very clear to NZQA and directed it to develop a clear plan of action so this does not happen again. "Students have been badly let down," she said. Students and parents also told 1News of their anger, upset and annoyance.
Next week's Level 1 English exam is the last large-scale digital assessment of the year. Hawkesby said all schools will have full paper contingency for it, which he hopes will put students' minds at rest. The questions about the vendor, and about whether digital-first assessment should continue, remain open.
Bemerkenswerte Zitate
Students have been badly let down. They and their families deserve confidence that the systems supporting their exams are reliable.— Erica Stanford, caretaker Education Minister
Schools had to make decisions before they even had the information.— Chris Abercrombie, PPTA president