WEBVTT 00:13:07.000 --> 00:13:07.900 As Mathew mentioned, please do drop questions or comments in the chat box as we go and I'll moderate a discussion after all 3 presentations. Thank you πŸ™‚ 00:14:08.000 --> 00:14:08.900 Question: I assume paper leakage control is to reduce risk of cheating. What was in place to prevent cheating where student were 'online'? 00:15:23.000 --> 00:15:23.900 who were the proctors? employed by the university or an outsource service? 00:16:07.000 --> 00:16:07.900 So students were required to have two cameras linked to their computers? 00:17:09.000 --> 00:17:09.900 How did the team deal with any technical issues the students had during such a large scale live assessment and what sort of scale did you experience technical issues? 00:17:23.000 --> 00:17:23.900 What training data set was used for the AI to determine a risk score for each candidate? 00:17:44.000 --> 00:17:44.900 did all students have access to quiet private home spaces? 00:18:38.000 --> 00:18:38.900 Thank you for sharing the Learning Spiral exam project - I'm wondering what differences the local cultural expectation make to the success of this type of intervention? 00:19:32.000 --> 00:19:32.900 Can you talk more about the hand-written response submission? Did students take a picture of their hand-written response and upload as a picture? Did you allow for more test time for students to use the technology? 00:20:26.000 --> 00:20:26.900 Dear YvonneW - For preventing online cheating there was AI based live proctoring and a secured app which ensured you were not accessing any other applications during the examination. For final semester 2 devices were used for video feeds in close to 300 degrees 00:20:49.000 --> 00:20:49.900 How was digital accessibility of assessments for disabled students ensured? 00:21:08.000 --> 00:21:08.900 nebosh - what foresight to make this a permanent change - where there ideas already in the pipeline that this situation allowed you to push forward? 00:21:26.000 --> 00:21:26.900 Dear Mathew Hillier - The proctors were a mix of staff of the University as well as trained proctors provided by Learning Spiral to the University. 00:22:12.000 --> 00:22:12.900 Dear Sarah Yu - For Final Semester Examinations leading to Degrees students needed TWO devices [typically it was TWO mobiles in the Indian context] 00:24:53.000 --> 00:24:53.900 Dear Kathy - The multiple mock sessions done [we did 10 for the entire cohort] made sure that the issues came during the mock sessions where there was no panic and more time for students and support team. Most of the issues as expected were related to students getting used to the interface , device configuration etc and all of that got solved in the mock sessions largely. During live sessions there were usually close to only 4000+ calls only [against a cohort of 100-120k per day. 00:25:47.000 --> 00:25:47.900 Dear Ammar Aldaoud - Mock session data and previous assessment data of drives conducted by Learning Spiral was used for the training 00:27:16.000 --> 00:27:16.900 How much time does closing interview take? 00:28:05.000 --> 00:28:05.900 Dear Mike - Students were from very diverse backgrounds. Many used mobiles and took the test from small rooms. Based on our survey the rooms were many times of their relatives / friend and not necessarily their own 00:28:30.000 --> 00:28:30.900 Are you finding opportunities to develop academic integrity as a preventative measure for malpractice - I think you covered some of this as I was writing the question. Any surprises as you reviewed the types of malpractice? 00:29:49.000 --> 00:29:49.900 Is the "3,000" words assessment the only piece of assessment? Or were there other formative assessments as well? 00:30:12.000 --> 00:30:12.900 Dear Sarah Yu - Yes students uploaded a picture of their handwritten paper. It was especially useful in Arts / Drawings / Scientific and Literature / Language examinations. For uploads separate time was given. 00:31:02.000 --> 00:31:02.900 Thanks Manish Mohta 00:33:56.000 --> 00:33:56.900 Hi Sarah - in addition to the open book assessment learners also have to complete a practical assessment in their workplace. We are now introducing formative assessment as an additional requirement. 00:35:51.000 --> 00:35:51.900 Thanks Dee 00:37:35.000 --> 00:37:35.900 Hi Mike - the closing interview takes approx 15 minutes - it is primarily an authenticity check - if the Learning Partner has any concerns an investigation is raised by our Ethical Practice Team 00:38:20.000 --> 00:38:20.900 ACER Signum - love the multi-language feature. I have no experience of this , sounds absolutely fascinating, not sure where to start with questions, it would be great to have the opportunity to experience this process. 00:38:47.000 --> 00:38:47.900 Thank you YvonneW, feel free to reach out if you are interested to learn more. 00:39:32.000 --> 00:39:32.900 Question for all three speakers: Introducing change is always difficult, particularly in assessment. What advice would you give to another organisation that is looking at introducing e-assessment change into their practice in order to give it the greatest chance of success? 00:42:17.000 --> 00:42:17.900 Thanks Manish - seems like the concerns are universal - the scaffolding you provided worked well πŸ™‚ 00:48:45.000 --> 00:48:45.900 Dear Matt Wingfield - My views areΒ  - involve all the stakeholders - have a dedicated and trained support desk which all stakeholders can access and get their issues cleared. also this becomes the early alarm system for taking corrective measures - have numerous mocks sessions in low stake environments to make stakeholders comfortable and avoid panic - have success indicators identified clearly 00:48:53.000 --> 00:48:53.900 interestingly some universities in australia have partly gone back to on-campus paper exams after covid restrictions have ended. mainly due to concerns around academic integrity. however many also are continuing some online exams for those that cant make it into campus. it is a push / pull to move things forward with larger scale online invigilated exams. 00:51:04.000 --> 00:51:04.900 we have also found the mock sessions are key to minimising issues on exam day. 00:51:27.000 --> 00:51:27.900 and having a hotline for students to call if they run into issues πŸ™‚ 00:51:49.000 --> 00:51:49.900 Very good point Manish re: Mobile, we made Signum work on mobile for a global study. Helped a lot! 00:55:37.000 --> 00:55:37.900 Thanks everyone. I do agree that stakeholder engagement is critical - including the students themselves. 00:55:50.000 --> 00:55:50.900 Thanks to Matthew for hosting, Paul - great curation and synthesis of questions and Panel: Manish - Stirling effort answering our questions, Dee - great example of working with regulators and the speed you pulled it off and Jacob and Ammar - I'll be in touch to learn more, thank you. 00:56:52.000 --> 00:56:52.900 thank you everyone - very helpful and congratulations 00:57:21.000 --> 00:57:21.900 Great session, thank you everyone. Have a nice day! 00:59:41.000 --> 00:59:41.900 Thanks everyone. A great session. 00:59:45.000 --> 00:59:45.900 Great session - thanks so much! 01:00:00.000 --> 01:00:00.900 Thank everyone! 01:00:00.000 --> 01:00:00.900 thank you