WEBVTT 00:02:30.000 --> 00:02:30.900 Recording in process Tim. 00:02:42.000 --> 00:02:42.900 I'm afraid I can't understand Fabio due to echo. Am I the only one experiencing this? 00:03:11.000 --> 00:03:11.900 I don't get any echo. 00:03:23.000 --> 00:03:23.900 Hi Julian, sorry. It seems all good on my end 00:03:32.000 --> 00:03:32.900 Julian do you have the original Blackboard room open still? 00:03:32.000 --> 00:03:32.900 No echo on my side Julian, is this any better now? 00:03:44.000 --> 00:03:44.900 have you both BB Collaborates running? 00:04:06.000 --> 00:04:06.900 or have you closed the original 00:04:40.000 --> 00:04:40.900 The echo happens if you have both Collaborates running 00:05:26.000 --> 00:05:26.900 Thank you! 00:05:35.000 --> 00:05:35.900 I'm not familiar with 'future-oriented teaching model' can anyone expand? 00:05:49.000 --> 00:05:49.900 It only occured when Fabio was talking... but all fine now 🙂 00:06:01.000 --> 00:06:01.900 he had mic open in both 00:06:16.000 --> 00:06:16.900 Sorry it was hard to multitask 🙂 00:06:28.000 --> 00:06:28.900 no problem... all is fine now 00:07:40.000 --> 00:07:40.900 @Elaine (Sydney Uni) is is a choice for a teaching model based on activation (active, cooperative, and solution-oriented) 🙂 00:08:01.000 --> 00:08:01.900 thanks Sarah! 00:09:17.000 --> 00:09:17.900 I think in our institution proctoring was not considered mainly due to cost barriers and difficulty in implementation. 00:10:21.000 --> 00:10:21.900 What is the LMS? 00:10:30.000 --> 00:10:30.900 Learning Management System 00:10:30.000 --> 00:10:30.900 Learning managements system or VLE 00:10:33.000 --> 00:10:33.900 Learning Management System? 00:10:40.000 --> 00:10:40.900 Yes! 00:10:51.000 --> 00:10:51.900 LMS = VLE 00:10:53.000 --> 00:10:53.900 but which one was it? (sorry) 00:10:53.000 --> 00:10:53.900 Yes VLE 00:11:01.000 --> 00:11:01.900 It was an institutional decision not to use proctoring ...but feedback from Russell group colleagues reported it was problematic and if used, didn't intend to continue... 00:11:21.000 --> 00:11:21.900 ahh which LMS /VLE 🙂 00:11:42.000 --> 00:11:42.900 yeah which one (Moodle, Canvas)? 00:11:59.000 --> 00:11:59.900 The problem is not just training teachers, but also students... A lot to take on. 00:12:28.000 --> 00:12:28.900 @Jay Cohen #2 it is Toledo 00:12:31.000 --> 00:12:31.900 Which VLE - I don't think this has been said as yet. 00:12:46.000 --> 00:12:46.900 Discipline needs as Karen says are so different. E.g. Maths online is a nightmare. 00:13:27.000 --> 00:13:27.900 Disability/Accessibility requirements 00:14:15.000 --> 00:14:15.900 I am curious about the accessibility of proctoring and students with additional needs and how they would be catered for with proctoring 00:14:54.000 --> 00:14:54.900 Thank you @Sarah Marent (KU Leuven) 00:16:10.000 --> 00:16:10.900 Very delicate matter @anne chard - not something we can fix with "extra-time" as typical blanket policy. 00:16:16.000 --> 00:16:16.900 @Mike and @anne chard the ability to take exams in own home environment might be less of an issue for those with accessibility requirements and specific learning needs than on campus methods. 00:16:53.000 --> 00:16:53.900 Fair point Fiona. There's very little research on this still. 00:17:18.000 --> 00:17:18.900 We find that test runs/mock exams are really helpful in managing student anxiety and minimising technical issues 00:17:48.000 --> 00:17:48.900 Unfortunately, I have to go, but I look forward to listening to the recording. 00:17:49.000 --> 00:17:49.900 I bet this reduces anxiety for teachers too @Maggie Gibson #2 00:17:57.000 --> 00:17:57.900 Thanks Claudia! 00:18:05.000 --> 00:18:05.900 @magie... are your tests/mocks based on process experience or marking student scripts too? 00:18:14.000 --> 00:18:14.900 have other institutions been able to make assistive tech available for students who need to use it during a locked down and/or remote proctored exam? 00:18:32.000 --> 00:18:32.900 Interested to hear how a proctored session is review/inspected? If there was the incident of someone entering the room during the session for example, how this is flagged and reviewed? 00:18:47.000 --> 00:18:47.900 @Maggie Gibson #2 I agree - this should be standard rather than it being seen as an additional asect. 00:18:57.000 --> 00:18:57.900 some students don't have a private space at home 00:19:35.000 --> 00:19:35.900 @Julian Gould from Cardiff #2 The purpose is the process experience, but of course this is good practice and allows for formative assessment. How they are set up and whether they are marked depends on the course - usually they are. 00:20:08.000 --> 00:20:08.900 @Maggie Gibson #2 That's very helpful to know. Thanks Maggie! 00:20:13.000 --> 00:20:13.900 @Mike this is true, it is a difficult problem to address. 00:20:18.000 --> 00:20:18.900 Good point, Mike - we have to consider all student needs. 00:21:46.000 --> 00:21:46.900 I would think a very good system of review and appeal is important to reassure students and staff 00:22:37.000 --> 00:22:37.900 We have an on-campus centre with pcs and staffing available for students who do not have appropriate space/IT equipment/do not give GDPR consent/have additional needs that cannot be met remotely. Almost all students do their proctored exams from home, but we do have a few coming to campus. 00:22:59.000 --> 00:22:59.900 👍 00:23:02.000 --> 00:23:02.900 👏 00:27:24.000 --> 00:27:24.900 Interesting point... new providers jumpining in at the opportunity. 00:30:57.000 --> 00:30:57.900 Has any colleague in the room experience of proctoring during Covid in their institution? 00:31:55.000 --> 00:31:55.900 not in my institution Fabio but yes at my professional body at massive scale! 00:32:17.000 --> 00:32:17.900 yes at USyd for final exams 00:32:21.000 --> 00:32:21.900 Ah yes, professional bodies! 00:32:26.000 --> 00:32:26.900 and some mid-semester exams 00:32:27.000 --> 00:32:27.900 We have a type of proctoring using mobile phones that record sound - most of our students do not have computers and webcams, or good enough wifi. Its not bad, but also not great 00:33:09.000 --> 00:33:09.900 Interesting Ingrid, I didn't know about this. 00:33:30.000 --> 00:33:30.900 Yes. We were already using digital assessment systems with some of the features Steffen is describing. During the pandemic we were able to add proctoring as we already had the structures and staffing in place. 00:33:55.000 --> 00:33:55.900 they were already using a sophisticated online exam platform but even so the proctoring was a significant project to implement. I think the option to sit remotely will be a permanent one. 00:34:06.000 --> 00:34:06.900 That's crucial @Maggie Gibson #2 . We surely were not ready for it. 00:34:07.000 --> 00:34:07.900 @anne chard one of our pilots focused on the question wether protoring could be accessible for students with addiotional needs; no overall answer, depending on the needs it is or is not accessible. For those who it was possible had a very positive experience as they could do their exams at their chosen place. 00:34:09.000 --> 00:34:09.900 It was developed in South Africa to deal specifically with the fact most of our stuednts stay in areas without good Internet 00:34:23.000 --> 00:34:23.900 There was an institution level decision at Newcastle that remote proctoring will only be used if required by a professional accrediting body (PSRB), and where an in person exam is not possible. To date all take home exams have been open book, and we are investigating remote proctoring solutions should they be required in future if an in person exam isn't possible for an exam with a PSRB requirement for remote proctoring 00:34:24.000 --> 00:34:24.900 We abolished on-campus exams @Alice Shepherd (Univ of Leeds) (unless regulated externally) 00:35:07.000 --> 00:35:07.900 At Flinders University in Adelaide we have been using remote proctoring for exams in medicine and accounting where the accrediting bodies require this. 00:35:41.000 --> 00:35:41.900 interesting @Rebecca Gill (Newcastle UK) there's a default position at Leeds that everything will be take online open book. We're a special case because of professional accreditation, and running on campus exams this year. Don't know what we will settle on in the longer term. 00:35:45.000 --> 00:35:45.900 I now have to leave - thanks for a great session. Will the recording be made available and if so, where/how may it be accessed? 00:35:47.000 --> 00:35:47.900 Are you using a provider @Rogerh? Which one? 00:36:07.000 --> 00:36:07.900 RPNow 00:36:42.000 --> 00:36:42.900 Maybe PSRB will change requirements in future? My partner takes a lot of accredited training. They are progressively changing from invigilated exams to open book project submissions. 00:37:05.000 --> 00:37:05.900 Thanks @Rogerh 00:37:26.000 --> 00:37:26.900 @Fabio Arico discussions are ongoing but in accountancy in the UK it's not so much the professional bodies, it's the regulator (currently the Financial Reporting Council) which pulls the strings, and they are quite traditional! 00:37:36.000 --> 00:37:36.900 @Alice Shepherd (Univ of Leeds) sounds like the same situation as we have had - for exams with professional body requirements thus far we have been able to deliver them on campus (with appropriate social distancing measures etc) 00:37:39.000 --> 00:37:39.900 At my previous institution we retained a MCQ exam - opened it for 24 hours, but students could only access it for the same time as they would have done on campus - this enabled students to complete thee exam when it was convenient to them. 00:37:55.000 --> 00:37:55.900 No problem, we have had a number of issues especially with students in China 00:38:19.000 --> 00:38:19.900 what sort of issues @Rogerh 00:38:27.000 --> 00:38:27.900 IT issues or cheating? 00:38:39.000 --> 00:38:39.900 IT 00:38:47.000 --> 00:38:47.900 Thanks 00:39:11.000 --> 00:39:11.900 @Fiona Meddings I did this too- for most it worked well and felt appropriate given the time zone spread. But there were unfortunately new forms of collusion as well! 00:39:23.000 --> 00:39:23.900 👏 00:39:31.000 --> 00:39:31.900 We use a couple of providers and make decisions about proctoring based on the needs of the course and the students. High stakes exams (mostly PSRB regulated) use video stream proctoring, others use the WiseFlow type and others use lockdown browsers only. The uni policy is for all exams to be remote. 00:39:40.000 --> 00:39:40.900 if a student really wants to cheat I expect they can cheat proctoring also 00:39:48.000 --> 00:39:48.900 yes @mike 00:39:56.000 --> 00:39:56.900 @Mike absolutely 00:40:25.000 --> 00:40:25.900 I think there will always be a small number of students who choose to apply their ingeniuty to cheating rather than their studies! 00:41:07.000 --> 00:41:07.900 @Alice Shepherd (Univ of Leeds) - interesting point. They have 90 mins to complete a 100 question MCQ - not a lot of time for collusion. 00:41:39.000 --> 00:41:39.900 if doing computer science then hacking the system could be a good test !! 00:41:49.000 --> 00:41:49.900 @Mike White hats! 00:42:25.000 --> 00:42:25.900 Thanks @Karen Van Eylen (KU Leuven) and @Steffen/UNIwise for your presentations - food for thought. Thanks also to @Fabio Arico for dealing with the start up issue so well!! Need to go now. 00:42:25.000 --> 00:42:25.900 Thanks @Karen Van Eylen (KU Leuven) and @Steffen/UNIwise for your presentations - food for thought. Thanks also to @Fabio Arico for dealing with the start up issue so well!! Need to go now. 00:42:51.000 --> 00:42:51.900 Another meeting calls - thanks for a very interesting session. 00:43:44.000 --> 00:43:44.900 That's great thanks, I was also thinking about issues around IT compatibility etc and how common it is and easy for staff to sort out- which you are talking about now! 00:43:53.000 --> 00:43:53.900 Thanks all. V interesting. 00:46:23.000 --> 00:46:23.900 Thank you 00:46:31.000 --> 00:46:31.900 Thank you! 00:46:31.000 --> 00:46:31.900 Many thanks to everyone - very interesting session 00:46:33.000 --> 00:46:33.900 Thanks very much 00:46:35.000 --> 00:46:35.900 thanks all 00:46:37.000 --> 00:46:37.900 Except for places with a half-hour time zone 😉 00:46:38.000 --> 00:46:38.900 Thanks all and thanks for pushing through at the start. A very helpful session. 00:46:38.000 --> 00:46:38.900 Thanks a lot 00:46:40.000 --> 00:46:40.900 many thanks for a really interestign session; thanks for fixing the tech as well - much apprecaited 00:46:40.000 --> 00:46:40.900 Excellent session and well handled Fabio! 00:46:41.000 --> 00:46:41.900 Thank you 00:46:45.000 --> 00:46:45.900 I'll stay for 10 minutes if needed by colleagues 🙂 00:46:45.000 --> 00:46:45.900 Thanks. Interesting session. 00:46:46.000 --> 00:46:46.900 Thank you very much! 00:46:50.000 --> 00:46:50.900 Will the slides be available on the website? 00:46:51.000 --> 00:46:51.900 Thank you Karen and Steffen 🙂 00:46:56.000 --> 00:46:56.900 Thank you for a great session 00:46:57.000 --> 00:46:57.900 Thanks so much Steffen, Karen and Fabio - really useful and interesting session! 00:46:57.000 --> 00:46:57.900 Thank you all, very interesting discussion - and thank you for flexing with the technical issues so the session could still go ahead, much appreciated! 00:48:10.000 --> 00:48:10.900 students good at on campus cheating 00:48:27.000 --> 00:48:27.900 Julian, I wonder whether there is one solution - possibly a flexible and responsive range of solutions? 00:48:51.000 --> 00:48:51.900 uniwise.co.uk/blog/to-proctor-or-not-to-proctor-is-that-the-question 00:49:34.000 --> 00:49:34.900 uniwise.co.uk/blog/preventing-academic-misconduct-in-digital-exams-using-third-party-programs 00:50:28.000 --> 00:50:28.900 wouldn't student having risk of Viva be an easier option? 00:51:07.000 --> 00:51:07.900 I do vivas in my module. I was trained like this in Italy. It can be done, but takes time to implement. 00:51:31.000 --> 00:51:31.900 Yes, I would love to see figures on what difference proctoring has made in cheating case figures and also exam appeal numbers- whether these have gone up or down 00:51:52.000 --> 00:51:52.900 Mike that's a good option, but labour intensive if you have large cohorts. You would have to have some way of identifying students for viva - would it be a random selection? 00:52:59.000 --> 00:52:59.900 If students don't know how you are selecting sample then greater risk for them 00:53:03.000 --> 00:53:03.900 We also searched for other ways to control the authenticity, other than proctoring, like for example change the way of assessment to working with more unique assignments 00:53:25.000 --> 00:53:25.900 thank you Karen! 00:53:44.000 --> 00:53:44.900 my colleagues want to know that the student - and not another - is answering the exam paper 00:54:01.000 --> 00:54:01.900 The problem with stats on cheating is you only know about the ones you caught 00:54:27.000 --> 00:54:27.900 Definitely assessment design and format is an important consideration. Exams aren't the best option in many cases. 00:54:39.000 --> 00:54:39.900 should/would students report other students for cheating? 00:55:26.000 --> 00:55:26.900 True but there are many papers and articles on proctoring from both sides of argument but I am finding it hard to find evidence based info 00:55:34.000 --> 00:55:34.900 I agree that vivas are a very good way of deterring/catching cheating - for both exams and hand-in assessement 00:56:36.000 --> 00:56:36.900 Mike I've talked to people who have had students contact them to complain about cheating - especially on weekly quizzes 00:56:47.000 --> 00:56:47.900 sorry I have to leave now, but thank you again everyone 00:56:51.000 --> 00:56:51.900 I had people reporting too 00:56:54.000 --> 00:56:54.900 Thanks Rebecca 00:56:58.000 --> 00:56:58.900 @Karen Van Eylen (KU Leuven) I agree with that point 100%. 00:57:27.000 --> 00:57:27.900 should students be encourages to report cheating? 00:58:02.000 --> 00:58:02.900 Text matching is useful, but in my experience you have to have a take home exam to do it, as otherwise someone has to upload the text to Turnitin etc. 00:58:06.000 --> 00:58:06.900 I am sorry that I need to go now. Well done Fabio for getting this organised beyond the initial challenges this morning. 00:58:17.000 --> 00:58:17.900 Thanks Fiona 00:58:40.000 --> 00:58:40.900 Thank you @Karen Van Eylen (KU Leuven) and @Steffen/UNIwise see you in Manchester. 00:58:52.000 --> 00:58:52.900 Mike I think they should be encouraged but not rewarded - incentives can result in perverse outcomes 00:59:01.000 --> 00:59:01.900 Phillip, some exam systems have Turnitin as an addin so it can be used in remote exams with proctoring 00:59:04.000 --> 00:59:04.900 thank you!! 00:59:12.000 --> 00:59:12.900 Thanks you presenters- very good session. 00:59:35.000 --> 00:59:35.900 Thank you all presenters