Mathew Hillier 5:00 PM To ensure you can hear us please use: Tools > Audio > Audio setup wizard Mathew Hillier 5:01 PM type in here at any time Ruth and Dale #2 5:01 PM Hi, just testing susan.ellicott-darke@sydney.edu.au 5:01 PM testing Mathew Hillier 5:01 PM i am from Melbourne Carol Higgison (Bradford) 5:02 PM I am from Bradford in the UK Rachel F (UK) 5:02 PM Manchester, UK Sue Gill 2 5:02 PM I'm from Newcastle, north east England Ruth and Dale #2 5:02 PM We are from Uni SA, Adelaide LeanneD 5:02 PM I am from Sydney and it's still 30 degrees here! Rachel James 1 5:02 PM Swansea, UK Stephanie 5:02 PM I am from Adelaide Anna Verges 5:02 PM Manchester UK Linda M 5:02 PM Hi Matt! Linda from UQ Brisbane. Weather great here (sorry ;)) Rhonda Gibbons 5:02 PM Armidale NSW Australia Laura 5:02 PM I am from Melbourne (Monash U) Carmel 5:02 PM Hi, I am from Toowoomba (Qld Australia) - perfect weather here today Yes 5:03 PM Mathew Hillier 5:03 PM yes Tim Hunt 5:03 PM y Sarah Kahle 5:03 PM yes Tracy 1 5:03 PM yes Linda M 5:03 PM yes Mathew Hillier 5:03 PM for those just joining - if you cannot hear us please use: Tools > Audio > Audio setup wizard Geoffrey Crisp 5:06 PM must be good if designed by academics! Linda M 5:07 PM https://www.review-edu.com/ Mathew Hillier 5:07 PM for those just joining - if you cannot hear us please use: Tools > Audio > Audio setup wizard thanks linda :-) 5:08 PM susan.ellicott-darke@sydney.edu.au 5:08 PM so no more bell curve to "meet"? Mathew Hillier 5:08 PM @ susan - that is the idea :-) Abby Cathcart #2 5:09 PM The self-assessment is the most powerful part of the software for me Abby Cathcart #2 5:14 PM Hi Danny Barnard 5:18 PM Did I miss meaning of codes Is AOL?, CIRT, etc? On previous slide... 5:18 PM Linda M 5:19 PM AOL = Assurance of Learning Barnard 5:19 PM Tks Stephanie 5:19 PM CIRT = Continuous Improvement Review Team Barnard 5:20 PM Tks Stephanie Mathew Hillier 5:20 PM Assuring Learning OLT Site http://www.assuringlearning.com/ Stephanie 5:21 PM Another challenge in universities are systems that use course/unit/subject as organising unit rather than viewing program as an interconnected whole Jacqui_Lynagh 3 5:26 PM Sometimes the way students engage in work determines what they learn. Is there capacity in review to set/encourage how students engage with their tasks/ Rachel James 1 5:26 PM Swansea University. I'm a Quality Enhancement Officer tasked with improving Learning, Teaching and Assessment Jacqui_Lynagh 3 5:27 PM Thanks Danny. Geoffrey Crisp 5:27 PM How do you encourage other academics to put in the time you have obviously done with this? Can Review be used effectively with limited time input from academics? Thanks 5:28 PM ABby Cathcart 5:29 PM Sorry I had to change rooms Bhavani 5:30 PM would this tool support peer review amongst students? Carmel 5:30 PM Yesa Naomi 5:30 PM Yes thank you ABby Cathcart 5:30 PM (y) Do you use it for multiple choice exams? 5:32 PM Rachel James 1 5:33 PM How much does this software cost? ABby Cathcart 5:34 PM (y) Tim Hunt 5:34 PM Y Barnard 5:34 PM Yep Carol Higgison (Bradford) 5:34 PM how does the software fit in with your student learning environment (LMS/VLE) and other systems for example eportfolio? does it integrate? Geoffrey Crisp 5:34 PM doing a good job with the technology Danny Stephanie 5:34 PM can this software talk to other systems software the university uses, eg the LMS (Canvas, Blackboard, Moodle platforms)? Bhavani 5:35 PM and Desire2Learn? ABby Cathcart 5:35 PM Carol: We use REVIEW at QUT embedded within Blackboard - haven't seen it linked with e-portfolio yet but its a lovely idea Debbi Weaver 5:36 PM Does Review work on mobile devices? for both staff and student interfaces? Carol Higgison (Bradford) 5:37 PM see https://www.review-edu.com/ ABby Cathcart 5:37 PM Yes Debb -some of our tutors mark on tablets and it looks fine Debbi Weaver 5:37 PM Thanks Abby susan.ellicott-darke@sydney.edu.au 5:37 PM is audio feedback enabled? Carol Higgison (Bradford) 5:38 PM @Abby: do you use it for student assessment within Blackboard rather than Bb assignment handler? Bhavani 5:38 PM Is it possible to download both marks data and comments data? Colin Simpson 5:38 PM does this integrate with Turnitin at all? Carol Higgison (Bradford) 5:38 PM we have been looking at the Bb program goal internal mapping tools. yes please would love that 5:39 PM ABby Cathcart 5:40 PM @Carol - not quite but as Danny says I think its coming. We still get students to submit on turnitin, mark (and self-assess) in REVIEW and then export results later Thanks Danny 5:40 PM Paul A Whitelaw 1 5:40 PM Is that $1.80 per student per semester, or per unit of study or per year? thank you 5:41 PM Rachel James 1 5:41 PM That's great, thanks Danny Colin Simpson 5:42 PM ok thanks ABby Cathcart 5:42 PM We'll add it to the research agenda Danny (growing list) Tim Hunt 5:42 PM Y Linda M 5:42 PM yes ABby Cathcart 5:42 PM (y) Sara Rickards 5:42 PM yep Carol Higgison (Bradford) 5:42 PM we are trying to wean our faculty off detailed in text comments to more strategic feedback against specific learning outcomes - a big challenge. Tim Hunt 5:43 PM (LOL just received the email saying that this webinar is starting in 5 minutes.) Mathew Hillier 5:43 PM opps maybe the time zone was off on the server. will have to check into that! ABby Cathcart 5:45 PM @Carol we have the same challenge here, the beauty of this system is that you can tailor the feedback to the exposed gaps between their self-assessment and the tutor's assessment i.e. not lots of feedback, but very focused - Sara Rickards left the Main Room. ( 5:45 PM ) - Rachel F (UK) 5:46 PM @abby and Carol, do you think it's hard to get people to think about feedback for improvement rather than feedback to justify the mark? Ellen McIntyre 5:47 PM Do they get some sort of printout of these individual outcomes? Carol Higgison (Bradford) 5:47 PM not yet but we have been asked to look at this by our Faculty of Management for similar reasons that you have engaged with it. ABby Cathcart 5:47 PM @Yes Rachel....but I think colleagues are usually open to being convinced! Carol Higgison (Bradford) 5:48 PM that would be great Bhavani 5:48 PM what format can the data be exported for doing some analysis - closing the loop at program level? Tim Hunt 5:48 PM If you get to the UK by 30th June, you may be interested in http://aheconference.com/ahe-seminar-2016/ Geoffrey Crisp 5:49 PM would be good to also let students know whether feedback is for current learning or future learning. Carol Higgison (Bradford) 5:49 PM my assessments are coming in this afternoon so lots of practice to look forward to over then next couple of weeks. Barnard 5:50 PM Can we return to singlew screen view pls? ABby Cathcart 5:54 PM ethical considerations need a bit of work! Barnard 5:55 PM 2dp seems a bit serious! Bhavani 5:55 PM is there anyway we can get the report with assessment weight for each criteria (to ensure more validity to AoL process? Geoffrey Crisp 5:55 PM This is meaningful when the alignment between the learning outcomes and the assessment have been mapped accurately. Barnard 5:57 PM 2 decimal places! susan.ellicott-darke@sydney.edu.au 5:57 PM are students able to give reasons for the feedback rating they give to staff? Barnard 5:57 PM I suspect your accuracy is less than the figures quoted? Debbi Weaver 5:58 PM Thanks, very interesting:) Carol Higgison (Bradford) 5:58 PM LOTS to think about. Paul A Whitelaw 1 5:58 PM thanks Danny - very informative - need to go. cheers Paul Linda M 5:58 PM Thansk again - great work! Rachel James 1 5:59 PM It's been fantastic, thank you Danny. I'm quite excited about proposing this to the powers that be at Swansea Barnard 5:59 PM I worry - perhaps foolishly - about 'weighting' of qualitative criteria to make up 'final marks' ? ABby Cathcart 5:59 PM Thanks Danny, really interesting, I finally got my hands on this version of review and can't wait to get stuck in Erica Wilson 5:59 PM Thanks danny - Liz Johnson 5:59 PM thanks all - most interesting Barnard 5:59 PM Thanks Mathew Bhavani 5:59 PM Thank Danny! - very useful and interesting session! Colin Simpson 5:59 PM thanks everyone Lynn 4 5:59 PM Thanks Sheona Thomson QUT 5:59 PM Thank you, Danny. Super interesting. :) Barnard 6:00 PM Thanks danny Rachel James 1 6:00 PM Thanks everyone Jamie 6:00 PM Thanks...really interesting. Naomi 6:00 PM Thank you Barnard 6:00 PM et al Geoffrey Crisp 6:00 PM Thanks Danny - great presentation S 6:00 PM Thanks Danny Carol Higgison (Bradford) 6:00 PM thanks very much - really enjoyed it and worth getting up early ;) I would like to continue off-line. Rachel F (UK) 6:00 PM Thanks Carol Higgison (Bradford) 6:00 PM bye Rachel James 1 6:00 PM Thank you, that's great. Definitely expect an email at some point! Jacqui_Lynagh 3 6:01 PM is is worth doing on a small scale to begin with before doing it at the Program/Degree level? Barnard 6:01 PM Thanks, there is an issue but that is what professional judgements are about, right! Ellen McIntyre 6:02 PM Thanks Rhonda Gibbons 6:03 PM Thanks I have not joined this forum before and found it well worth the effort ABby Cathcart 6:03 PM Bye Danny Geoffrey Crisp 6:04 PM Rhonda you can check out the recordings too Jacqui_Lynagh 3 6:04 PM Thanks Danny and Matthew - was great. Bye for now, Jacqui. Rhonda Gibbons 6:05 PM Thanks Geoff - Rhonda Gibbons left the Main Room. ( 6:05 PM ) - susan.ellicott-darke@sydney.edu.au 6:05 PM Thanks all Danny Carroll UNSW 6:07 PM Bye all - it was fun & pls get in touch offline if you want - best danny 6:07 PM Mathew Hillier 6:08 PM thanks all :-) the room will close in a minute. 6:08 PM