Mathew Hillier 5:01 PM OK Wilma (Edinburgh) 5:02 PM :) m 5:02 PM hi m = martina Geoff Crisp 5:03 PM hi Mathew Hillier 5:03 PM type here! Phil 5:03 PM Terrific Bronwen 5:04 PM Hello everyone Mathew Hillier 5:04 PM i am from brisbane australia mark wetton 5:04 PM HI Wilma Andrew Dekker 5:04 PM Hi all :) Mathew Hillier 5:04 PM where are you from? Wilma (Edinburgh) 5:04 PM Hi Mark Ross Titshall 5:04 PM Hi from Wales m 5:04 PM :) Amy Woodgate, University of Edinburgh 5:04 PM Edinburgh out loud and proud! :) Wilma (Edinburgh) 5:04 PM Big Edinburgh contingent - Hi Amy! LJShaw 1 #2 5:04 PM Hi from Canterbury England Mathew Hillier 5:05 PM http://www.transformingassessment.com/ Anne-Marie Scott (Edinburgh) 5:05 PM Morning all (or evening to antipodean chums) Phil 5:06 PM Go'day Anne Marie! m 5:06 PM (y) Mathew Hillier 5:07 PM L m 5:07 PM ;) Mathew Hillier 5:07 PM :-D Mathew Hillier 5:07 PM opps my fault :-D Phil 5:07 PM No worries, mate LJShaw 1 #2 5:08 PM Good the different title was not what I wanted Andrew Dekker 5:08 PM hello :> Geoff Crisp 5:08 PM sorry saw the two different titles and picked the wrong one!! Phil 5:08 PM Hi there! m 5:10 PM (y) Phil 5:12 PM yes Mathew Hillier 5:12 PM yes\ BerniCooper 1 5:12 PM yep Anna Verges 5:12 PM yes thansk Phil 5:13 PM Woohoo! Mathew Hillier 5:14 PM UQ uses Blackboard LMS. Geoff Crisp 5:14 PM systems that talk to each other - now that is useful! James Denholm-Price 1 #2 5:14 PM ;-) Phil 5:14 PM who'd have thunk it? Anne-Marie Scott (Edinburgh) 5:16 PM Crazy talk! m 5:16 PM neat Anne-Marie Scott (Edinburgh) 5:17 PM Now that is very neat! Wilma (Edinburgh) 5:18 PM O'm liking this a lot ;-} Geoff Crisp 5:18 PM sounds like you have actually built a system around academic practice rather than the usual computer programmer approach AP 5:18 PM love it Andrew Dekker 5:20 PM press refresh :) Phil 5:20 PM Great - it's a REAL demo!! Geoff Crisp 5:20 PM love live demos m 5:21 PM brilliant Geoff Crisp 5:22 PM where do I buy it! or do you give it away to make everyone's life better? Anne-Marie Scott (Edinburgh) 5:22 PM Ditto Geoff! Phil 5:23 PM All our work at CEIT is intended to be open source - Where that is an issue is the iPad app which we intende to be free but that you would get the compiled app. m 5:24 PM ;) Geoff Crisp 5:24 PM thanks Phil Wilma (Edinburgh) 5:24 PM I really like the workflow, more than the iPad App itself. Anne-Marie Scott (Edinburgh) 5:25 PM The workflow makes total sense Wilma - exactly what we see some of our staff struggling with now. mark wetton 5:25 PM The annotation satisies a few folks I know of Bronwen 5:25 PM having used turnitin I am so keen on the app Mathew Hillier 5:25 PM the annotations are exactly in-situ too so the context is not lost. Phil 5:25 PM :)tnx Wilma & Anne-Marie Wilma (Edinburgh) 5:26 PM When they change their minds is it tracked? m 5:27 PM (y) Phil 5:27 PM Wilma - yes, if you want to track that. Wilma (Edinburgh) 5:28 PM l guess tracking is only really important once marks and feedback have been sent in Geoff Crisp 5:28 PM if you clone Andrew you can make even more brilliant apps Andrew Dekker 5:28 PM thank you Geoff :) m 5:28 PM :D LJShaw 1 #2 5:29 PM How do you nmoderate marks across the group of markers? Phil 5:29 PM (Andrew is NOT available ;) He's brilliant and we're very fortunate. Andrew Dekker 5:29 PM yes, each time the marks are pushed to the server they are versioned so we can track if marks change later on Phil 5:29 PM yes Anne-Marie Scott (Edinburgh) 5:29 PM (Send him to Edinburgh and we'll do a Dolly the sheep on him) Phil 5:29 PM LOL A-M!! LJShaw 1 #2 5:29 PM But does that allow a comparison to ensure consistency Andrew Dekker 5:30 PM the moderation markup iPad app will show all marked submissions, and the moderator can choose which they moderate (sorted by tutor name) Phil 5:30 PM Yes LJ (the feedback is seen by the student through their browser - they don't need an iPad - only the markers use the iPad) 5:31 PM m 5:31 PM are students aware of that? Phil 5:31 PM yes - part of the ethics approval. m 5:31 PM that their interaction is trackable ok 5:31 PM mark wetton 5:33 PM Self regulation - the way to go for sure Kay 5:33 PM Love the idea of added a dashboard for the students...our next task :) mark wetton 5:35 PM How does the colour coded info work for equality and accessibility? Geoff Crisp 5:35 PM this information is really helpful for tutors and coordinators - staff need to know what is worth spending time on and this lets them know what was worth the time Phil 5:36 PM The null hypothesis was the don't look at feedback and we can stop giving it. This turned out not to be true. :) 5:36 PM Wilma (Edinburgh) 5:36 PM Did students need encouragement or support to access different feedback modes? Or did they just take to it easily? Andrew Dekker 5:37 PM mark - the colours are still a work in progress and not heavily tested (yet), but the differentiator is on colour shading so hopefully should be reasonably accessible Kay 5:38 PM students seemed to by very accepting of the different modalities - we are still analysing the finer detail of that Phil 5:39 PM (no point in looking at feedback when it's the last one they'll do, from their perspective). Wilma (Edinburgh) 5:39 PM Potential for good insights into the strategic student LJShaw 1 #2 5:40 PM But you said that the 370 inlcuded some just left open Geoff Crisp 5:41 PM analytics are great for stimulating conversations amongst the teaching team Phil 5:42 PM LJ - right - averages can be skewed by a few large values. We need to to follow up on a spot basis to ask what they were doing. in that way we'll be able to come up with a a better estimate of when to exclude the "outliers". m 5:44 PM takes time to change habits some are aware of their own voices 5:45 PM Mathew Hillier 5:47 PM is the poster avilable online for download? Kay 5:48 PM I'm happy to provide that if you want:) Geoff Crisp 5:48 PM when we did recorded audio feedback a couple of years ago it was interesting to analyse the content as tutors tended to start with something personal like the student's name and then something positive before saying what could be improved. This is not normally the pattern for written feedback Phil 5:49 PM Interesting Geoff. We have found the personalisation, using the student's name, elicits a strong positive reaction from the student m 5:50 PM similar as in real life - personalized Wilma (Edinburgh) 5:51 PM If you have time, I'd be interested to know how you handle special needs - e.g. visually or audio impaired students. Geoff Crisp 5:51 PM what was interesting was we didn't guide the tutors about what to say - they just naturally said the name and a positive comment. I posit it is because tutors treat the audio feedback as if they had the person in the room m 5:51 PM :) Mathew Hillier 5:53 PM some youtube videos are also avilable UQMarkUp Tutorial - upload submissions, mark, publish: http://youtu.be/ek5TTW8PK5U 5:53 PM Kay 5:53 PM onq lovely comment from a student was "i felt like i could go talk to the lecturer, because we'd already started the conversation" Mathew Hillier 5:53 PM UQMarkUp Tutorial - create course, assignment, rubric and teaching team: http://youtu.be/jzpqcQtUVgc UQMarkUp Tutorial – Analytics: http://youtu.be/BA17Z-Monek 5:54 PM Ross Titshall 5:54 PM Is it Mac only? Mathew Hillier 5:54 PM the marking App is ipad only at this time. Andrew Dekker 5:54 PM iPad only for the marking, web based for everything else m 5:54 PM :) Phil 5:54 PM (we hope to port this to Android in the future, if there is an interest in that) m 5:54 PM (y) Wilma (Edinburgh) 5:55 PM @Kay like that a lot - especially with such a large cohort Anna Verges 5:55 PM Very useful thanks! Phil 5:55 PM No worries - Kirsten! Well done! Bronwen 5:55 PM Thanks! V much m 5:55 PM excellent brilliant 5:55 PM Wilma (Edinburgh) 5:55 PM Many thanks Kirsten Anne-Marie Scott (Edinburgh) 5:55 PM Very useful and enjoyable. Andrew Dekker 5:55 PM fantastic :D Philip Uys 5:55 PM Thank you! mark wetton 5:55 PM Fantastic, lots of excitement at the prospect. AP 5:55 PM fantastic! James Denholm-Price 2 5:55 PM Great -- Android would be cool :-) LJShaw 1 #2 5:55 PM Excellent presentation Mike 5:55 PM thank you! very interesting Ross Titshall 5:55 PM great piece of development! Phil 5:55 PM Thanks to everyone from CEIT - we aim to make 'learning visible'! Mathew Hillier 5:56 PM very well done Kirsten!! Martin 5:56 PM Thanks! Look forward to using it LJShaw 1 #2 5:56 PM Will you develop marking to other than ipad? Wilma (Edinburgh) 5:56 PM WHat marker resistance did you meet? m 5:57 PM (y) mark wetton 5:57 PM Can you say anything about standards used for data/workflow integration...e.g. with your student record Kay 5:58 PM Use of the audio was initially daunting for some markers (myself included) but once you start, and realise how good it is - mcuh better takeup! mark wetton 6:00 PM Can you access/download the analytics data in a raw form to enable offline analysis? Andrew Dekker 6:01 PM yep we don't use XML, rather csv 6:01 PM mark wetton 6:01 PM OK thnaks Phil 6:01 PM We try to keep things simple ;) Andrew Dekker 6:02 PM but we integrate with the universities student system to pull a lot of data automatically mark wetton 6:03 PM I know people who love that stuff :) Anne-Marie Scott (Edinburgh) 6:03 PM Andrew: I assume that's a proprietary interface based on whatever student record you have. (Mark - that would be me!) 6:03 PM Phil 6:03 PM Andrew is writing the scripts to allow process the data so academics can get the core questions answered through the visualistation Anna Verges 6:04 PM Regardign audio feedback: are studetns able to download their audio feedback to keep it? At the moment Grademark does not allow studetns to download their mp3 files Andrew Dekker 6:04 PM its an open standard that the university uses called LDAP where we pull student records, most universities use it but they all use it differently (so there is some configuration) Anna - yes mp3 download as a zip package with the annotated PDF 6:05 PM Anne-Marie Scott (Edinburgh) 6:05 PM Thanks Andrew - makes total sense - we use LDAP in a similar way here. Anna Verges 6:05 PM lovely thanks Phil 6:05 PM Note Anna, this strips the context away as the zip file packages the audio as a set. m 6:06 PM are we moving towards prerecorded feedback at the click of a button? LJShaw 1 #2 6:06 PM Got to go but its been a great session. Thank you very much.:) Geoff Crisp 6:06 PM can we have john cleese do the prerecorded feedback!!! Wilma (Edinburgh) 6:07 PM Have to go now - thanks again for a really interesting session :) mark wetton 6:07 PM Thanks Kirsten you've done a great job with this. Phil 6:07 PM Yes - libraries of feedback is available (as Kirsten noted) m 6:07 PM thanks much Mathew Hillier 6:07 PM pls fill the survey if you have yet to do so! Anne-Marie Scott (Edinburgh) 6:07 PM Excellent webinar. Phil 6:07 PM Yay Kirsten m 6:07 PM :)very informative great work all cheers Martina AP 6:07 PM thank you so much Anna Verges 6:07 PM Thank you all James Denholm-Price 2 6:07 PM Thanks -- really good webinar :-) Andrew Dekker 6:08 PM thank you all, brilliant work Kirsten :) Phil 6:08 PM No worries Glenn #2 6:08 PM Thank you. I come in late. Are you planning to release your APP?? Phil 6:09 PM You'll have to follow up with them by email! Kay 6:09 PM well done, Kirsten! ;) Yep, that's fine with me 6:09 PM Phil 6:10 PM Glenn - we're looking at distirbution methods -the way we do that depends on whether we can get some support. With support we can design an installer for it. If we don't have $$ we'll create a tar file for the server side and try to find the time to make the iPad app Glenn #2 6:10 PM Thanks Phil James Denholm-Price 2 6:11 PM Thanks Phil -- that'd be my q too. Anne-Marie Scott (Edinburgh) 6:11 PM Thanks Phil. Anne-Marie Scott (Edinburgh) 6:13 PM Would love to see / hear more. Glenn #2 6:14 PM Have you talked to Blackboard, I reckon you could sell it into their BB learning analytics package. $$ Dom 6:14 PM Thanks everyone Andrew Dekker 6:14 PM thank you, great session Phil 6:14 PM cheers James Denholm-Price 2 6:14 PM Thanks - look fwd to publications :-) Great job . Anne-Marie Scott (Edinburgh) 6:14 PM Thanks all Geoff Crisp 6:14 PM Bye all Glenn #2 6:15 PM Thanks