Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Using the SAMR model to innovate assessment design
Similar to Using the SAMR model to innovate assessment design (20)
More from LearningandTeaching
More from LearningandTeaching (20)
Recently uploaded
Recently uploaded (20)
Using the SAMR model to innovate assessment design
- 1. Using the S.A.M.R model to innovate assessment design Gemma Clarke | Senior Academic Developer, Navitas Learning and Teaching Bronwyn Mortimer | Academic Coordinator - Language, Learning and Teaching, Curtin College
- 2. S.A.M.R. Image found here: https://www.schoology.com/blog/samr-model-practical-guide-edtech-integration
- 3. Presentations before S.A.M.R. TEACHING STAFF STUDENTS
- 6. Student Survey 1. When you first learned that you had to complete a group presentation for this unit, how did that make you feel? 2. Was this your first time to deliver a group presentation in English? 3. Did you or your group members watch your recorded presentation before submitting it to Moodle? 4. If you did view your presentation before submitting it, how many times did you view it before you were happy to submit it to Moodle? 5. Did you or your group members have any challenges (technology or others) when filming your presentations or uploading it to Moodle? 6. If you were giving a recommendation to a friend about the format you felt you learnt the most from, would you recommend this filmed approach or the live class audience format?
- 9. Impact on Learning Able to achieve learning that was not conceivable without the use of technology • Practice, practice, practice! • Language proficiency improved • Authentic peer feedback and learning • Genuine self reflection through the use of video play back • Work place skills using video to deliver presentations (Zoom, Skype, etc.) • Improved team engagement • Improved accountability between students
- 10. Teacher feedback • Recorded presentations allow for much more considered assessment and feedback. • I feel they provide more actual learning to the students who can address errors as they go. (Teacher 1) • It was a good idea to have a practice presentation in class where they could receive feedback before they were asked to film • Marking the videos allowed for more accuracy and reliability compared with live presentations (Teacher 2) I think the recording is a great idea. It allows the student to practise to get the presentation right. It provides scaffolding to the real thing-face to face presentation! (Teacher 3) I find both students and teachers benefit from the recording: • Students can hone their presentation skills prior to being assessed. • Students get to work on their pronunciation and delivery and feedback from group members allows students to improve lexical choice and the academic tone of the presentation. • It assists with moderation and standardisation of marking across teachers so students get consistent feedback. (Teacher 4) The benefits of a video presentation are clear in terms of student rehearsal and preparation as well as being able to reflect on their performance. (Teacher 5)
- 11. Impact on Teaching • Aids moderation and standardisation of marking • Evidence of practice • Used in teaching to model to students examples of presentations skills • Time efficient for teachers in terms of marking • Allows much more quality and in depth marking • More considered feedback from teachers
- 12. Challenges Students • Underestimating how many takes they would do before submitting • students not scheduling enough time for their recording and having to reschedule • students not showing up Staff • Overly innovative • Not comfortable not being at the centre of the whole process • Moving from an teacher centred approach to student centred • Clarity of process particularly in relation to student responsibility and then staff accessing the recordings LMS • Moodle file size • Submission box upload too slow • Uploading incorrect file format Equipment • Venues: Difficult to book classrooms due to full timetable • Student classroom bookings not being honoured
- 13. Solutions Students • In class advice about time required to record • Student micro-advice videos (in development) Staff • Collecting data from student survey • Promoting the student voice • Sharing feedback from experienced teachers about the advantages of this innovative approach • Sharing the evidence LMS • Saved video files to student Google Drive • Students just post the G drive link to the Moodle submission box (much less bandwidth required) • Videos remain accessible as long as student does not delete it • Staff can still download the video and save to staff drive Equipment • Week 7 U/C sends room availability to all students • Have access to after hours usage (SafeZone app intalled)
- 14. 4 Going Forward Review OP Assessments Train Staff Implement Recorded OP Assessments
- 15. Questions Contact • Gemma.Clarke@navitas.com B.A., Grad. Dip. Ed., C.E.L.T.A., M.Ed. • Bronwyn.Mortimer@curtincollege.edu.au B.A., Grad. Dip Business (Marketing), C.E.L.T.A., Grad. Cert. TESOL, Cert. IV T.A.E.
- 16. References Puentedura, R. R. (2013, May 29). SAMR: Moving from enhancement to transformation [Blog post]. Retrieved from http://www.hippasus.com/rrpweblog/archives/000095.html
Editor's Notes
- (Gem) Welcome to our presentation where we will be sharing with you how we used SAMR to innovate student group oral presentations in a way that has significantly improved the student learning experience to such an extent that approximately 60% of students have identified this assessment model as being the one that provides better learning outcomes.
- (Gem) Dr. Ruben Puentedura’s S.A.M.R model informed our change in practice. The SAMR Model is a framework that categorizes four different degrees of technology integration into classroom practice. The letters "SAMR" stand for Substitution, Augmentation, Modification, and Redefinition. The model should not be viewed as a hierarchy where levels have higher value over each other, but rather as a spectrum of options for technology integration into teaching practice for improved learning outcomes for students. The use of technology in our project resulted in significant transformation of the assessment process, it redefined our assessment and enabled new learning and teaching experiences that were inconceivable previously. However, we must admit up front that the extent of the redefinition of the student learning was a surprise even to us and it was not what we set out to achieve when we looked at using to technology to innovate our group oral presentations.
- (Gem)To provide some context, we used to assess student oral presentations in week 12 of the trimester. Our classes are 4 hours in length, so every student attended class in week 12 and had to sit through all their classmates presentations. The teacher graded the presentations in real time, completed the marking rubric for each team and individually for each student and then in the last 45 minutes provided whole of class feedback and the formal completed rubrics. We used this model because we wanted to ensure that students benefitted from hearing the whole of class feedback and to ensure they had a chance to engage with teacher and their team in reviewing and discussing their feedback so that it was a learning process. However, in reality it was a terrible way to end the trimester. Every one was tired by week 12 including the teachers! The students are not really interested in listening to their peers, their minds on their upcoming exams or they are rehearsing their own speech in their heads. Teachers are trying to multi-task under serious time constraints to provide meaningful feedback by the end of the class and by the time the class ends everyone is running for the door to escape! It’s not the ideal way to end the trimester. In terms of a positive student experience this was not working!
- (Bron)In trying to improve this assessment that we realised was flawed in design and delivery, we looked to technology. But, we wanted the technology to be something that was already familiar to students, something they knew how to use intuitively. We did not want the technology being an additional barrier or another hurdle that students had to learn in order to complete the assessment. The focus was still very much on learning to deliver a proficient group presentation not how to use technology. The assessment outcomes remained the same - we looked to technology to help us achieve them in a more student and teaching friendly manner. We were not interested in changing our assessment outcomes to fit the technology. The technology needed to be the enabler. We chose mobile phones as the technology that students would use to film their presentations because every single student has a mobile phone and most of them are already well versed in using the filming tool on it. And because students were working in groups, even if one student did not have a phone we could reasonably assume that someone else in the group would have one.
- (Bron) In redefining the assessment the students would film their group presentation in one continuous stream. Originally we had them save the file to a USB and submit the USB – however, there were often issues with corrupt files and USBs not working. So we changed this to use another form of technology that has real world application – Google Drive. Students now post their video file to their Google drive accounts (all College students have Google accounts because their College email is a Google enabled account). One member of the group would then get the shareable link from their Google drive and post it into the assignment submission link in Moodle for the unit. Instructions on how to do this is included in the unit outline/assessment guide which is provided to every student via Moodle in week 1. The image here shows you the instructions and assignment requirements that are provided to students. In 2018, we decided to survey all the students in the unit to get a sense of how they felt about this innovation to the assessment. We had already collected very favorable feedback from all teachers, our in class student feedback was positive and the quality of the presentations students were submitting were much better quality. We therefore felt positive that this innovation was working well. However, we wanted to ensure that we formally captured the student perspective to ensure we were keeping the student learning at the center of our assessment approach. Therefore, we asked students for two consecutive trimesters to complete a quick survey to find out what they thought of the assessment and also whether they felt this format improved their learning.
- (Gem) We surveyed a total of 205 students over two consecutive trimesters, we gathered 101 student responses, meaning 49% of our student engaged with the survey. We asked 6 questions in our survey. The results from the survey that were most significant were answers to question 4 and 6. ___________________________________________________ Additional data, in case you get any questions about numbers: Tri 3, 2018 - there were 86 students enrolled in ACS. (39 student responses out of cohort total of 86= 45%) Tri 2, 2018 - there were 119. (We got 62 responses out of the cohort total=52% participated in the survey) Total = 205 possible students, 101 responses= 49% participation
- (Gem) What is important to note here is that over 50% of students said that they viewed and then reshot their entire presentation more than 2 times. With a third of respondents saying they did more than 3 complete deliveries before they submitted. This was a significant amount more practice and reflection than we as teachers saw evidenced in live class presentations, where we often heard from student groups afterwards that in truth they had not managed to get together to practice their presentation other than on the day of delivery. By changing the assessment format so that students were able to record and view their presentations, it enabled them to self reflect. It also enabled them to provide feedback to their peers in a way that was not possible with a live class presentation. It also enabled them to see and hear for the first time what they really sounded and looked like to the audience listening to their presentations. Students then used this feedback information to redo their presentations. This kind of self reflection and ownership for learning was something that was not happening in the traditional live presentation delivery format.
- (Gem) What we can see here is that students overwhelmingly support the filmed approach, with three quarters of the student cohort favoring it by trimester 3. Keeping in mind that students ended up doing a lot more work in terms of practicing their presentations, having to provide peer to peer feedback and having to take on board their own self reflection with very little input from teachers in order to be able to deliver their assessment.
- (Bron) This change in assessment format has had significant positive benefits for student learning. (listed on the slide) It has also resulted in students improving their language proficiency because they are practicing their presentations significantly more than they would with normal live in class presentations. This is particularly important at the College where between 50-70% of our cohort are EAL speakers. Students are engaged in authentic peer feedback and genuine self reflection because they can now replay their presentation and really hear what they sound like and what they look like in their delivery. Something that was never possible before. And, all this learning is student driven, student centered and student focused. In terms of work place skills, being able to deliver a presentation via video is a valuable current skill where companies are working in a globally connected world where being able to present professionally via live stream is essential. Also, in reality in most work situations you have some time to prepare key presentations, and so allowing our students to record and play back and review and re-record their presentations is an authentic experience. We are also aware that once these students move into the second part of their diploma they will all be involved in traditional face to face presentations so will all have had the opportunity to engage in both before starting second year at Curtin university.
- Bron
- (Bron)
- Bron
- Bron
- (Bron)
- (Gem)