GUEST SPEAKER SERIES 2010-2011 Increasing students satisfaction with their learning experience: addressing issues raised by the National Student Survey Phil Race BSc PhD PGCE FCIPD SFHEA NTF Emeritus Professor Leeds Metropolitan University www.phil-race.co.uk Name labels Please write your first name, big and bold, on a coded sticky label, and
stick it to your clothing (not onto a fabric which would be damaged). A3 Phil Every student comes with a free person Im a person, not a number www.phil-race.co.uk Getting to know students Asking
students to write their names on labels helps them to get to know each other, and helps us to know what they want to be called. When they feel theyre known to us as individuals (in a good way), theyre less likely to drop out especially in big groups in HE. Labels are cheap and environmentallyfriendly. The codes can be used to get students into different group configurations, or to quiz the whole class. This slide has three main purposes. To focus the data projector, when necessary, and Annoy all the folk near the
back, and... ...to persuade colleagues never to put this sort of detail onto a slide! www.phil-race.co.uk About Phil Born a Geordie First a musician Then a writer
Then a scientist Then a researcher Then a lecturer and warden Got interested in how students learn
And now retired! (1995, 2009) Working with students on learning techniques And lecturers on teaching and assessment strategies
And trainers on training design Currently Emeritus Prof: Leeds Met And the effects assessment and feedback Travelling around as usual! have on them Based at Newcastle and And how we teach them
And on trains Gradually became an And an expert educational developer And still a Geordie. Leeds on train routes and timetables! Whats an Emeritus Professor? Someone really old? Someone who has not been sacked for gross moral turpitude? Someone whos still on the books, but not on the payroll? Or perhaps as in edentate, the e signifies
without. www.phil-race.co.uk Welcome to this session There is a terrific range of experience of higher education in this room lets bring our thinking together to find creative solutions to the problems we face in trying to achieve student satisfaction. www.phil-race.co.uk Thanks to students I could not do what I do nowadays if I did not continue to spend a fair bit of my time working with students theyve
taught me most of what I know. www.phil-race.co.uk Represented today... The Centre for Medical Education, History Nursing and Midwifery (7 registered),
Computer Science Management (3), Geography Centre for Vision and Vascular Science, Graduate Studies
Architecture, Union Theological College SPACE (School Office), English,
Marketing, Recruitment & Admissions Pharmacy, Educational and Skills Development Biological Sciences (IAFLU),
Mechanical & Aerospace Engineering, Graduate Studies, Music and Sonic Arts (2 from School Office), AISHE reps (open to AISHE members as event included in AISHE regional seminar series) from Dublin City University, National College of Art & Design and Dundalk Institute of
Technology. University of Ulster Psychology (2), Sociology, Social Policy and Social Work Not (known, but not shared) www.phil-race.co.uk
You will be able to download my main slides You dont need to take notes. But of course do feel free to make notes of anything you think of your own thoughts, questions, issues and so on. Ill put the main slides I use today up on my website before the day is out. So sometimes Ill go fast. www.phil-race.co.uk Context In the UK, feedback is gathered nationally from
final year students by the National Student Survey (NSS), introduced in 2005, and implemented between January and March each year. There has also been discussion of the development of such a survey in the Republic of Ireland. The NSS looks at teaching, assessment and feedback, academic support, organisation and management of teaching, learning resources and students personal development. www.phil-race.co.uk Today ... In this workshop, we address head-on together how we can go about increasing student satisfaction in the context of the Survey, in particular in the
area of assessment and feedback which students across the sector have consistently rated as the least satisfactory aspect of their experience in higher education. www.phil-race.co.uk Questions to be addressed 1. What can I do in my teaching to increase my students satisfaction with their learning? 2. How can I ensure that students increased satisfaction will show from their evaluation responses? Colleagues across the sector in Ireland, both south and north, may gain some useful ideas which will help not only to improve their students experience, but also to
improve how students express their views about that experience. www.phil-race.co.uk Intended learning outcomes By the end of this interactive session, you should be better-able to 1. Identify, and address some of the principal causes of student dissatisfaction. 2. Work systematically towards improving the quality of the student experience of higher education. 3. Learn from what the gurus tell us about assessment and feedback, and respond to this particularly important aspect of student satisfaction.
Post-it introductory task On a post-it, in your best handwriting, please write your own short completion of: my students would be much more satisfied with their experience of higher education if only I Please swap post-its until you dont know whose you have. If asked, read out with passion and drama whats on the post-it you now have. www.phil-race.co.uk Using post-its to find out students real intended learning
outcomes February 14, 2020 18 Post-its A small, equal opportunities, non-threatening space. Just about everyone is willing to jot something down on a post-it in answer to a question, whereas they may not offer a spoken answer to a question, or write responses on a blank sheet of paper. Post-its allow everyone the same opportunity to respond, including the
quiet or shy students. Post-its can be swapped, and students can read out someone elses ideas, in the relative comfort of anonymity. Finding out where a group is starting from Post-its are particularly useful for openended questions, such as economics would be much better for me if only I Responses can be posted on a flipchart or wall, and used as an exhibit. They can be photocopied and returned to students. Post-its can be a fast way of finding out what the real intended learning outcomes
are for a group. They can also provide a measure of the learning incomes of the group. Face-to-face communication Making all the channels work Friday 14 February 2020 21 Face-to-face one-to-one feedback activity Please work in pairs, moving around the room, talking to different people using the script which follows The script: A
Hello. B Hello. A You are late. B I know. Try to do it completely differently each time. Friday 14 February 2020
Teaching smarter (Phil Race) 22 The power of face-to-face communication When explaining assessment criteria to students, and when linking these to evidence of achievement of the intended learning outcomes, we need to make the most of face-to-face whole group contexts and,,, Tone of voice Body language Facial expression Eye contact The chance to repeat things The chance to respond to puzzled looks
Some things cant work nearly so well just on paper or on screens. Friday 14 February 2020 Teaching smarter (Phil Race) 23 Finding out how were doing seeking and using feedback from students Phil Race Visiting Professor: Assessment, Learning and Teaching, Leeds Metropolitan University Friday 14 February 2020 www.phil-race.co.uk
www.phil-race.co.uk Rationale Questionnaires are perhaps the most common way of finding out what students think about our teaching but probably the least effective way, as we only get responses to the questions we happen to include. Theres no facial expression, tone of voice, eye contact nor all the rest of normal human communication. Its worth continuing to think of other ways of getting and using feedback from students, and share our collective experience regarding what students have told us www.phil-race.co.uk
Some limitations of questionnaires Ticky-box syndrome Performing dogs syndrome Lost learning opportunities WYSIWYG syndrome Blue, rosy and purple questionnaires Conditioned response questionnaires Death by questionnaire www.phil-race.co.uk Feedback and assessment Weve moved from... Assessment of learning, To assessment for learning, and Towards assessment as learning. Perhaps we need to be thinking of how
we can get feedback from students with the feedback as learning for them? www.phil-race.co.uk Student feedback some questions How can we develop student ownership? Are we getting the right feedback? Can we make giving feedback a learning experience in itself? How will we give students the results (and benefits) from their feedback? www.phil-race.co.uk Nine ways of gathering
feedback... 1. Interviews with individual students. 2. Feedback activities with groups of students. 3. Solicited feedback from large groups, e.g. stop, start, continue. 4. Questionnaires. 5. 6. 7. 8. 9. Student representation. Informally, through tutorials, seminars, etc. Students summative performance. Students coursework performance. External observers, moderators, examiners, peerobservation, etc. www.phil-race.co.uk
Feedback and evaluation My personal view: evaluation takes five years and after five years of the National Student Survey we can begin to evaluate what its telling us. All we can get from our students is feedback on their experiences (I never use evaluation forms). We can, however, use the feedback as part of our ongoing evaluation of the student experience. www.phil-race.co.uk What Im wondering... Whether it might help to get feedback relating to the seven factors underpinning successful student
learning... www.phil-race.co.uk Teaching Ripples on a pond. Assessing Wanting/ Needing Doing Making sense Feedback www.phil-race.co.uk e.g. What could we learn
from... 1. Feedback from students on their want to learn, and how we enhance it? 2. Feedback from students on their degree of ownership of the need to learn, as defined by our intended learning outcomes? 3. Feedback from students on what we get them to do practice, trial and error, repetition, and so on? 4. Feedback from students on how well they make sense of what theyre learning, and what we do to help them get their heads round things? Doing www.phil-race.co.uk What more can we learn from students about
5. How well our feedback to them helps them what works best, and what doesnt work? 6. How much they learn from coaching each other, explaining things to each other, and teaching each other? 7. How much they deepen their learning by making informed judgements about their own learning, and each others learning? www.phil-race.co.uk Useful sources Knight, P and Yorke, M (2003) Assessment, learning and employability Maidenhead, UK SRHE/Open University Press. Bowl, M (2003) Non-traditional entrants to higher education they talk about people like me Stoke on Trent, UK, Trentham Books.
Gibbs, G (2010) Using assessment to support student learning Leeds: Leeds Met Press. Boud, D and Associates (2010) Assessment 2020: seven propositions for assessment reform in higher education Sydney: Australian Learning and Teaching Council. Joughin, G (2010) A short guide to oral assessment Leeds: Leeds Met Press. Gordon Stobart (2008) Testing Times uses and abuses of assessment London: Routledge. My stuff Race P (2010) Making learning happen: 2nd edition London: Sage Publications: this edition has frequent links to the statements used in the UK National Student Survey, including what we can do to increase satisfaction. Race, P and Pickford, R (2007) Making teaching Work London: Sage Publications: this is the source material from which the handout has been adapted.
Race, P (2007) How to get a good degree: 2nd edition Maidenhead: Open University Press: this may help you to see how students think about their experience of higher education. Individual task What bugs students? Jot down on separate post-its, three things which you consider causes student dissatisfaction. In clusters as youre sitting, diamondnine these things, working out what bugs students most, 2nd-most, 3rd-most and so on. www.phil-race.co.uk Diamond-9 of things that bug students
worst 1 2 3 4 5 7 6 8 9 Less bad
Your top dissatisfaction items... Quality of teaching concepts not explained... Poor preparation of teaching, poor commitment. Slow, or no feedback Lack of communication/connection between lecturer and student Internal information systems! Not treating students with respect... www.phil-race.co.uk More... Over assessment Too many assessments at one time Untimeliness of feedback
Irrelevant modules Poor quality learning materials Lack of availability of materials Poor organisation Students feeling that they have to work too hard www.phil-race.co.uk Albert Einstein It is simply madness to keep doing the same thing, and expect different results www.phil-race.co.uk The UK National Student Survey 2005-10 22 statements: several of which are poorly crafted. The design of this particular survey if far from ideal, but its
use right across the higher education sector in the UK makes it an important indicator of at least some of students feelings about their higher education experience. Students are asked to make judgments as follows: definitely agree mostly agree neither agree nor disagree mostly disagree definitely disagree Not applicable www.phil-race.co.uk The main areas The teaching on my course Assessment and feedback Academic support Organisation and management
Learning resources Personal development And finally... Catch 22. Overall, I am satisfied with the quality of this course. www.phil-race.co.uk The teaching on my course 1. Staff are good at explaining things. 2. Staff have made the subject interesting.
3. Staff are enthusiastic about what they are teaching. 4. The course is intellectually stimulating. www.phil-race.co.uk Assessment and feedback 5. The criteria used in marking have been clear in advance. 6.
Assessment arrangements and marking have been fair. 7. Feedback on my work has been prompt. 8. I have received detailed comments on my work. 9. Feedback on my work has helped me clarify things I did not understand. www.phil-race.co.uk
Academic support 10. I have received sufficient advice and support with my studies. 11. I have been able to contact staff when I needed to. 12. Good advice was available when I needed to make study choices. www.phil-race.co.uk Organisation and management 13. The timetable works efficiently as far as my activities are concerned. 14. Any changes in the course or teaching have been communicated effectively.
15. The course is well organised and is running smoothly. www.phil-race.co.uk Learning resources 16. The library resources and services are good enough for my needs. 17. I have been able to access general IT resources when I needed to. 18.
I have been able to access specialised equipment, facilities, or rooms when I needed to. www.phil-race.co.uk Personal development 19. The course has helped me to present myself with confidence. 20. My communication skills have improved. 21. As a result of the course, I feel confident in tackling unfamiliar problems. And... 22. Overall, I am satisfied with the quality of this course. www.phil-race.co.uk
Fishing for feedback? Feedback is like fish. If it is not used quickly, it becomes useless. (Sally Brown). Give a man a fish, Makehim feedback timely, while it Feed for a day. still matters to students, in time Teach a man to itfish, for them to use towards
further learning, or to receive Feed him for a lifetime. further assistance. (Chinese proverb). (Graham Gibbs) www.phil-race.co.uk The ten most important words But you have to remember this bit I dont give away the 10th word in case it
leaks out to where Im going next. www.phil-race.co.uk Context Assessment and feedback take up a great deal of our time and energy and also a great deal of students' time and energy. Yet it can be argued that assessment and feedback are broken in higher education nowadays. They take too much of our time and we dont always measure the right things. www.phil-race.co.uk We desperately need to make assessment work better In the UK, we know from the National
Student Survey that since 2005 the evidence suggests that students nationally find assessment among the least satisfactory elements of their experience of higher education. We also know that assessment take up ever more of our time and energy. www.phil-race.co.uk Making exams fun what else can we do? 1. Read out the instructions to candidates rather differently! 2. Include a silly question (just for one mark). 3. Give the senior invigilator a brick. 4. Ask for a volunteer candidate to
accompany the invigilator to the toilet? www.phil-race.co.uk Assessment is broken in higher education Student numbers have grown: we cant use the same processes and instruments for a system where getting on for 50% of the 1830 year old population study in postcompulsory education, compared to 5% a couple of decades ago. The world has opened up, so that our assessment processes and practices need to be more compatible with those in quite different cultures and traditions. www.phil-race.co.uk And more...
It is widely accepted now that assessment is the major driver for student learning, and if assessment is not working as a good driver for learning, the effectiveness of our entire higher education provision is jeopardised. We need to continue to diversify the assessment processes and instruments we use, so that no students are repeatedly disadvantaged by the predominance of particular assessment formats. www.phil-race.co.uk In short, We assess far too much, Using the same old ways far too often, Assessment takes far too much of our time and far too much time of our
students. And we drive down the quality of learning by our assessment. www.phil-race.co.uk And whats wrong with feedback? Students get it too late. And too often, its just words on paper. It doesnt help them enough. They often dont take enough notice of it. www.phil-race.co.uk But whats really wrong with feedback?
Its one-way monologic. What students want is dialogue. They want to talk to us about their work. But theyre scared to talk to us, for various reasons: In case it leads to lower marks; In case theyre found out; In case they feel stupid. www.phil-race.co.uk What the gurus tell us on assessment, feedback and learning Towards making learning happen better, using smarter assessment and feedback
www.phil-race.co.uk Sally Brown, 2009 Concentrating on giving students detailed and developmental formative feedback is the single most useful thing we can do for our students, particularly those who have had a struggle to achieve entry to higher education. Assessment and feedback are two of the best tools available to us, to support student achievement, progression and retention. www.phil-race.co.uk With the changing economy, no one has lifetime employment, but community colleges provide lifetime employability. President Barack Obama
www.phil-race.co.uk Gibbs, 2010: tactics to improve student learning 1. Capture student time and effort, distributing that effort appropriately across topics and weeks. 2. Generate high-quality learning effort, oriented towards clear and high standards. 3. Provide sufficient feedback, often enough, and in enough detail. 4. Focus feedback on students performance, on actions under their control, rather than on students themselves or their characteristics. Gibbs, 2010: tactics to improve student learning 5. Make feedback timely, while it still matters to
students, in time for them to use it towards further learning, or to receive further assistance. 6. Link feedback to what students believe they are supposed to be doing. 7. Ensure that feedback is not only received, but is attended to, so that students act on it to change their future learning and performance. www.phil-race.co.uk Smarter assessment Coaching, and feedback: explaining, teaching we need to use them to:
Assessin Ripples on a pond. 1. Strive to enhance our students want to learn; g 2. Help students to develop ownership of the need making to learn; informed judgements practice, trial- 3.
Keep students learn by doing, and-error, repetition; 4. Ensure students get quick and useful feedback Wanting/ from us and from each other; 5. 6. 7. Needing Help students to make sense of what they
learn. Dointheir learning by Get students deepening coaching other students, g explaining things to Making them. sense Allow students toFeedback further deepen their learning by assessing theirwww.phil-race.co.uk own learning, and assessing Life is too short to Spend time and energy writing feedback which wont actually be used by students (sometimes
not even collected by them); Write feedback just for external examiners to see. Approach giving feedback only in the read-write dimension, when many students gain more from it through auditory, or visual, or kinaesthetic channels. (see Neil Flemings excellent (and free!) VARK work on www.vark-learn.com). www.phil-race.co.uk The read-write problem Higher education has become a read-write industry! Yet only since 1791 have we been using written exams and written feedback. Feedback on paper is probably the most timewasting, least effective and most dangerous way to give students feedback.
There is still a lot going for oral assessment and feedback see Joughin 2010. www.phil-race.co.uk Boud et al 2010: Assessment 2020 Assessment has most effect when...: 1. It is used to engage students in learning that is productive. 2. Feedback is used to actively improve student learning. 3. Students and teachers become responsible partners in learning and assessment. 4. Students are inducted into the assessment practices and cultures of higher education. 5. Assessment for learning is placed at the centre of subject and program design. 6. Assessment for learning is a focus for staff and institutional development.
7. Assessment provides inclusive and trustworthy representation of student achievement. www.phil-race.co.uk Boud et al, 2010 David Boud (University of Technology, Sydney), Royce Sadler (Griffith University), Gordon Joughin (University of Wollongong), Richard James (University of Melbourne), Mark Freeman (University of Sydney), Sally Kift (Queensland University of Technology), Filip Dochy (University of Leuven), Dai Hounsell (University of Edinburgh), Margaret Price (Oxford Brookes University), Tom Angelo (La Trobe University), Angela Brew (Macquarie University), Ian Cameron (University of Queensland), Denise Chalmers (University of Western Australia), Paul Hager (University of Technology, Sydney), Kerri-Lee Harris (University of Melbourne), Claire Hughes (University of Queensland), Peter Hutchings (Australian Learning and Teaching Council), Kerri-Lee Krause (Griffith University), Duncan Nulty (Griffith University), Ron Oliver (Edith Cowan University), Jon Yorke (Curtin University), Iouri Belski (RMIT University), Ben Bradley (Charles Sturt University), Simone Buzwell (Swinburne University of Technology), Stuart Campbell (University of Western Sydney), Philip Candy (University of Southern Queensland), Peter Cherry (Central
Queensland University), Rick Cummings (Murdoch University), Anne Cummins (Australian Catholic University), Elizabeth Deane (Australian National University), Marcia Devlin (Deakin University), Christine Ewan (Australian Learning and Teaching Council), Paul Gadek (James Cook University), Susan Hamilton (University of Queensland), Margaret Hicks (University of South Australia), Marnie Hughes-Warrington (Monash University), Gail Huon (University of Newcastle), Margot Kearns (University of Notre Dame, Sydney), Don Maconachie (University of the Sunshine Coast), Vi McLean (Queensland University of Technology,) Raoul Mortley (Bond University), Kylie OBrien (Victoria University), Gary ODonovan (University of Tasmania), Beverley Oliver (Curtin University), Simon Pyke (University of Adelaide), Heather Smigiel (Flinders University), Janet Taylor (Southern Cross University), Keith Trigwell (University of Sydney), Neil Trivett (University of Ballarat), Graham Webb (University of New England). David Nicol et al... Nicol, D J feedback and Macfarlane-Dick:
Good practice: Formative assessment and selfregulated learning: A model and seven principles of good feedback 1. Helps clarify what good performance is (goals, criteria, practice. Studiesstandards); in Higher Education (2006), Vol 31(2), 199-218 expected
2. Facilitates the development of self-assessment (reflection) in learning; 3. Delivers high quality information to students about their learning; 4. Encourages teacher and peer dialogue around learning; 5. Encourages positive motivational beliefs and self-esteem; 6. Provides opportunities to close the gap between current and desired performance; 7. Provides information to teachers that can be used to help shape the teaching. www.phil-race.co.uk The guru Royce Sadler The indispensable conditions for improvement are that the student comes to hold a concept of quality roughly similar to that held by the teacher, is able to monitor continuously the quality of what is being
produced during the act of production itself, and has a repertoire of alternative moves or strategies from which to draw at any given point. In other words, students have to be able to judge the quality of what they are producing and be able to regulate what they are doing during the doing of it. (Sadler 1989), my italics) www.phil-race.co.uk Royce Sadler... ...is the most cited author on formative feedback, writing about it since the mid-1980s. He is doing his absolute best work now. Sadler, D R (2009) Indeterminacy in the use of preset criteria for assessment and grading Assessment and Evaluation in Higher Education
34:2 159-179 Sadler, D R (2009) Grade integrity and the representation of academic achievement Studies in Higher Education, 34:7, 807-826 Sadler, D R (2007) Perils in the meticulous specification of goals and assessment criteria Studies in Higher Education I34:7 807-26. Sadler, D R (2005) Interpretations of criteria-based assessment and grading in higher education Assessment and Evaluation in Higher Education 30 175-194.
Sadler, D R (2002) Ah! ... So thats Quality In Schartz, P and Webb, G (eds) Assessment Case Studies: experience and practice from higher education London, Kogan Page. www.phil-race.co.uk The Weston Manor Group 2007 ASKe: Assessment Manifesto for Change Professor Trudy Banta, Dr Simon Barrie, Professor Sally Brown, Cordelia Bryan, Dr Colin Bryson, Jude Carroll, Professor Sue Clegg, Professor Linda Drew, Professor Graham Gibbs, Dr Karen Handley, Professor Anton Havnes, Dr Mary Lea, Dr Janet Macdonald, Professor Ranald Macdonald, Dr Debra Macfarlane, Dr Susan Martin, Professor Marcia Mentkowski, Dr Stephen
Merry, Professor David Nicol, Professor Andy Northedge, Professor Lin Norton, Berry ODonovan, Dr Thomas Olsson, Dr Susan Orr, Dr Paul Orsmond, Professor Margaret Price, Professor Phil Race, Clive Robertson, Dr Mark Russell, Dr Chris Rust, Professor Gilly Salmon, Professor Kay Sambell, Professor Brenda Smith, Professor Stephen Swithenby, Professor Mantz Yorke. www.phil-race.co.uk The Weston Manor Group: Assessment Standards: a Manifesto for change 1. The debate on standards needs to focus on how high standards of learning can be achieved through assessment. This requires a greater emphasis on assessment for learning rather than assessment of
learning. 2. When it comes to the assessment of learning, we need to move beyond systems focused on marks and grades towards the valid assessment of the achievement of intended programme outcomes. www.phil-race.co.uk The Weston Manor Group: Assessment Standards: a Manifesto for change 3. Limits to the extent that standards can be articulated explicitly must be recognised since ever more detailed specificity and striving for reliability, all too frequently, diminish the learning experience and threaten its validity. There are important benefits of higher education which
are not amenable either to the precise specification of standards or to objective assessment. 4. Assessment standards are socially constructed so there must be a greater emphasis on assessment and feedback processes that actively engage both staff and students in dialogue about standards. It is when learners share an understanding of academic and professional standards in an atmosphere of mutual trust that learning works best. Friday 14 Febr uary 2020 www.phil-race.co.uk The Weston Manor Group: Assessment Standards: a Manifesto for change
5. Active engagement with assessment standards needs to be an integral and seamless part of course design and the learning process in order to allow students to develop their own, internalised conceptions of standards, and to monitor and supervise their own learning. 6. Assessment is largely dependent upon professional judgement, and confidence in such judgement requires the establishment of appropriate forums for the development and sharing of standards within and between disciplinary and professional communities. Friday 14 Febr uary 2020 www.phil-race.co.uk
Assessment Reform Group 2002 Testing, motivation and learning Professor Paul Black Kings College, London Professor Patricia Broadfoot University of Bristol Professor Richard Daugherty University of Wales, Aberystwyth Professor John Gardner Queens University, Belfast Professor Wynne Harlen University of Bristol Dr Mary James University of Cambridge Dr Gordon Stobart Institute of Education, London Professor Dylan Wiliam Kings College, London www.phil-race.co.uk Assessment Reform Group 2002 Do more of this ... Provide choice and help pupils to take responsibility for their learning.
Discuss with pupils the purpose of their learning and provide feedback that will help the learning process. Encourage pupils to judge their work by how much they have learned and by the progress they have made. Help pupils to understand the criteria by which their learning is assessed and to assess their own work.
Develop pupils understanding of the goals of their work in terms of what they are learning; provide feedback to pupils in relation to these goals. Help pupils to understand where they are in relation to learning goals and how to make further progress. Give feedback that enables pupils to know the next steps and how to succeed in taking them. Encourage pupils to value effort and a wide range of attainments.
Encourage collaboration among pupils and a positive view of each others attainments. Assessment Reform Group 2002 Do less of this ... Define the curriculum in terms of what is in the tests to the detriment of what is not tested. Give frequent drill and practice for test taking. Teach how to answer specific test questions.
Allow pupils to judge their work in terms of scores or grades. Allow test anxiety to impair some pupils performance (particularly girls and lower performing pupils). Use tests and assessment to tell students where they are in relation to others. Give feedback relating to pupils capabilities, implying a fixed view of
each pupils potential. Compare pupils grades and allow pupils to compare grades, giving status on the basis of test achievement only. Emphasise competition for marks or grades among pupils. www.phil-race.co.uk What else can we do? In groups as directed, please think creatively, out of the box about how else we can act to cause our students to feel greater satisfaction about selected
items on the National Student Survey. Compose short, sharp recommendations for action, carefully, and write them on separate post-its, containing the statement number(s) addressed most directly. www.phil-race.co.uk Homework Ill put the best five recommendations I receive by 1200 on Monday 25th October as a separate file in the same post as this on my website. www.phil-race.co.uk Fishing for feedback? Feedback is like fish.
If it is not used quickly, it becomes useless. (Sally Brown). Give a man a fish, Makehim feedback timely, while it Feed for a day. still matters to students, in time Teach a man to itfish, for them to use towards further learning,
or to receive Feed him for a lifetime. further assistance. (Chinese proverb). (Graham Gibbs) www.phil-race.co.uk How to get feedback to a large group of students within 24 hours There are serious reservations about written feedback, but we can make even
this work much better than it did. The next two slides are about a way of giving students feedback on their work within 24 hours of them doing it. There are three or more yes, butss with this idea, but please hold these for around four minutes. www.phil-race.co.uk Set the hand-in time to be at a whole-group session E.g. next Tuesdays 10-11 lecture, Deadline = 1003. Let them pile up all their work at the front. At 1003, issue a coloured sheet, containing numbered points (so you can
say in feedback please see point 3, blue sheet and so on). www.phil-race.co.uk The blue sheet can contain.... Illustration of what is expected as evidence of achievement of each of the intended learning outcomes Likely mistakes Features of a good answer Frequently needed explanations Let the students study this for 3 minutes until 1006 it goes rather quiet! www.phil-race.co.uk At 1006...
Go into face-to-face oral mode, until 1009.... Spend a few minutes de-briefing the whole group and talking them through one point on the handout adding tone-of-voice, facial expression, body language, emphasis, and so on to the feedback. www.phil-race.co.uk The rationale... Since many students will have done the work in the last 24 hours before handing it in, youre giving them feedback while they still remember what they were doing. They know what they didnt do.
They know what they missed out because they couldnt understand it. www.phil-race.co.uk Now take away their work to mark in a third of the time it used to take you! You waste far less writing the same old things on one piece of work after another, regarding frequently occurring mistakes; You can make your comments relate more to each individual piece of work; This means when students get their marked work back with feedback, they are more likely to use it, as its personal to them.
www.phil-race.co.uk Furthermore... When they get their marked work back, theyve already had the chance to make sense of their own piece of work in the light of the generic feedback you gave them when they handed it in, and the additional oral deepening of one important point. www.phil-race.co.uk Back to our intended learning Do you now feel outcomes better able to... (two hands = much better, one hand = somewhat
better, no hands = no better) 1. Identify, and address some of the principal causes of student dissatisfaction? 2. Work systematically towards improving the quality of the student experience of higher education? 3. Learn from what the gurus tell us about assessment and feedback, and respond to this particularly important aspect of student satisfaction? www.phil-race.co.uk Action planning statements One thing Im going to do is One idea Im taking away is Im going to think more about I have found out that
Id like to know In future, Im not going to Friday 14 February 2020 Thank you www.phil-race.co.uk e-mail: [email protected]