Developing a Rubric for Assessment

Developing a Rubric for Assessment

Developing a Rubric for Assessment Office of Assessment University of Nebraska at Kearney What is a rubric? A systematic scoring guideline to evaluate students performance (papers, speeches, problem solutions, portfolios, cases) through the use of a detailed description of performance levels. Used

to get consistent scores across all students. Allows students to be more aware of the expectations for performance and consequently improve their performance. http://www.utexas.edu/academic/mec/research/pdf/rubricshandout.pdf Why do we use rubrics for assessment? A rubric is a flexible tool that can be used to measure student learning related specifically to a departments

objectives. Because rubrics provide descriptions of each score level, it is easier for different faculty to use a rubric to grade consistently across students. Rubric Characteristics For assessment purposes, we usually want to develop a rubric that: allows us to directly evaluate performance on program level student learning outcomes. is general enough that it can be used for different assignments (e.g. papers may be collected from different courses/faculty). is understood and agreed upon by faculty

who will be using the rubric. Step 1 in developing a rubric 1. Clearly define the assignment. What is the student expected to produce? What are the common expectations across instructors? Step 2 in developing a Rubric 2. Consider what student learning outcomes will be assessed. Often with a culminating project, students are expected to demonstrate several of the department/program outcomes. For example, for a senior seminar paper,

outcomes related to writing and critical thinking may be assessed, as well and more discipline-specific outcomes. Step 3 in developing a Rubric 3. Determine the key criteria that you are interested in-- for example, for the senior seminar paper, what aspects of writing will be assessed? Coherence Organization

Mechanics Step 4 in developing a Rubric 4. Clearly define those key criteria. What do you mean by organization? What does organized writing look like? Step 5 in developing a Rubric 5. Establish clear and detailed descriptors for each performance level for each criteria Determine what the different levels of performance look like within each criteria

Use sample papers of high, mid and low performers to help It is usually easiest to begin by describing the highest level of performance Using specific language for the descriptors of performance levels increases the chances that multiple faculty members will apply the rubric in a similar manner. Step 6 in developing a Rubric 6. Try out the rubric on a few students with several raters to see if the rubric works and gets consistent scoring from multiple raters. Scales vs. Rubrics Below

Expectatio n Citations Meets Expectatio n X Exceeds Expectatio n Scales vs. Rubrics Citations

Below Expectatio n Meets Expectatio n Exceeds Expectatio n The paper fails to cite sources using a consistent, formal, citation

style Most follow a consistent style, although some contain minor errors or incomplete information All citations are complete, accurate, and consistently conform to a formal style

Initial Assessment Scale Criteria Poor Marginal Fair Good Excellent Introduction: Adequate literature review; sound rationale; clear statement of hypothesis/hypotheses 1

2 3 4 5 Method: Appropriate for hypothesis/hypotheses; adequate descriptions of participants, design, materials, and procedure. 1 2

3 4 5 Results: Appropriate use of statistics; adequate description of analyses 1 2 3 4

5 Discussion: Clear evaluation of hypothesis/hypotheses; connect to literature review/theory/ appropriate discussion of limitations, implications, and recommendations 1 2 3

4 5 Poster Style and Format: Well-organized; visually appealing, appropriate information density; readable font size and graphics; effective use of figures and illustrations 1 2 3 4

5 Improved Rubric Using Rubrics Train evaluators Sample work should be scored Discuss scores and reach agreement More than on evaluator should score papers If two evaluators disagree a third decides Frequent disagreements on an item indicate the item needs to be revised or removed Practice Select a rubric that is currently being used

in your department: Is it a rubric or a scale? Are there multiple descriptions of the criteria (at least 3)? Are the descriptions clear and easy to use? Will other faculty agree on the descriptors? Practice Rewrite the selected rubric to ensure it has multiple descriptors of the criteria (is not a scale), clear descriptors, and ratings that can be agreed upon by other faculty. Look at samples at: http:www.web.virginia.edu/iaas/assessm

ent/assessrubrics.htm Where to start Developing a rubric from scratch can be challenging. Get ideas by looking at what others have done Lots of sample rubrics for many disciplines at: http://www.winona.edu/air/rubrics.htm Online tool for developing rubric (with more samples): Rubistar for Teachers: http://rubistar.4teachers.org/index.php Online module for using the Rubistar at: http://www.vcu.edu/cte/resources/videos/Rubistar_tut orial/index.html Sources

http://www.winona.edu/air/ resourcelinks/rubric_sampler.pdf (document of rubric development long) http://www.utexas.edu/academic/mec/ research/pdf/rubricshandout.pdf - good description of rubrics with focus on general analytic rubrics for the purpose of assessment

Recently Viewed Presentations

  • Mega MANIAc AWARDS April, 2016 6th grade RESPECT

    Mega MANIAc AWARDS April, 2016 6th grade RESPECT

    6th Grade. Excellence -Always Doing Your Best. Johan Abreu. Zachary Aldrich. Yahir Alvarado-Lopez. Tanner . Caragay. Rishabh. Chandel. Smilee. Chunduru. Breanna ...
  • Prevention of Sepsis  Handwashing  Skin preparation  Tissue Handling

    Prevention of Sepsis Handwashing Skin preparation Tissue Handling

    Surgical Drains Indications: Prevent accumulation of fluid Blood Pus Infected fluids Prevent accumulation of air/gas Characterise fluid Surgical Drains Types: Open Simple (corrugated tubes or sheets) Can increase the risk of infection in non-infected cases Closed Reduce the risk of...
  • Why Conceptual modeling? - IDEALS

    Why Conceptual modeling? - IDEALS

    Why Conceptual Modeling? A Case Study of A11y First Text Editor. Lightning Talk: Library Research Showcase 2016. JaEun Ku, PhD. This presentation reports how conceptual modeling can be used in building a text editor in order to ensure accessibility in...
  • Chapter 19 - Acids, Bases, and Salts - Henry County School ...

    Chapter 19 - Acids, Bases, and Salts - Henry County School ...

    A titration is the use of a buret to add a measured amount of a known acid (or base) to a measured amount of an unknown base (or acid) until neutralization is achieved. The equivalence point of a titration is...
  • CSE 114 - Computer Science I Lecture 1: Introduction

    CSE 114 - Computer Science I Lecture 1: Introduction

    CSE 381 - Advanced Game Programming Collision Detection Combining our Algorithms Sweep and Prune will tell us if a collision might happen Continuous collision detection will tell us when it happens it might also tell us S & P gave...
  • Unit 2: Law Enforcement - Mr. Westwater's History Class

    Unit 2: Law Enforcement - Mr. Westwater's History Class

    Miranda vs. AZ (1966) Miranda Rights. You have the right to remain silent. 2. If you give up that right, anything you say can and will be used against you in a court of law.
  • Lighting and Wiring Fundamentals - Cengage

    Lighting and Wiring Fundamentals - Cengage

    Lighting and Wiring Fundamentals ... Dimmer switch Changes headlights from low to high beam Automatic headlight dimmer Detects oncoming cars Courtesy lights Interior dome and underdash lights Headlight wiring Many use grounded electrical systems Daytime running lights: powered when engine...
  • Contract Law, Tort and Intellectual Property

    Contract Law, Tort and Intellectual Property

    Contract Law, Tort andIntellectual Property. Douglas Wilhelm Harder, ... Law: Charter of Rights and Freedoms, contracts, torts, negligent malpractice, forms of carrying on business. Intellectual property (patents, trade marks, copyrights and industrial designs) ... Causing unintentional harm to ...