Evidence-Based Practice: Evaluating our collections and services Clare

Evidence-Based Practice: Evaluating our collections and services Clare

Evidence-Based Practice: Evaluating our collections and services Clare Thorpe @thorpe_clare #2018ANZTLACONF CRICOS QLD 00244B | NSW 02225M TEQSA: PRV12081 EBP Whats in it for me? A short history of evidence-based practice in libraries and information services Build your own evidence-based practice backpack (including tips for solo practitioners)

Some real life examples My evidence-base practice story In the beginning Evidence-based medicine Evidence-based librarianship What is evidence-based practice? A structured process of collecting, interpreting and applying valid and reliable research and evidence to support decision-making and

continuous service improvement in professional practice. Doing and being Not just a one-off but: Questioning our practice Gathering or creating evidence (if we dont already have it) Using evidence wisely to make and inform decisions (especially about our value, impact or worth)

Other perspectives from research Evidence-based practice is: Not always straight-forward or linear (messy) Holistic Deliberate or unintended (serendipitous) Used immediately or filed away for future use Impacted by time, accessibility and the availability of evidence Highly contextualised and influenced by the librarians Stop - Think - Check Have you ever had to/wanted to? Defend your funding? Make a case for

funding? Defend your space? Understand how your space is used? Prove your return on investment, your value/impact? Understand your clients needs better? Evaluate your collection? Fill your evidence-based backpack A backpack full of stories, statistics and evaluations that can be used with authority and conviction is

required if advocacy is to be successful. Sources of evidence Research evidence/literature Books Journal articles Conference papers Profession al Knowledg e

Research Local Evidence Evidence Systematic reviews Benchmarks and standards (Koufogiannakis, 2011) Sources of evidence Local evidence Statistics Client feedback

Surveys & evaluation forms Profession al Knowledg e Research Local Evidence Evidence Policy and procedure documents Observations and anecdotal evidence

Budgets and staffing numbers (Koufogiannakis, 2011) Sources of evidence Professional knowledge Expertise Professional experience Tacit knowledge Profession al Knowledg

e Research Local Evidence Evidence Input from colleagues What other libraries do Intuition Non-research literature (blogs, commentaries, (Koufogiannakis, 2011) Putting it in practice

Interpret Apply Measure Communicate Interpret Strategic direction & goals Design outcome-driven services based on strategic priorities. Use evidence for

strategic purposes. (Grieves, 2017) The choice of methods (evidence) must be tied to the mission of each specific institution. (Tenopir, 2013) Apply Services, Collections, Spaces Build your service offer so as to generate bespoke evidence around the outcome and impact of engagement (Grieves, 2017) What do your services, collections and spaces tell you about your performance

and achievements? Measure Outcomes & Impact Measures and metrics are the means they are the process not the product. Measure plus meaning what does the evidence mean? Combine quantitative and qualitative data to form analytics and insights. (Grieves, 2017) Communicate Influence & Advocacy

Tell someone! Use your evidence to influence and advocate. Combine statistics with stories to craft and present meaningful narratives Quantitative data can show return on investment and trends. Qualitative data can tell a story or put a personal face on data. An example from real life SLQ INTERPRET From the Local Evidence, we identified that: Clients wanted space to study, often

for long periods of time Audience research High demand for quiet/silent study space Occupancy counts, Audience research, Client feedback High use of study spaces on Levels 2 and 3 where bags are permitted

Occupancy counts, Client feedback Low use of quiet study space on Level 4 where bags are restricted Occupancy counts An example from real life APPLY Reconfigure space on Level 4. MEASURE

Professional knowledge used to design a new service offering. This included library staff expertise in conservation and architects expertise in design. We measured the outcome and impact of the change, gathering Local evidence occupancy counts, client feedback and staff feedback.

Research evidence from literature used to support our funding application to show that our clients experiences were not unique. An example from real life COMMUNICATE for influence and advocacy We communicated the change and outcomes (Local evidence, Research evidence) to clients via website, social media,

feedback received; to staff via staff meetings, project acquittal report, feedback received to industry via conference presentations and journal articles Instagram post 25/7/2016 https://www.instagram.com/p/BIRBHW zh1is/? hl=en&taken-by=statelibraryqld Another example - SLQ Interpret Strategic need to evaluate and demonstrate the level of

service offered by Information Desk staff. Apply Team members collaborated to develop a Service Commitment which they would all commit to. Measure Peer observations used to measure performance against each element of the Service Charter across all Information Desks. Aggregated scores gave a measure of performance for the whole team. Communicate Findings were discussed with the team and shared with senior leaders. Gaps were identified for skills development. What goes into your backpack? What do you want to know? Use and apply what you have

Find/gather what you dont have What does it mean? Tell the right audience (or not) Information Services Mystery shoppers Client feedback Observations of clients, of staff Surveys and event

evaluations Statistics number of info desk queries, long and short term trends Focus groups, interviews, personas Chat transcripts (READ scores) Heuristics

Anecdotes/stories Print Collections Usage and holdings data borrowing and ILL statistics, stocktakes Return on investment evaluation item usage plus cost of housing the resource (current and future value) Large scale collection review consider importance, quality and coverage in terms of student and research success, institutional reputation, uniqueness Significance assessment for a single, group or cluster of items (uniqueness, rarity)

Electronic and Digital Collections Usage and non-usage (turnaway) data from vendors and discovery layers (COUNTER, JUSP) Duplication, currency (embargoes), accuracy and completeness Patron driven acquisition Search logs; webpage analytics

Vendor support and supply pricing models, access rights, trials, training (current and future states) Functionality, accessibility, ease of use Technical feasibility, integration with other tech, security, privacy Spaces and Facilities Observations Journey maps

Occupancy counts, seating surveys, gate counts, wi-fi heat maps Client feedback Focus groups, interviews Seating survey map of Springfield Library August 22, 2017 Stakeholder engagement One of your best sources of evidence is your stakeholders. Can be lightweight doesnt always have to in-depth UX

Develop a proactive approach that includes seeking, interpreting and using the input of faculty, students and community and that articulates the value of your Evidence from the Goldilocks experiment Working solo Pick one thing, start small, keep it local Read widely, think critically, actively reflect and share your adventures Find your tribe (people, tweeters)

Develop your skills and fill your backpack with a variety of evidence sources and stories No one can stop you being evidence based. (Lewis & Wilson 2015) A reminder of the why Being data driven creates a healthy service culture. Its not about how good we are. Its about, This is how good we are with our customers. Masud Khokhar, University of Lancaster, June 2018

What Im working on How can evidence-based practice become a whole of library experience? How can we measure the maturity of our library to determine if we are evidence-based? Research project: Towards a evidence-based practice maturity model for Australian academic libraries One step at a time An evidence based culture in your library can be the first of

many stepping stones to a sustainable future. (Bell et al, 2017) Spring Stepping Stones by Paul Downey is licensed under CC BY 2.0 Thank you Thorpe_clare @Thorpe_clare [email protected] CRICOS QLD 00244B | NSW 02225M TEQSA: PRV12081

Recently Viewed Presentations

  • Name: University of Santo Tomas College of Commerce

    Name: University of Santo Tomas College of Commerce

    Introductory Macroeconomic w/ Land Reform ECO 1A Introductory Microeconomics HRD 113 Strategic Human Resource Mgmt HRD 108 Labor Relations HRD 109 Conflict Mgmt & Negotiations COMP 2 Business SAD w/ Software Applications II COMP 1 Introduction to IS w/ Software...
  • Embedding Research Skills in the Pre-Honours Undergraduate Geography

    Embedding Research Skills in the Pre-Honours Undergraduate Geography

    Enquiry based learning can help to draw students into a community of practice, both within a discipline, within the curriculum and within the broader university, by providing a shared experience upon which students can draw (Garde-Hansen & Calvert, 2007).
  • www.1ppt.com


    IFM: RMB inter nationalization lost momentum. ... The quality of services shall be further improved in aspect of taxation, foreign exchange, insurance, customs, and information. Impose strict control over prohibited outbound investment projects.
  • Chapter 7 Section 3 Notes The Midwestern States

    Chapter 7 Section 3 Notes The Midwestern States

    Chapter 7 Section 3 Notes The Midwestern States ... The Chicago Mercantile Exchange is the world's busiest market for many farm products. The Chicago Board of Trade is the largest grain exchange. Industry, Resources, and Transportation The Midwest is home...
  • 5 El relativismo y la responsabilidad moral en los negocios ...

    5 El relativismo y la responsabilidad moral en los negocios ...

    6 El relativismo y la responsabilidad moral en los negocios globales 6 El relativismo y la responsabilidad moral en los negocios globales Los patrones éticos pueden variar entre países Distintas culturas tienen distintos códigos morales.
  • TerraNova 3rd Edition Pre-test Workshop - archchicago.org

    TerraNova 3rd Edition Pre-test Workshop - archchicago.org

  • Liquids and Solids - ctlsfasu

    Liquids and Solids - ctlsfasu

    volatile. The higher the vapor pressure, the easier it goes from a liquid to a gas. i.e. acetone has a high vapor pressure. As the temperature increases, the kinetic energy of the molecular motion becomes greater, and vapor pressure increases....
  • Populations - Vigo County School Corporation

    Populations - Vigo County School Corporation

    The reason you have this is because of the fact eventually there will be a winner and a loser. ... Green Tree Python - Australia. ... Characteristics of Populations. Geographic distribution - the area inhabited by a population.