Field Guide to Living a Data-Rich Life Webinar 2: Logic ...

Field Guide to Living a Data-Rich Life Webinar 2: Logic ...

Field Guide to Living a Data-Rich Life Webinar 12: Evaluating Systems and Collaborations Hosted by Durhams Partnership for Children, with support from the North Carolina Partnership for Children Presented by Compass Evaluation and Research Compass Evaluation and Research Field Guide to Living a DataRich Life Overview

What do we mean by systems and collaborations? Planning out an evaluation Mixed methods approaches Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life What is a System? Ecologically: a community and its natural environment Many inter-dependent organisms and niches Social: actors able to produce actions and outcomes, specific to environments

Many inter-dependent actors and needs Early Childhood: resources and services designed to strengthen and support the social, physical, and learning needs of young children Many inter-dependent actors, resources, and services Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life System Frameworks Presents systems concepts What are the important components and processes? Can form foundation of a Theory of Change and Logic

Model Can be helpful for developing and implementing an evaluation Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Sample System Framework: BUILD model Evaluating Systems and Collaborations

Compass Evaluation and Research Field Guide to Living a DataRich Life Sample System Framework: Bronfenbrenner s Ecological Model Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life

Sample System Framework : Collective Impact Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Systems.1 Identify the systems needs Resources Type of resources Primary: people and direct services

Secondary: transportation, translation support Scope of resources Are resources sufficient to the need? Ask: do we need a different type of program or do we have the programs we need, just not enough of them? Policy Rules, laws, and guidance Processes Who receives what from whom?

What is the flow of resources and interactions? Awareness Supply Demand Sensitivity Evaluating Systems and Collaborations Ask: do our clients want to <> and if so, do they have access to change agents or services?

Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Systems.2 What will it take to build the system? People Do you need a champion? Investment Awareness and Information How long will it take to build? What factors can help or hinder progress? Public and political approval Evaluating Systems and Collaborations

Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Systems.3 Construct your theory of how the systems work will proceed Who will be involved? How often? What is step 1, step 2, step 3? What kind of short-term, intermediate, and long-term

changes can be expected? Example: Coffman Framework for Evaluating Systems Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Coffman Framework for Evaluating Systems Initiatives Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life

Evaluating Systems.4 Collect your data Developmental Progress and theory of change is uncertain Formative Inform systems progress as it occurs Summative Identify whether or not systems change actually

is occurring Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Systems.5 Development al approach Focus on relationships and innovation Exploring, Creating,

Emerging Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life What is the role of collaboration? Is collaboration the goal or the strategy? Goal: collaboration is the system element that is missing Establishing collaboration is the outcome Strategy: collaboration is the means for producing a desired outcome; the desired outcome reflects the system element that is missing

Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Example 1: Collaboration as the goal Two or more agencies are charged with collaborating to develop a county-level resource bank for distributing information, resources, and services Collaboration is the short-term outcome that is necessary for producing the resource bank Evaluating Systems and Collaborations

Compass Evaluation and Research Field Guide to Living a DataRich Life Example 2: Collaboration as the strategy Two or more agencies want to improve access to preventive health services across the county and in doing so, increase the proportion of children receiving preventive care and screenings Collaboration is the strategy agencies use to reduce duplication of services and neighborhoods served Also can be considered a very short-term outcome Evaluating Systems and Collaborations

Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Collaboration Model 1: Nature of collaboration Networks, coalitions, partnerships, co-funders, collective impact Model 2: Collaboration process Himmelmans Partnership Quotient Model 3: Nature of collaborative relationships Wilder Collaboration Factors Inventory Evaluating Systems and Collaborations

Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Collaboration.2 What are the collaboration needs? Is it a goal or a strategy? What model or models of collaboration are in play? What is the theory of change? Who will be involved? How often?

What is step 1, step 2, step 3? What kind of short-term, intermediate, and long-term changes can be expected? Is there a formal process or plan to develop or maintain collaboration? Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Collaboration.3 Collect your data Developmental approach What does collaboration look like? What should it look like? Is it happening yet? Why or why not? Who should be involved?

Formative approach Is collaboration proceeding as planned? How can we improve our approach to ensure we achieve collaboration? How can we provide helpful feedback to staff? Summative approach To what extent is collaboration occurring? What does collaboration produce? Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Systems and

Collaborations Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Systems and Collaborations Mixed methods approaches Numbers and stories will be important What numbers tell you that systems are improving? That collaboration is

progressing? What stories inform the how and why of systems and collaboration work? Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Evaluating Systems and Collaborations Evaluating Systems and Collaborations Compass Evaluation and Research

Field Guide to Living a DataRich Life Evaluating Systems and Collaborations Spend time planning: Sequential or concurrent design Concurrent when limited timeframe for data collection If sequential: qualitative or quantitative first? Results from one

can inform the other Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Questions? Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Additional questions? Taylor Webber-Fields

Durhams Partnership for Children Phone: 919-403-6960 Email: [email protected] Evaluating Systems and Collaborations Compass Evaluation and Research Field Guide to Living a DataRich Life Additional questions? Feel free to contact me, too! Sarah Heinemeier Compass Evaluation and Research Phone: 919-308-5019 Email: [email protected]

Evaluating Systems and Collaborations

Recently Viewed Presentations

  • INEG 3413 Engineering Economic Analysis Fall 2004

    INEG 3413 Engineering Economic Analysis Fall 2004

    Chapter 2 Time Value of Money (TVOM) Example 2.38 Wenfeng Li borrowed $1,000 and paid off the loan in 4.5 years with a single lump sum payment of $1,500.
  • mCLASS®:Reading 3D™ Mondo

    mCLASS®:Reading 3D™ Mondo

    WR is intended for students with TRC instructional reading levels A/1 to E/8. At the present time, there are no Benchmark goals for WR. Research is ongoing to establish goals for this measure. The current guideline is to give appropriate...
  •  2019 American Association for the Study of Liver

    2019 American Association for the Study of Liver

    The following people have nothing to disclose: Huikuan Chu, Yi Duan, Sonja Lang, Lu Jiang, Ana Cristina Llorente Izquierdo, Francisco J. Bosques, Ling Yang, Peter Stärkel Disclosure information not available at the time of publication: Yanhan Wang, Jinyuan Liu, Selene...
  • What Is Emergency management?

    What Is Emergency management?

    emergency management process. Emergency management is a process. Mitigation. Preparedness. Response. Recovery. Emergency Management Process. Stated in another way, emergency management is the continuous process by which all individuals, agencies, and levels of government manage hazards in an effort to...
  • Slajd 1 - poig.2007-2013.gov.pl

    Slajd 1 - poig.2007-2013.gov.pl

    Instytut Innowacji Przemysłu Mleczarskiego Sp. z o.o. Pracownia bakteriologii i mikrobiologii Wykonywane badania - wybrane analizy: Salmonella - oznaczanie obecności i liczby- metoda klasyczna i real time PCR Listeria monocytogenes - oznaczanie obecności i liczby - metoda klasyczna i real...
  • Základy vědecké práce - Univerzita Karlova

    Základy vědecké práce - Univerzita Karlova

    Informační prameny Online zdroje Internet Vyhledávací nástroje internetu Sdružování dokumentů Snímek 35 Databáze Zásady práce s elektronickými informačními zdroji Jak najít, kde hledat Příklady možných zdrojů Science Citation Index (SCI) ISI Web of Knowledge ISI WoK - přístup Kde najdu...
  • Spreadsheet Charts - calhoun.k12.al.us

    Spreadsheet Charts - calhoun.k12.al.us

    Spreadsheet Charts Vocabulary Do not login. You will need a writing utensil. Reference - pp. IE123-IE127 in Office 2000 Textbook Chart Graphical representation of data contained in a worksheet An embedded chart is one on the spreadsheet itself A chart...
  • Chapter 3. Interpolation and Extrapolation Hui Pan, Yunfei

    Chapter 3. Interpolation and Extrapolation Hui Pan, Yunfei

    It first "hunts," either up or down, in increments of 1, then 2, then 4, etc., until the desired value is bracketed. It then bisects in the bracketed interval. hunt algorithm