ESTP courses: "Evaluation'

ESTP courses: "Evaluation'

European Statistical Training Programme: Evaluation" Intro-Beginners and Advanced Courses On Seasonal Adjustment 2008-2012 Prepared by Adriano di Guglielmo Unit B1 Quality Methodology and Research, Eurostat. European Statistical Training Programme: The purpose of the European Statistical Training Programme (ESTP) is to provide European statisticians the opportunity to participate in international training courses, workshops and seminars at postgraduate level. The programme is coordinated by Eurostat. Courses are delivered either at Eurostat premises in Luxembourg or in national training sites of EU and European Free Trade Association (EFTA) countries. It is tailored to meet the specific needs of the European Statistical System (ESS) by taking into account the different levels of statistical knowledge and working experiences. It comprises courses in Official Statistics, IT applications, Research and Development and Statistical Management. More info here "ESTP - Customer Satisfaction" by Adriano di Guglielmo 2 Analysis of Customer Satisfaction: Studying the questionnaires on evaluation, proposed at the end of each course, we are going to verify our attendants satisfaction. With this descriptive analysis will be possible to understand where to take action to improve the service offered.

"ESTP - Customer Satisfaction" by Adriano di Guglielmo On the other hand, our data are not collected in such a way as to make a more in depth analysis (such as MCA or PLS PM). Therefore it would be useful to know all the sequence answers of each user and also a series of illustrative variables of them (the users) useful to describe the differents interviewees profiles, whitout invading any privacy. 3 Questionnaires Structure: Topics Expectations New Concepts/ Methods/ Techniques Deepening methods/techniques Programme Course content Course Work Overall evaluation of the course Final Evaluation Theoretical practical

Training methods & training support SA/Demetra+ Combination of methods Materials Quality Actives Trainers Presentations Length Pace Logistics Course administration Course organisation "ESTP - Customer Satisfaction" by Adriano di Guglielmo Support provided 4 BEGINNERS COURSES Number of attendants, number of applicants Who are the course leaders, who are the trainers, who are the attendants? Questionnaires outcomes Time Series evaluation scores "ESTP - Customer Satisfaction" by Adriano di Guglielmo Number of Attendants 2006 2012 Beginners Intro - Beginners 35

30 7 25 20 18 0 0 7 0 14 N of Not Accepted Invitation N of Accepted Invitation 15 21 20 22 22 17 15 14 10 5 0 2006 2007 2008 2009 "ESTP - Customer Satisfaction" by Adriano di Guglielmo

2010 2011 2012 6 Beginners Courses 2009-2012 2009 2010 2011 2012 Course Leader G. L. Mazzi; C.Calizzani G. L. Mazzi; C.Calizzani D. Buono D. Buono Trainers D. Buono; A. Maravall; B. Monsell; D. Ladiray D. Ladiray E. Infante D. Buono E. Infante D. Buono 22/29 17/24

14/28 15/33 Duration Days 4 4 3 3 Duration Hours - 27 15 15 Duration Breaks 1h 1h 2h 2h - 6h 45min 5h 5h Attendants/ applicants Daily Average

"ESTP - Customer Satisfaction" by Adriano di Guglielmo 7 To be noticed that: Countries with largest number of presences: Germany (7), Czech Republic (6), Greece (6), Sweden (6), Italy (6), Romania (6), Slovenia (6), Slovakia (6). Countries that are never present: Macedonia, France, Liechtenstein, Switzerland. Last presence more than 4 years ago: Estonia, Denmark, Latvia, Luxembourg, Hungary. General balance between students from old* and new** EU countries *Old EU countries = Join EU before 2004 **New EU countries = Join EU after 2004 + EFTA countries "ESTP - Customer Satisfaction" by Adriano di Guglielmo 8 Analysis of all variables - Beginners 2009 Satisfaction 2009 16 Agree S. 14 Agree 12 10 8 6 4 2 0

"ESTP - Customer Satisfaction" by Adriano di Guglielmo Neutral Disagree Disagree S. No response 9 Analysis of all variables - Beginners 2010 Satisfaction 2010 12 Agree S. 10 Agree 8 Neutral 6 Disagree 4 2 0 "ESTP - Customer Satisfaction" by Adriano di Guglielmo Disagree S. No response 10 Analysis of all variables - Beginners 2011 Beginners Satisfaction 2011 12 10

Agree S. 8 Agree 6 Neutral 4 Disagree 2 0 The duration of the course decreases (3 day 5h per day) The evaluation scores increase "ESTP - Customer Satisfaction" by Adriano di Guglielmo 11 Analysis of all variables - Beginners 2012 Satisfaction 2012 16 14 12 Agree S. 10 Agree 8 Neutral 6 4 Disagree

2 0 The duration of the course decreases (3 day 5h per day) The evaluation scores increase "ESTP - Customer Satisfaction" by Adriano di Guglielmo 12 Final Evaluation Beginners Agree Vs Disagree - Beginners 100% 0% 90% 23% 0% 0% 22% 80% 70% 22% 60% Disagree 100% 50% 40% 100% Agree 77%

30% Neutral 56% 20% 10% 0% C O U N T R I E 2009 2010 2011 2012 12 old EU 10 new EU 9 old EU 8 new EU 6 old EU 7 new EU 9 old EU 4 new EU S "ESTP - Customer Satisfaction" by Adriano di Guglielmo

17 ADVANCED COURSES Number of attendants, number of applicants Who are the course leaders, who are the trainers, who are the attendants? Questionnaires outcomes Time Series evaluation scores "ESTP - Customer Satisfaction" by Adriano di Guglielmo Number of Attendants 2008 2012 Advanced Courses Advanced 35 30 25 8 8 19 20 15 N of Not Accepted Invitation 20 21 0 0 N of Accepted Invitation 16 10 14 15

2011 2012 5 0 2008 2009 2010 "ESTP - Customer Satisfaction" by Adriano di Guglielmo 19 Advanced Courses 2008-2011 2008 2009 2010 2011 G. L. Mazzi, C.Calizzani C.Calizzani G.L. Mazzi, J.M. Museux D. Buono D. Findley; R. Kirchner A. Maravall; B. Monsell R. Kirchner; A. Maravall; T. Mc Elroy D. Findley D. Buono A. Maravall

R. Kirchner; D. Buono; K. Attal-Toubert; A. Kocak; J. Palate 20/28 21/29 16/16 14/33 Duration Days 4 5 4 3 Duration Hours 24h 30min 32h 26h 15 Duration Breaks 1h 1h 1h 2h More than 6h Less then 6h 30min

6h 30min 5h Course Leader Trainers Attendants/ applicants Daily Average "ESTP - Customer Satisfaction" by Adriano di Guglielmo 20 To be noticed that: Countries with largest number of presences (4): Turkey, Portugal, Slovenia, Romania, United Kingdom. Countries that are never present: Cyprus, Czech republic, Macedonia, France, Liechtenstein. In the next advanced course of 2012 there will be also a Mexican attendant. It is strange that attendants from Czech Republic are very interested only in the beginners courses. General balance between students from old and new EU countries "ESTP - Customer Satisfaction" by Adriano di Guglielmo 21 N ics /e xp ec ta tio

C ns ou co rs nc e/ ep w D or ts ee Pr /m k og pe et ra nd ho m ds in m g /te e m c et h ni ho qu ds es / te ch ni qu es SA /D em

et ra + Le ng th Th eo re Pa C om tic ce al bi /p na r ac tio tic n al of m e th M od at er s ia ls Q Ac ua ti v lit es y Tr ai ne Pr

rs es en ta tio ns C Lo ou gi rs st e ic or s ga ni Su sa t io pp n or tp ro Fi vid na ed lE va lu at io n ew To p Analysis of all variables - Advanced Course - 2008 Satisfaction 2008 16 Agree

S. 14 12 Agree 10 8 6 4 "ESTP - Customer Satisfaction" by Adriano di Guglielmo Neutral Disagree 2 Disagree S. 0 No response 22 Analysis of all variables - Advanced Course - 2009 Satisfaction 2009 16 14 Agree S. 12 Agree 10 8 6 Neutral

Disagree 4 2 Disagree S. 0 No response "ESTP - Customer Satisfaction" by Adriano di Guglielmo 23 Analysis of all variables - Advanced Course - 2010 Satisfaction 2010 14 12 Agree S. Agree 10 8 6 4 2 0 "ESTP - Customer Satisfaction" by Adriano di Guglielmo Neutral Disagree Disagree S. No response 24 Analysis of all variables - Advanced Course - 2011 Satisfaction 2011 12 Agree

S. 10 Agree 8 Neutral 6 Disagree 4 Disagree S. 2 No response 0 The duration of the course decreases (3 day 5h per day) The evaluation scores increase "ESTP - Customer Satisfaction" by Adriano di Guglielmo 25 Final Evaluation - Advanced Agree Vs Disagree - Advanced 100% 10% 90% 16% 7% 7% 80% 70% 60%

Disagree 50% 40% Neutral 90% 84% 93% 93% 2008 2009 2010 2011 10 old EU 10 new EU 13 old EU 7 new EU 5 old EU 10 new EU 7 old EU 6 new EU Agree 30% 20% 10% 0% C O U

N T R I E S "ESTP - Customer Satisfaction" by Adriano di Guglielmo 30 Findings (Beginners) As shown in the previous slides, we find extremely positive results for most of beginners courses (years 2009/2011/2012). On the other hand, the course of 2010 wasnt able to fully satisfy the course participants: it seems to be crucial for the debacle of this course, the poor satisfaction shown for the training methods and training support where more of the half of interviewees (51%) didnt show satisfaction (Neutral, Disagree, Disagree Strongly). More critical aspects involve the questions: Theoretical and practical training was combined in an appropriate way and The combination of methods (lectures, presentations, group work, discussions, exercises, etc.) was appropriate. The course of 2012 (73% of Agree Strongly) results the best ever with a peak of 93% of Agree Strongly in the Course Administration category. No neutral or negative scores in the final evaluation of the years 2011/2012. Balance between students from old and new EU countries. "ESTP - Customer Satisfaction" by Adriano di Guglielmo

38 Findings (advanced) The analysis performed on the advanced courses shows satisfactory evaluation scores. As for the beginners courses, 2010 is the year in which the satisfaction of the advanced course reaches its minimum point (47%) in terms of Agree Strongly, even if it doesnt hit the negative peak of the corresponding beginners course (47% vs. 11% respectively). To be noticed that the advanced course of 2009 reaches the 63% of Agree Strongly and that the question: The course was relevant to my job and will help me in my current and/ or future work collected 74% of Agree Strongly. On the other hand, when comparing the scores (Agree vs. Disagree), it can be noticed that the general satisfaction lies around a common threshold for the four years under consideration, with peaks in the years 2010 and 2011. No negative scores in the final evaluation of all the years considered. Balance between students from old and new EU countries. "ESTP - Customer Satisfaction" by Adriano di Guglielmo 39

Recently Viewed Presentations

  • Photographs of West Virginia Outcrops by County Marion

    Photographs of West Virginia Outcrops by County Marion

    Quadrangle: Fairmont East. Location Info: Valley Falls State Park. Rock Formation(s): Pennsylvanian Conoquesnessing Sandstone (Pottsville) Strike/Dip (in degrees): Horizontal, but dip of crossbedding is about 20. Comments: View shows side and top of crossbedding in sandstone that is partly conglomeratic....
  • Chapter 1 Structure and Bonding - faculty.swosu.edu

    Chapter 1 Structure and Bonding - faculty.swosu.edu

    Addition of a salt containing the conjugate base (acid) to a solution of a weak acid (base) decreases its ionization Example: A solution of 1.0 M HF and 1.0 M NaF HF H+ + F- Ka = 7.2 x 10-4...
  • La qualité de vie chez l'enfant

    La qualité de vie chez l'enfant

    * Implications cliniques Un outil de troisième vague Fontaine et Fontaine, 2006 Un travail thérapeutique sur L'état avec les thérapies comportementales Le but avec les thérapies cognitives L'écart provoqué par la distance entre l'état et le but avec les thérapies...
  • Pfiesteria piscicida - The University of Arizona

    Pfiesteria piscicida - The University of Arizona

    Pfiesteria piscicida Monster or merely misunderstood By: Erica Hudson Discovery Pfiesteria piscicida was first discovered at North Carolina State University where it was blamed for a large fish kill in 1988 (Miller and Belas 2003).
  • Essay unit: week two Wednesday, Thursday, and Friday

    Essay unit: week two Wednesday, Thursday, and Friday

    If you had to write a rap or song which form of punctuation would you write your song about? Pass the ball: Review game ... Friday's test will cover these three areas: the circulatory, the digestive, and the nervous system....
  • La reiterazione della domanda di protezione internazionale alla

    La reiterazione della domanda di protezione internazionale alla

    Vestanet. Notifica di un provvedimento di allontanamento " Domanda reiterata in fase di esecuzione di un provvedimento di allontanamento ": "1. Nel caso in cui lo straniero abbia presentato . una prima domanda reiterata . nella fase di esecuzione di...
  • Twenty-First Century Psychotherapies

    Twenty-First Century Psychotherapies

    History of Psychoanalytic Psychotherapy Sigmund Freud and his contributions The structure and process of the unconscious Key role of early childhood experiences in shaping personality Creation of a distinctive methodology for psychological treatment of mental disorders The recognition that the...
  • Using Context Clues - Valencia

    Using Context Clues - Valencia

    Using Context Clues to Determine Definitions Ways to Figure Out the Meaning (when you can't use a dictionary): pages 12 to 15 in 10 Steps to Advanced Reading * The concept of the ecological niche is almost inseparable from the...