【正文】
? Interview ? Focus Group ? Phone survey 9 Level One: Reaction Questionnaire: scales ? Excellent Well Fair Poor ? Excellent Very Good Good Fair Poor ? Strongly Agree Disagree 7 6 5 4 3 2 1 ? High Low 10 9 8 7 6 5 4 3 2 1 10 Level One: Reaction Advantages ? Easy to execute ? Participants are free ? Some relationship to on job performance Issues ? Purely subjective – Halo effect (smile sheet) – Horn effect – Central tendency ? Time pressure 11 Level One: Reaction Tip 1: highlight purpose, solicit cooperation ? To determine the degree that the seminar met your needs, we would like you to give us your honest opinion… ? To make our future sessions as meaningful as possible, we would appreciate your candid evaluation of this program. ? Your ments will be used to improve future offerings of this seminar. 12 Level One: Reaction Tip 2: Encourage ments – Comments are more accurate than scores Tip 3: Set up baseline scores – Historical data – Benchmarking data – Pilot group data (Formative evaluation) Tip 4: Combine questionnaires, interviews, focus groups Tip 5: instant feedback for multi subject courses 13 Level Two: Learning How to evaluate? ? Test ? Demonstration ? Presentation ? Discussion ? Role Play 14 Level Two: Learning Advantages ? Pressure to participants ? Pressure to trainer ? Fir