Marla A. Franco Scott J. Duncan Michele M. Willingham Program - - PowerPoint PPT Presentation
Marla A. Franco Scott J. Duncan Michele M. Willingham Program - - PowerPoint PPT Presentation
Marla A. Franco Scott J. Duncan Michele M. Willingham Program Outline Back to Basics Why, What and How to Assess Writing Clear, Measurable Learning Outcomes Next Steps How to Analyze and Interpret Results Tips for Presenting Results Lots
Program Outline
Back to Basics Why, What and How to Assess Writing Clear, Measurable Learning Outcomes Next Steps How to Analyze and Interpret Results Tips for Presenting Results Lots of Hands On Practice!
2
Michele
Today’s Learning Outcomes
Participants who actively engage in this training session will be able to:
Write learning outcomes that contain all the
required elements.
Recall at least 3 questions to ask themselves
when analyzing assessment results.
3
Marla
Why, What and How
Explain what we do and how it makes a difference in ways that people who are not us can understand and remember (Keeling & Associates, 2008) Operational Effectiveness – what happened? utilization, efficiency, quality, satisfaction Mission Effectiveness – what changed? how are students different?
Michele
4
Not Just Another Assignment!
Before Collecting Any Data… Design an Overall Assessment Plan Tools
Assessment Planning Matrix Assessment Planning Template
Scott
5
Student Learning Outcomes
Desired qualities, capacities, abilities of students at the completion of a single learning activity
- r after multiple learning experiences.
What any student should be able to do, know, or value as a result of engaging in a learning experience (Keeling & Associates, 2008)
Michele
6
Constructing Outcomes
Audience = Who? Behavior = Observable Change, Action Verbs Condition = Setting/Situation, Influencing Variables, and Tools, Resources or Aids Degree = Level of Achievement A Audience B Behavior C Condition D Degree
7
Michele
Constructing Outcomes
8
Marla
Measuring Outcomes
9
Scott
Surveys Observations Interviews and Focus Groups Reflective Essays and Portfolios Content Analysis and Rubrics
More Details on Assessment Methods
Practice, Practice, Practice… 30 minutes
10
Marla & Michele
Questions to Ask Yourself
What does this data tell me? What trends do I see? What patterns emerge? What do these results mean in relation to… us,
- ur department, our processes, this program,
future programs?
Now that we know this, what will we… change,
do differently, do more of, stop doing?
Who else would/should care about these results? What would/should the results mean to them? How can we best communicate that?
11
Scott
Tips for Presenting Results
Just the facts, Jack! Avoid using the word “significant” to describe
your results unless you’ve run tests that show statistical significance.
Never under-estimate the value of a good
Executive Summary
Sample Reports and Booklet on “Researchese”
12
Scott
13
Michele & Marla
Practice, Practice, Practice… 30 minutes
14
Scott