Measuring the Effectiveness of Wisconsin Principals: Two Studies From the State- wide Evaluation of Educator Effectiveness
1
Measuring the Effectiveness of Wisconsin Principals: Two Studies - - PowerPoint PPT Presentation
Measuring the Effectiveness of Wisconsin Principals: Two Studies From the State- wide Evaluation of Educator Effectiveness Curtis Jones & Leon Gilman, University of Wisconsin Milwaukee Steve Kimball, University of Wisconsin Madison
1
2
3
4
2 1 1 1 1 1 1 2 2 1 1 5 16 42 30 55 44 63 21 73 19 9 42 28 29 38 27 21 19 10 23 11
277 256 236 227 201 229 207 216 201 267 185 236 266 223 217 254 243 265 227 256 282
40 50 42 65 65 48 50 83 47 34 126 42 26 69 63 37 57 37 85 43 29
Recruiting and Selecting Assignment of Teachers and Instructional Staff Observation and Performance Evaluation Professional Development and Learning Distributed Leadership Mission and Vision Student Achievement Focus Staff Collaboration School-wide Use of Data Student Learning Objectives (Teacher SLOs) Professionalism Time Management and Priority Setting Use of Feedback for Improvement Initiative and Persistence School Climate Communication Conflict Management and Resolution Consensus Building Learning Environment Management Financial Management Policy Management Human Resource Leadership Instructional Leadership Personal Behavior Intentional and Collaborative School Culture School Management
Principals
Unsatisfactory Basic Proficient Distinguished 5
6
7
8
9
386 385 170 141 207 160 167 156 325 287 281 340 190 208 185 305 811 693 478 351 471 451 395 323 495 499 559 680 417 463 453 596
1,205 1,308 1,530 1,557 1,385 1,475 1,489 1,459 1,260 1,292 1,255 1,252 1,355 1,344 1,452 1,265
519 531 724 860 831 812 844 948 829 829 806 628 942 891 819 737
The principal participates in instructional planning with teams of teachers. The principal knows what's going on in my classroom. The principal carefully tracks student academic progress. The principal encourages teachers to implement what they have learned in professional development. The principal communicates a clear vision for our school. The principal makes clear to the staff his or her expectations for meeting instructional goals. The principal understands how children learn. The principal sets high standards for student learning It's OK in this school to discuss feelings, worries, and frustrations with the principal. The principal looks out for the personal welfare of the staff. I trust the principal at his or her word. The principal is an effective manager who makes the school run smoothly. The principal places the needs of children ahead of personal and political interests. The principal has confidence in the expertise
The principal takes a personal interest in the professional development of staff. Staff feel respected by the principal. Leadership Trust
Principals
Strongly Disagree Disagree Agree Strongly Agree 10
278 407 329 382 446 263 245 194 167 275 211 178 118 188 105 286 362 320 359 384 313 229 194 220 274 241 256 187 269 136
740 660 716 671 632 698 742 715 708 740 643 681 652 664 628
636 503 562 512 459 653 711 827 837 627 831 805 965 797 1,061
included specific improvement suggestions. included specific suggestions to improve my content/subject knowledge. included specific instructional strategies that I could use to improve my teaching. included specific classroom management strategies that I could use to improve my teaching. included recommendations for finding resources or professional development to improve my teaching. was provided as frequently as I needed it. was provided in time for me to use it to inform my practice. The feedback I received was an accurate portrayal of my teaching. The classroom observations or walkthroughs that informed the feedback I received represented a typical day in my classroom. In our evaluation system, different evaluators reviewing the same evidence would likely give the same ratings. knowledge of my subject/content to effectively evaluate me. knowledge of how my students learn to effectively evaluate me. knowledge of effective teaching practices to effectively evaluate me. understanding of the curriculum being
understanding of the established teacher evaluation system to effectively evaluate me. Feedback Usefulness Feedback Accuracy Evaluator Qualifications (In my opinion, my evaluator had sufficient…)
Principals
Disagree Somewhat Disagree Somewhat Agree Agree 11
12
1 2 3 4 5 6 7 8 9 10 11 12 13 14
.80**
.75** .65**
.46** .49** .51** .50**
.90** .88** .85** .86** .69**
.39** .39** .26** .36** .08 .36**
.36** .36** .22** .36** .10 .34** .91**
.17* .16* .09 .16* .08 .15 .57** .50**
.27** .30** .14 .26** .11 .26** .60** .64** .62**
.25** .26** .17* .28** .13 .26** .71** .71** .71** .76**
.10
.10
.10
.30** .41** .31** .20* .23** .36** .27** .34**
.02 .02 .01 .003
.03
.01
13
1 2 3 4 5 6 7 8 9 10 11 12 13 14
.80**
.75** .65**
.46** .49** .51** .50**
.90** .88** .85** .86** .69**
.39** .39** .26** .36** .08 .36**
.36** .36** .22** .36** .10 .34** .91**
.17* .16* .09 .16* .08 .15 .57** .50**
.27** .30** .14 .26** .11 .26** .60** .64** .62**
.25** .26** .17* .28** .13 .26** .71** .71** .71** .76**
.10
.10
.10
.30** .41** .31** .20* .23** .36** .27** .34**
.02 .02 .01 .003
.03
.01
14
1 2 3 4 5 6 7 8 9 10 11 12 13 14
.80**
.75** .65**
.46** .49** .51** .50**
.90** .88** .85** .86** .69**
.39** .39** .26** .36** .08 .36**
.36** .36** .22** .36** .10 .34** .91**
.17* .16* .09 .16* .08 .15 .57** .50**
.27** .30** .14 .26** .11 .26** .60** .64** .62**
.25** .26** .17* .28** .13 .26** .71** .71** .71** .76**
.10
.10
.10
.30** .41** .31** .20* .23** .36** .27** .34**
.02 .02 .01 .003
.03
.01
15
16
Outcome ICC (Percent of variance attributed to school) B (WFPL ratings) Teacher level standardized effect size (Z) School level standardized effect size (Z) School Pseudo R2(after including WFPL ratings) School Pseudo R2(after also including school and principal characteristics)
17
Outcome ICC (Percent of variance attributed to school) B (WFPL ratings) Teacher level standardized effect size (Z) School level standardized effect size (Z) School Pseudo R2(after including WFPL ratings) School Pseudo R2(after also including school and principal characteristics)
18
Outcome ICC (Percent of variance attributed to school) B (WFPL ratings) Teacher level standardized effect size (Z) School level standardized effect size (Z) School Pseudo R2(after including WFPL ratings) School Pseudo R2(after also including school and principal characteristics)
19
Outcome ICC (Percent of variance attributed to school) B (WFPL ratings) Teacher level standardized effect size (Z) School level standardized effect size (Z) School Pseudo R2(after including WFPL ratings) School Pseudo R2(after also including school and principal characteristics)
20
21
22
23
24
1 2 3 4 5 6 7 8 9
1
.891** 1
.864** .777** 1
.853** .717** .630** 1
Culture Subdomain .849** .698** .661** .682** 1
.699** .504** .485** .511** .477** 1
.040 .013 .020 .054 .043 .036 1
.045
1
.459** 1
.292** .262** .294** .260** .193** .197** -.119* -.356** -.844**
25
1 2 3 4 5 6 7 8 9
1
.891** 1
.864** .777** 1
.853** .717** .630** 1
Culture Subdomain .849** .698** .661** .682** 1
.699** .504** .485** .511** .477** 1
.040 .013 .020 .054 .043 .036 1
.045
1
.459** 1
.292** .262** .294** .260** .193** .197** -.119* -.356** -.844**
26
27
28
29
30
31
32
33