Differences Differences PBMAS PBMAS DVM DVM SYSTEM PURPOSE - - PDF document

Data Validation Monitoring ‐ Student Assessment 4/14/2015 1

Data Validation Monitoring – Student Assessment

Staging Training Presented by Region 4 ESC April 14, 2015 Staging Training Presented by Region 4 ESC April 14, 2015

Data Validation Acronyms Data Validation Acronyms

• DVM – Data Validation Monitoring
• DA – Data Analysis (Intervention

document)

• SLDR – Student Level Data Review

(Intervention document)

• DVM-CAP – Data Validation

Monitoring Corrective Action Plan

• DVM – Data Validation Monitoring
• DA – Data Analysis (Intervention

document)

• SLDR – Student Level Data Review

(Intervention document)

• DVM-CAP – Data Validation

Monitoring Corrective Action Plan

PBMAS PBMAS DVM DVM

SYSTEM PURPOSE

• Measures program

effectiveness INTERVENTION PURPOSE

• Identify and

address the root cause of program ineffectiveness SYSTEM PURPOSE

• Measures program

effectiveness INTERVENTION PURPOSE

• Identify and

address the root cause of program ineffectiveness

SYSTEM PURPOSE

• Identifies data

anomalies in statewide systems INTERVENTION PURPOSE

• Determine if

anomaly is caused by noncompliance – If yes, develop corrective action plan SYSTEM PURPOSE

• Identifies data

anomalies in statewide systems INTERVENTION PURPOSE

• Determine if

anomaly is caused by noncompliance – If yes, develop corrective action plan

Differences Differences

Data Validation Monitoring ‐ Student Assessment 4/14/2015 2

INDIC INDICATORS INDIC INDICATORS

Data Validation Monitoring – Student Assessment Data Validation Monitoring – Student Assessment

List of 2014 Student Assessment Indicators List of 2014 Student Assessment Indicators

• STAAR 3-8 Absent Rate – Indicators 1-5

– Math, Reading, Science, Social Studies,

Writing

– Eleven Student Groups

• STAAR 3-8 Other Rate – Indicators 6-10

– Math, Reading, Science, Social Studies,

Writing

– Eleven Student Groups

• STAAR 3-8 Absent Rate – Indicators 1-5

– Math, Reading, Science, Social Studies,

Writing

– Eleven Student Groups

• STAAR 3-8 Other Rate – Indicators 6-10

– Math, Reading, Science, Social Studies,

Writing

– Eleven Student Groups List of 2014 Student Assessment Indicators List of 2014 Student Assessment Indicators

• TELPAS Absent Rate – Indicator 11
• TELPAS Other Rate – Indicator 12
• STAAR EOC Participation Rate – Indicator 13

– Algebra I, English I, English II, Biology, US History – Absent, Other, Not Found

• CTE Coding Discrepancy – Indicator 14
• TELPAS Absent Rate – Indicator 11
• TELPAS Other Rate – Indicator 12
• STAAR EOC Participation Rate – Indicator 13

– Algebra I, English I, English II, Biology, US History – Absent, Other, Not Found

• CTE Coding Discrepancy – Indicator 14

Data Validation Monitoring ‐ Student Assessment 4/14/2015 3

DVM-Student Assessment

SA I ndicat

• r

Description Workbook Content Student Level Report 1 STAAR Absent Rate – Math (i-xi) SLDR and DA DVM Report 2 STAAR Absent Rate – Reading (i-xi) SLDR and DA DVM Report 3 STAAR Absent Rate – Science (i-xi) SLDR and DA DVM Report 4 STAAR Absent Rate – Social St (i-xi) SLDR and DA DVM Report 5 STAAR Absent Rate – Writing (i-xi) SLDR and DA DVM Report 6 STAAR Other Rate – Math (i-xi) SLDR and DA DVM Report 7 STAAR Other Rate – Reading (i-xi) SLDR and DA DVM Report 8 STAAR Other Rate – Science (i-xi) SLDR and DA DVM Report 9 STAAR Other Rate – Social St (i-xi) SLDR and DA DVM Report 10 STAAR Other Rate – Writing (i-xi) SLDR and DA DVM Report 11 TELPAS Absent Rate SLDR and DA DVM Report 12 TELPAS Other Rate SLDR and DA DVM Report 13 EOC Participation Rate (i-v) SLDR and DA DVM Report 14 CTE Coding Discrepancy DA DVM Report

i-xi are indicators based on student

• groups. The absent

math rate is calculated for each student group There are 110 STAAR indicators calculated 10 core indicators x11 student groups 110 indicators These 110 can be “triggered”

DVM-Student Assessment

SA I ndicat

• r

Description Workbook Content Student Level Report 1 STAAR Absent Rate – Math (i-xi) SLDR and DA DVM Report 2 STAAR Absent Rate – Reading (i-xi) SLDR and DA DVM Report 3 STAAR Absent Rate – Science (i-xi) SLDR and DA DVM Report 4 STAAR Absent Rate – Social St (i-xi) SLDR and DA DVM Report 5 STAAR Absent Rate – Writing (i-xi) SLDR and DA DVM Report 6 STAAR Other Rate – Math (i-xi) SLDR and DA DVM Report 7 STAAR Other Rate – Reading (i-xi) SLDR and DA DVM Report 8 STAAR Other Rate – Science (i-xi) SLDR and DA DVM Report 9 STAAR Other Rate – Social St (i-xi) SLDR and DA DVM Report 10 STAAR Other Rate – Writing (i-xi) SLDR and DA DVM Report 11 TELPAS Absent Rate SLDR and DA DVM Report 12 TELPAS Other Rate SLDR and DA DVM Report 13 EOC Participation Rate (i-v) SLDR and DA DVM Report 14 CTE Coding Discrepancy DA DVM Report

i-v are indicators based on EOC subject areas. Each subject area has a calculations for Absent Other Not Found There are 15 EOC indicators calculated within # 13 5 subject areas x 3 calculations (A, O, NF) 15 indicators Each of the 15 can be “triggered”

DVM-Student Assessment DVM-Student Assessment

Types

• f I ndicators

Number

• f I ndicators

STAAR 110 TELPAS 2 EOC 15 CTE 1 TOTAL 128

Data Validation Monitoring ‐ Student Assessment 4/14/2015 4

INDIC INDICATOR 14 – 14 – CTE CODING TE CODING

Data Validation Monitoring - Data Validation Monitoring -

Page 2.126 in Section 2 of the 2014-2015 PEIMS Data Standards

District Testing Coordinator Reminder District Testing Coordinator Reminder

• Coordinate/collaborate

with CTE counterpart

• CTE coding decision

flowchart

• Districts that triggered

# 14

• New DTCs
• Coordinate/collaborate

with CTE counterpart

• CTE coding decision

flowchart

• Districts that triggered

# 14

• New DTCs

Data Validation Monitoring ‐ Student Assessment 4/14/2015 5

CAL CALCULATIONS CAL CALCULATIONS

Data Validation Monitoring – Student Assessment Data Validation Monitoring – Student Assessment

Indicators 1 - 5 Indicators 1 - 5 Indicators 6 - 10 Indicators 6 - 10

Data Validation Monitoring ‐ Student Assessment 4/14/2015 6

Indicator 11 Indicator 11 Indicator 12 Indicator 12 Indicator 13 Indicator 13

Data Validation Monitoring ‐ Student Assessment 4/14/2015 7

Indicator 14 Indicator 14

ST STAGING INF AGING INFORMA RMATION ION ST STAGING INF AGING INFORMA RMATION ION

Data Validation Monitoring – Student Assessment Data Validation Monitoring – Student Assessment

Stage 3 Stage 2 Stage 1

2014 -15 Three Stages 2014 -15 Three Stages

Data Validation Monitoring ‐ Student Assessment 4/14/2015 8

ST STAGING RE PORTING RE QUIRE ME NT AGING RE PORTING RE QUIRE ME NTS ST STAGING RE PORTING RE QUIRE ME NT AGING RE PORTING RE QUIRE ME NTS

Data Validation Monitoring – Student Assessment Data Validation Monitoring – Student Assessment

DVM-Student Assessment Stage 1 DVM-Student Assessment Stage 1

• Indicator Workbook(s)
• CAP if appropriate
• Retain Locally
• Random Submissions
• Indicator Workbook(s)
• CAP if appropriate
• Retain Locally
• Random Submissions

DVM-Student Assessment Stage 2 DVM-Student Assessment Stage 2

• Indicator Workbook(s)
• CAP if appropriate
• Submit to TEA
• Feedback on submission
• Indicator Workbook(s)
• CAP if appropriate
• Submit to TEA
• Feedback on submission

Data Validation Monitoring ‐ Student Assessment 4/14/2015 9

DVM-Student Assessment Stage 3 DVM-Student Assessment Stage 3

• Indicator Workbook(s)
• CAP if appropriate
• Submit to TEA
• Feedback on submission
• Additional follow-up and

support

• Indicator Workbook(s)
• CAP if appropriate
• Submit to TEA
• Feedback on submission
• Additional follow-up and

support

Submission Deadline Submission Deadline

• All activities must be completed by

May 28

• Stage 1 – Completed and kept locally
• Stage 2, 3 – Completed and

submitted

• All activities must be completed by

May 28

• Stage 1 – Completed and kept locally
• Stage 2, 3 – Completed and

submitted WORKBOOK RKBOOKS WORKBOOK RKBOOKS

Data Validation Monitoring – Student Assessment Data Validation Monitoring – Student Assessment

Data Validation Monitoring ‐ Student Assessment 4/14/2015 10

DVM-Student Assessment

SA I ndi- cator Description Workbook Content Student Level Report 1 STAAR Absent Rate – Math (i-xi) SLDR and DA DVM Report 2 STAAR Absent Rate – Reading (i-xi) SLDR and DA DVM Report 3 STAAR Absent Rate – Science (i-xi) SLDR and DA DVM Report 4 STAAR Absent Rate – Social St (i- xi) SLDR and DA DVM Report 5 STAAR Absent Rate – Writing (i-xi) SLDR and DA DVM Report 6 STAAR Other Rate – Math (i-xi) SLDR and DA DVM Report 7 STAAR Other Rate – Reading (i-xi) SLDR and DA DVM Report 8 STAAR Other Rate – Science (i-xi) SLDR and DA DVM Report 9 STAAR Other Rate – Social St (i-xi) SLDR and DA DVM Report 10 STAAR Other Rate – Writing (i-xi) SLDR and DA DVM Report 11 TELPAS Absent Rate SLDR and DA DVM Report 12 TELPAS Other Rate SLDR and DA DVM Report 13 EOC Participation Rate (i-v) SLDR and DA DVM Report 14 CTE Coding Discrepancy DA DVM Report

Indicators highlighted in the same color are in the same workbook

Indicators 1-5 and 11 Indicators 1-5 and 11

• SLDR and Data Analysis Tabs
• Checkbox for No Issues Identified
• SLDR and Data Analysis Tabs
• Checkbox for No Issues Identified

Indicators 6-10 and 12 Indicators 6-10 and 12

• SLDR and Data Analysis Tabs
• Checkbox for No Issues Identified
• SLDR and Data Analysis Tabs
• Checkbox for No Issues Identified

Data Validation Monitoring ‐ Student Assessment 4/14/2015 11

Indicator 13 Indicator 13

• SLDR and Data Analysis Tabs
• Checkbox for No Issues Identified
• SLDR and Data Analysis Tabs
• Checkbox for No Issues Identified

Indicator 14 Indicator 14

• Data Analysis Tab
• 7 Responses Required
• Data Analysis Tab
• 7 Responses Required

Question Questions Question Questions