Heather Villalobos Pavia, Colorado Department of Education Amarilys - - PowerPoint PPT Presentation

▶
heather villalobos pavia colorado department of education
SMART_READER_LITE
LIVE PREVIEW

Heather Villalobos Pavia, Colorado Department of Education Amarilys - - PowerPoint PPT Presentation

Mar 03, 2024 131 likes •390 views

Heather Villalobos Pavia, Colorado Department of Education Amarilys Galindo, Tri-Lin Integrated Services, Inc. Phyllis Garrett, Pearson History of native language accommodations Role of Spanish language arts assessment in assessment and

slide-1
SLIDE 1

Heather Villalobos Pavia, Colorado Department of Education Amarilys Galindo, Tri-Lin Integrated Services, Inc. Phyllis Garrett, Pearson

slide-2
SLIDE 2
  • History of native language accommodations
  • Role of Spanish language arts assessment in assessment and accountability

system

  • Participation
  • Procurement approach for Colorado Spanish Language Arts (CSLA)
  • Standards approach for Spanish language arts
  • Critical members in CSLA development and administration
  • CSLA development and administration
  • CSLA scoring and reporting
  • Lessons learned
slide-3
SLIDE 3

Colorado has addressed assessments in languages other than English since state assessments were first legislated

  • 22-7-409(1) beginning in the spring semester 1997, the department shall

implement the Colorado student assessment program…The department shall administer the English versions of the assessments and may administer any assessments adopted by the board in languages other than English, as may be appropriate for students with limited English proficiency, except that any student who has participated in the English language proficiency program…for more than a total of three school years shall be ineligible to take the assessments in a language other than English.

  • 22-7-409(3.5)(a) The board shall revise as necessary, and the department

shall administer reading assessments in Spanish for students in enrolled in the third and fourth grades and a writing assessment in Spanish to students enrolled in the fourth grade. (b) If the board deems that there are sufficient moneys received from the federal government…starting in the spring semester 2003, the department shall administer a writing assessments in Spanish for students enrolled in the third grade.

slide-4
SLIDE 4
  • First Spanish reading and writing originally developed in 1999
  • Under prior assessment system (CSAP 1997-2014): Lectura and Escritura
  • Current assessment legislation:
  • Replaced reading and writing with language arts
  • Extended three year limit to five years for eligibility to take assessments

in languages other than English

  • Current elementary and middle school assessments: Colorado Measures of

Academic Success (CMAS)

  • Colorado Spanish Language Arts (CSLA) is administered as an

accommodation

  • “Census” field test in 2015
  • Operational since 2016
  • All other content assessment are available in Spanish (transadaptation of

English assessment)

slide-5
SLIDE 5

5

CoAlt: ELA/L & Math (DLM)

Accommodations

  • Colorado Spanish

Language Arts (CSLA)

CoAlt: Science & Social Studies

Accommodations Accommodations

Mathematics Evidenced-based Reading and Writing Science & Social Studies ELA/L & Mathematics Colorado Measures of Academic Success (CMAS) Colorado SAT Suite CoAlt: ELA/L & Math (DLM)

slide-6
SLIDE 6

Assessment: treated as accommodated form Accountability:

  • Included in School and District Performance Frameworks
  • Academic achievement indicator calculations
  • Participation calculations
  • State and Federal
  • ESSA identification for Comprehensive and Targeted Support
slide-7
SLIDE 7

Students are eligible for the CSLA if they meet all the following criteria:

  • Identified as English learner (non-English proficient or

limited English proficient)

  • In grade 3 or 4
  • Received instruction in Spanish language arts within the last

9 months

  • Enrolled in the English language development program for 5

years or less (not including preschool or kindergarten)

(Students who are native Spanish speakers, first year in US and have had instruction Spanish language arts within the last 9 months in participate in the CSLA)

slide-8
SLIDE 8

1390 1149 1512 1701 1637 156 115 200 527 835 1097 LECTURA/ESCRITURA 2014 CSLA "CENSUS" 2015 SPRING CSLA FIELD TEST 2015 FALL CSLA 2016 CSLA 2017 CSLA 2018 Participation Count

Student Participation

Grade 3 Grade 4

slide-9
SLIDE 9
  • Included in Request for Proposals (RFP) with rest of

CO’s state assessments, CMAS

  • Emphasized treatment as an accommodation

throughout the RFP Goal: full integration

slide-10
SLIDE 10

Used Colorado Academic Standards (CAS) as foundation

  • CCSS are embedded in the CAS
  • Used Common Core en Español
  • Leveraging the Spanish standards
slide-11
SLIDE 11
  • Colorado Department of Education
  • Pearson: prime contractor
  • Tri-Lin: subcontractor
  • Educators familiar with:
  • Content standards
  • CMAS ELA assessment
  • CMAS development activities preferred
  • Standards and CMAS performance expectations
  • Bilingual learners
  • Bilingual instruction and assessment
slide-12
SLIDE 12

Designed to match CMAS: ELA

  • Standards
  • Construct
  • Content
  • Claim level
  • Reading and writing
  • Types of writing
  • Subclaim level
  • RI (informational), RL (literary), vocabulary, written

expression, writing knowledge of language and conventions

  • Evidence statements
  • Test design/Test blueprint
  • Session structure
  • Item types (input and output)
  • Text complexity/word count – differences between English and

Spanish

  • Cognitive complexity
  • Response
slide-13
SLIDE 13
  • Initial Spanish development (not translated)
  • Commissioned/Permissioned – challenges and advantages
  • Passage selection and educator passage review
  • Item writing
  • Goal: educator item writing
  • Educator item review
  • Field testing
  • Educator range finding
  • Educator data review
  • Challenges:
  • Small pool of educators
  • Right expertise
slide-14
SLIDE 14

Administration policies and procedures are the same as those for the English language arts assessment

  • Same procedures manual
  • Same test security and administration policies
  • Security plans
  • Treatment of irregularities and security breaches
  • Environment
  • Scheduling and testing time (Students are expected to take CSLA

at the same time as their peers are taking the English language arts assessment)

  • Same accommodations as paper-based English language arts

(extended time, large print, human reader, etc.)

  • Same test management system
  • Single mode rationale
slide-15
SLIDE 15
  • Item-level scoring
  • Same scoring approach as the ELA assessment
  • Selected response items are machine scored
  • Constructed response items use the same rubrics
  • Rubrics mirror the ELA assessment rubrics
  • Test-level scoring
  • Performance levels
  • Standard setting – process of determining performance standards

(cut scores) used to classify students into a given performance level

  • Process mirrored the ELA assessment standard setting where

appropriate

  • Performance levels
  • Performance level descriptor development
  • Modified Angoff standard setting method
  • Steps in the standard setting process
  • Data shared with panelists during the process
  • Vertical articulation
slide-16
SLIDE 16

20 12 19 19 23 28 35 34 4 8 20 40 60 80 100

Grade 3: Overall Total Grade 4: Overall Total

CMAS: ELA Spring 2015

Level 1 Level 2 Level 3 Level 4 Level 5 31 19 25 27 23 31 21 22 1 2 20 40 60 80 100

Grade 3: Free/Reduced Lunch Grade 4: Free/Reduced Lunch

CMAS: ELA Spring 2015

Level 1 Level 2 Level 3 Level 4 Level 5

slide-17
SLIDE 17

9 9 31 31 34 34 38 38 43 43

20 13

2 1

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% G03 G04

CSLA Spring 2016

Level 1 Level 2 Level 3 Level 4 Level 5

slide-18
SLIDE 18
slide-19
SLIDE 19
  • Equating and Scaling
  • Similarities
  • Use of common items
  • Scaling/scale score system
  • Differences
  • IRT models and software
  • Equating process
  • Reporting
  • Score information
  • Scale scores
  • Performance level
  • Claim and subclaim performance
  • Score reports
  • Student performance reports
  • Aggregate reports
slide-20
SLIDE 20
slide-21
SLIDE 21
slide-22
SLIDE 22
  • Number of students participating
  • Advantages to increased numbers
  • General assessment revisions
  • Directives from the State Board of Education for new contract
  • The Department will have decision-making authority over test design, form

development and test administration policies

  • The English language arts and mathematics average standard testing time for

the operational assessments will not exceed 4 hours in length (maximum of 8 hours in total)

  • Individual student level results will be made available to the school districts

within 30 days of receipt of all tests

slide-23
SLIDE 23
  • Growth in participation - impacts
  • Small educator pool
  • Language nuances
  • Bilingual learners
  • Regional
  • Timing of general decisions/activities
  • Test design revisions
  • Scoring and reporting
slide-24
SLIDE 24

Contact information: Heather Villalobos Pavia villalobospavia_h@cde.state.co.us, 303-866-6118 Amarilys Galindo agalindo@tri-lin.com, 800-421-7842 Phyllis Garrett, PhD phyllis.garrett@pearson.com, 512-989-5324