Based on the publication of the same name published in BMJ Global - - PowerPoint PPT Presentation

based on the publication of the same name published in
SMART_READER_LITE
LIVE PREVIEW

Based on the publication of the same name published in BMJ Global - - PowerPoint PPT Presentation

Based on the publication of the same name published in BMJ Global Health. David Evans | 22 July 2020 | @DaveEvansPhD At its height, more than 1.5 billion learners affected by school closures. Source: UNESCO, COVID-19 Impact on Education


slide-1
SLIDE 1

David Evans | 22 July 2020 | @DaveEvansPhD

Based on the publication of the same name published in BMJ Global Health.

slide-2
SLIDE 2

David Evans | 22 July 2020 | @DaveEvansPhD

  • At its height, more than

1.5 billion learners affected by school closures.

Source: UNESCO, “COVID-19 Impact on Education”

slide-3
SLIDE 3

David Evans | 22 July 2020 | @DaveEvansPhD

  • At its height, more than

1.5 billion learners affected by school closures.

  • Even now, more than 1

billion learners continue

  • ut of school.

Source: UNESCO, “COVID-19 Impact on Education”

slide-4
SLIDE 4

David Evans | 22 July 2020 | @DaveEvansPhD

Source: CGD COVID-19 Education Tracker

slide-5
SLIDE 5

David Evans | 22 July 2020 | @DaveEvansPhD

slide-6
SLIDE 6

David Evans | 22 July 2020 | @DaveEvansPhD

Phone-based learning assessments in Botswana showed a similar distribution of skills to face-to-face assessments a few months earlier.

slide-7
SLIDE 7

David Evans | 22 July 2020 | @DaveEvansPhD

Piloting phone- based assessments in Botswana Face-to-face

  • ral

assessments in Botswana, the Gambia, Kenya, Sierra Leone, etc. Household surveys in various countries

slide-8
SLIDE 8

David Evans | 22 July 2020 | @DaveEvansPhD

  • 1. Protect children.
  • 2. Test the reliability and validity of your

measures.

  • 3. Keep instructions simple and use

practice items to ensure that respondents understand the exercise.

  • 4. Some assessments will be more

conducive to phone assessment than

  • thers.
  • 5. Keep it short.
  • 6. Experiment with how to get people to

pick up the phone.

  • 7. Establish rapport with adult phone
  • wners and youth respondents.
  • 8. Choose the most cost-effective

approach.

  • 9. Account for sample bias.
  • 10. Learn and document
slide-9
SLIDE 9

David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 1: Protect Children

  • Consent
  • Low stakes
  • Supervise

Lesson 2: Test measures

  • Item analysis
  • Ideally validate against

face-to-face measures

slide-10
SLIDE 10

David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 3: Simple instructions

  • Phone assessments bundle

receptive language skills with whatever you want to test

  • Keep it simple
  • Practice

Lesson 4: Use what has the best chance of working

  • Word problems from EGMA

have only oral stimuli

  • Text something to students
slide-11
SLIDE 11

David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 5: Keep it short

  • Early Grade Reading

Assessment: 15 minutes

  • Botswana: 15-20 minutes
  • Half of that is logistics

Lesson 6: Get people on the phone

  • Text, then call:

Botswana, India, Liberia

slide-12
SLIDE 12

David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 7: Establish rapport

  • Advance call only with the

adult

  • Initial instructions through

caregiver

  • Dependent on age and

culture Lesson 8: Be cost-effective

  • Cheaper than face-to-face
  • Interactive voice response

calls (IVR)?

  • Rapport
  • Logistics
slide-13
SLIDE 13

David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 9: Beware of sample bias

  • Document who responds
  • Find non-responders

creatively For the future: Learn and document

  • Many are trying phone-based

assessment

  • This will be a massive waste if

we don’t learn from it and document it

slide-14
SLIDE 14

David Evans | 22 July 2020 | @DaveEvansPhD

Available here Available here