Constance Pierson, Ph.D. & Michael Dillon, Ph.D. University of - - PowerPoint PPT Presentation

constance pierson ph d michael dillon ph d university of
SMART_READER_LITE
LIVE PREVIEW

Constance Pierson, Ph.D. & Michael Dillon, Ph.D. University of - - PowerPoint PPT Presentation

Constance Pierson, Ph.D. & Michael Dillon, Ph.D. University of Maryland, Baltimore County MdAIR 2009 Annual Conference October 16, 2009 Are there changes in algebra and calculus test scores? How are test scores related to course


slide-1
SLIDE 1

Constance Pierson, Ph.D. & Michael Dillon, Ph.D. University of Maryland, Baltimore County

MdAIR 2009 Annual Conference October 16, 2009

slide-2
SLIDE 2

 Are there changes in algebra and calculus test

scores?

 How are test scores related to course

performance?

 Do students placed in a given course perform

better or worse in that course than those taking the paper & pencil tests?

slide-3
SLIDE 3

PP (F03 to F05) OL (F06 to F08) Total Fall Cohort # % # % 200309 1487 1424 99.9% 1 0.1% 200409 1402 1311 99.9% 1 0.1% 200509 1414 1166 89.6% 135 10.4% 200609 1419 106 7.9% 1238 92.1% 200709 1424 40 3.1% 1238 96.9% 200809 1557 153 11.2% 1218 88.8%

* Subsequent analysis will exclude students taking paper test after Fall 2005 and online test prior to Fall 2006.

slide-4
SLIDE 4

Test Type Paper (F03 to F05) Online (F06 to F08)

Placement

# % % not taking calc test # % % not taking calc test 106 1236 31.7% 49.9% 976 26.4% 70.0% 150 1034 26.5% 20.6% 970 26.3% 46.7% 151 1104 28.3% 0.1% 1340 36.3% 0.1% 99 187 4.8% 78.2% 101 2.7% 88.1% ADV1 340 8.7% 31.4% 307 8.3% 56.0% Total 3901 3694

slide-5
SLIDE 5

50 100 150 200 250 300 350

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32

Algebra Test Score DISTRIBUTION OF ALGEBRA TEST SCORE BY TEST TYPE Fall 2003 to Fall 2008 OL PP

slide-6
SLIDE 6

50 100 150 200 250 300

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25

Calculus Test Score

DISTRIBUTION OF CALCULUS TEST SCORE BY TEST TYPE Fall 2003 to Fall 2008

OL PP

slide-7
SLIDE 7
slide-8
SLIDE 8

575.0 578.0 580.8 557.2 556.4 550.0

280 380 480 580 680 780

2003 2004 2005 2006 2007 2008

Fall MATH 106

625.3 626.5 625.7 609.5 597.7 605.6

280 380 480 580 680 780

2003 2004 2005 2006 2007 2008

Fall

MATH 150

684.6 677.0 675.6 660.8 651.8 656.0

280 380 480 580 680 780 2003 2004 2005 2006 2007 2008 Fall

MATH 151

Paper Online

slide-9
SLIDE 9

17.2 17.1 17.1 17.1 17.4 17.3

1 6 11 16 21 26 31

2003 2004 2005 2006 2007 2008

Fall Math 106

26.6 26.3 26.0 26.3 26.2 26.2

5 10 15 20 25 30

2003 2004 2005 2006 2007 2008

Fall Math 150

29.4 28.9 28.5 28.8 28.8 28.7

5 10 15 20 25 30

2003 2004 2005 2006 2007 2008

Fall

Math 151

Paper Online

slide-10
SLIDE 10

14.9 14.8 14.2 16.5 16.1 16.5

5 10 15 20 25 2003 2004 2005 2006 2007 2008 Fall

MATH 150

Paper Online

21.6 21.4 21.3 21.7 22.1 21.9

5 10 15 20 25 2003 2004 2005 2006 2007 2008 Fall

MATH 151

Paper Online

slide-11
SLIDE 11
slide-12
SLIDE 12

Placement % Taking Placement Course % Taking No Math Course PP OL PP OL LRC 099 56.1 61.4 39.0 34.7 MATH 106 77.1 76.2 19.5 20.6 MATH 150 60.3 60.2 22.1 23.9 MATH 151 58.8 49.6 22.2 30.4

slide-13
SLIDE 13

LRC 099 C or better <C

PP (F03-F05)

86.5% 13.5%

OL (F06-F08)

87.1% 12.9% MATH 106 C or better <C

PP (F03-F05)

73.6% 26.4%

OL (F06-F08)

66.6% 33.4% MATH 150 C or better <C

PP (F03-F05)

81.4% 18.6%

OL (F06-F08)

70.7% 29.3% MATH 151 C or better <C

PP (F03-F05)

85.8% 14.2%

OL (F06-F08)

80.4% 19.6%

slide-14
SLIDE 14

0.0% 5.0% 10.0% 15.0% 20.0% 25.0% 30.0% 35.0% 40.0% 45.0% A B C D F WX

Grades for Students Placed in LRC099 Taking LRC099 in First Semester

Paper Online

N=104 N=62

slide-15
SLIDE 15

0.0% 5.0% 10.0% 15.0% 20.0% 25.0% 30.0% A B C D F W WX

Grades for Students Placed in Math 106 Taking Math 106 in First Semester

Paper Online

N=949 N=742

slide-16
SLIDE 16

0.0% 5.0% 10.0% 15.0% 20.0% 25.0% 30.0% 35.0% 40.0% A B C D F W WX

Grades for Students Placed in Math 150 Taking Math 150 in First Semester

Paper Online

N=623 N=583

slide-17
SLIDE 17

0.0% 5.0% 10.0% 15.0% 20.0% 25.0% 30.0% 35.0% 40.0% 45.0% 50.0% A B C D F W WX

Grades for Students Placed in Math 151 Taking Math 151 in First Semester

Paper Online

N=648 N=664

slide-18
SLIDE 18
slide-19
SLIDE 19

ALGEBRA TEST SCORE Type <=12 13 14 15 16 17 18 19 20 21 22 >=23 # Online 41 57 56 64 70 71 95 95 102 105 76 60 # Paper 68 69 72 72 95 112 92 131 134 120 68 68

0% 20% 40% 60% 80% 100% <=12 13 14 15 16 17 18 19 20 21 22 >=23

% of MATH106 students with a grade of C or better by Placement Test Type and Algebra Test Score Online Paper

slide-20
SLIDE 20

ALGEBRA TEST SCORE Type <=20 21 22 23 24 25 26 27 28 29 30 31 32 # Online 17 16 25 41 101 96 101 90 65 54 25 26 5 # Paper 26 12 16 52 91 123 104 87 88 52 32 9 2

0% 20% 40% 60% 80% 100% <=20 21 22 23 24 25 26 27 28 29 30 31 32

% of MATH150 students with a grade of C or better by Placement Test Type and Algebra Test Score Online Paper

slide-21
SLIDE 21

CALCULUS TEST SCORE Type <=7 8 9 10 11 12 13 14 15 16 17 18 19 20 >=21 No test # Online 6 5 2 7 10 14 16 31 53 49 60 62 15 22 48 262 # Paper 23 25 19 20 25 39 61 60 68 80 80 64 11 10 7 102

0% 20% 40% 60% 80% 100% <=7 8 9 10 11 12 13 14 15 16 17 18 19 20 >=21

% of MATH150 students with a grade of C or better by Placement Test Type and Calculus Test Score Online Paper

slide-22
SLIDE 22

ALGEBRA TEST SCORE Type <=22 23 24 25 26 27 28 29 30 31 32 # Online 10 13 35 60 59 91 99 108 109 91 56 # Paper 21 16 40 40 61 74 108 107 130 114 62

0% 20% 40% 60% 80% 100% <=22 23 24 25 26 27 28 29 30 31 32

% of MATH151 students with a grade of C or better by Placement Test Type and Algebra Test Score Online Paper

slide-23
SLIDE 23

CALCULUS TEST SCORE Type <=16 17 18 19 20 21 22 23 24 25 No test # Online 10 17 24 95 99 125 129 97 90 32 13 # Paper 55 30 64 130 100 113 119 82 50 25 5

0% 20% 40% 60% 80% 100% <=16 17 18 19 20 21 22 23 24 25

% of MATH151 students with a grade of C or better by Placement Test Type and Calculus Test Score Online Paper

slide-24
SLIDE 24

 Results presented to key stakeholders on

campus.

 Decision made to accept online testing methods

as reasonably comparable to paper & pencil

 More focus needed on advising efforts  Analysis of performance in Math 150 and 151

 Determine factors related to success in these courses  Develop model to help students choose their best

course of action

 Questions/comments – krach@umbc.edu