Transcript ECO Longitudinal - OSEP Leadership Mtng

The National Picture on Child
Outcomes for Early Intervention
and Preschool Special Education
Kathy Hebbeler, ECO at SRI
Lynne Kahn, NECTAC and ECO at FPG
Division for Early Childhood
October 30, 2012
Overview
• National numbers and the quality of
the state data
• The findings for FY 2010-11
• Findings over the last 3 years
• State variation and data quality
Early Childhood Outcomes Center
2
OSEP Reporting Requirements:
Child Outcomes
• Positive social emotional skills
(including positive social
relationships)
• Acquisition and use of knowledge
and skills (including early
language/ communication [and
early literacy])
• Use of appropriate behaviors to
meet their needs
Early Childhood Outcomes Center
3
If you have not seen the two-pager….
Early Childhood Outcomes Center
4
State Approaches to Outcomes Data, 2010-11
Approach
Part C
Preschool
(N=56)
(N=59)
COS* 7 pt.
scale
43/56 (77%)
36/59 (61%)
One tool
statewide
7/56 (13%)
9/59 (15%)
Publishers’
online analysis
3/56 (5%)
6/59 (10%)
Other
5/56 (9%)
8/59 (14%)
*Child Outcomes Summary Rating
Child Outcomes: What we know
• States are in various stages with
regard to building their child
outcomes measurement systems
• Some phrased in
• Some changed approaches
Early Childhood Outcomes Center
6
3 Methods Methods for
Calculating National Estimates
1. States with the highest quality data
weighted by child count to represent
all states*
2. All states weighted by child count
3. All states averaged (each state
weighted as 1)
*The data we will be presenting for the national picture
Early Childhood Outcomes Center
7
Identifying the States with Highly
Questionable Data
Criteria for eliminating states:
• Not reporting data on enough children
• Odd patterns in the data
• Review of method reported suggested the
data were of questionable quality
Early Childhood Outcomes Center
8
Continued increase in the number
of states included
Number of States that Met Criteria
for Inclusion in the National Analysis
0809
0910
10-11
Pt. C
19
29
39
Part B
Preschool
15
33
36
Early Childhood Outcomes Center
9
OSEP Reporting Categories
Percentage of children who:
a. Did not improve functioning
b. Improved functioning, but not sufficient to move nearer
to functioning comparable to same-aged peers
c. Improved functioning to a level nearer to same-aged
peers but did not reach it
d. Improved functioning to reach a level comparable to
same-aged peers
e. Maintained functioning at a level comparable to sameaged peers
3 outcomes x 5 “measures” = 15 numbers
Early Childhood Outcomes Center
10
Illustration of 5 Possible Paths
70
60
Score
50
40
30
20
10
0
1
6
11
16
21
26
31
36
41
46
51
56
Age in Months
Maintained functioning comparable to age peers
Achieved functioning comparable to age peers
Moved nearer functioning comparable to age peers
Made progress; no change in trajectory
Did not make progress
• And now the data….
And now the
data….
Early Childhood Outcomes Center
12
*Based on 39 states with highest quality data
13
*Based on 36 States with the highest quality data.
14
The Summary Statements
1. Of those children who entered the program below
age expectations in each outcome, the percent who
substantially increased their rate of growth by the
time they turned 3 [6] years of age or exited the
program.
2. The percent of children who were functioning within
age expectations in each outcome by the time they
turned 3 [6] years of age or exited the program.
Early Childhood Outcomes Center
15
*Based on 39 states with highest quality data
16
*Based on 36 States with the highest quality data.
17
Part C: Trends over Time
Early Childhood Outcomes Center
18
Part C: Trends over Time
Early Childhood Outcomes Center
19
Part B Preschool: Trends over Time
Early Childhood Outcomes Center
20
Part B Preschool: Trends over Time
Early Childhood Outcomes Center
21
Looking for Patterns
Early Childhood Outcomes Center
22
Early Childhood Outcomes
Center
%
24
Early Childhood Outcomes Center
Part C: States continue to report on
more children
Total Number of Children States Included in the Child
Outcomes Data
Number of States and Jurisdictions
Number of
children
reported
2007-08
(N=56)
2008-09
(N=56)
2009-10
(N=54)
2010-11
(N=54)
99 or less
13
6
5
4
100-499
25
16
9
10
500-999
6
13
10
7
1,0001,999
9
11
10
13
2,000+
3
10
20
22
Early Childhood Outcomes Center
27
Part B Preschool: States continue to
report on more children
Total Number of Children Included in Progress Data
Number of States and Jurisdictions
Number of
children reported
FFY 2007
(N=58)
FFY 2008
(N=58)
FFY 2009
(N=58)
FFY 2010
(N=59)
10 or fewer
1
1
1
1
10-99
11
7
6
7
100–499
14
6
4
2
500-999
10
12
10
8
1000–1999
8
7
9
5
2000–2999
5
10
11
12
3000–4999
5
11
9
13
5000-8999
3
3
7
9
9000+
1
1
1
2
Early Childhood Outcomes Center
28
Early Childhood Outcomes
Center
%
Early Childhood Outcomes Center
30
Maximum
75th
Percentile
50th
Percentile
25th
Percentile
Minimum
Outlier
Variation across states percent “a” :
Part B 619 2010-11
Variation across states percent “b” :
Part B 619 2010-11
Variation across states percent “c” :
Part B 619 2010-11
Variation across states percent “d” :
Part B 619 2010-11
Variation across states percent “e” :
Part B 619 2010-11
Variation across states in greater than
expected growth (Summary Statement 1) :
Part B 619 2010-11
Variation across states in exits at age
expectations (Summary Statement 2) :
Part B 619 2010-11
Variation across states percent “a” :
Part C 2010-11
Variation across states percent “b” :
Part C 2010-11
Variation across states percent “c” :
Part C 2010-11
Variation across states percent “d” :
Part C 2010-11
Variation across states percent “e” :
Part C 2010-11
Variation across states in greater than
expected growth (Summary Statement 1):
Part C 2010-11
Variation across states in greater than
expected growth (Summary Statement 2):
Part C 2010-11
Part C Improvement Activities
#
states
11
5
3
3
2
4
2
2
2
7
Topic/theme
Training/TA on evidence based practices, effective
practices, family centered services, DAP
TACSEI/CEFEL
Training/TA on social emotional development (not
TACSEI/CEFEL specific)
Training/TA on more functional IFSP outcomes
Revised IFSP format to enhance practices
Training/TA on Literacy
Training/TA on RBI
Training/TA on ASD
Training/TA on PSP
Other topics: coaching, instruction, self-help,
transition practices, Special Quest, assistive
technology, relationship based services in NE
46
Conclusions
• The data show good outcomes for many
children who attend Part C and Part B,
Preschool.
• The data quality continues to get better.
• The data will be a powerful tool for
program improvement when
– The data are consistently good at the local level
– States and local programs consistently use it.
Early Childhood Outcomes Center
47
For more information….
www.the-eco-center.org
Early Childhood Outcomes Center
48