Transcript CALPADS Training AA-Intro v2.0

ASSESSMENTS & ACCOUNTABILITY
Overview
Assessments & Accountability v 1.0
GROUND RULES REMINDER
–
–
–
–
–
2
Mute phones while listening (*6 to mute and un-mute)
Do not place your phone on HOLD
Silence cell phones
Hold questions until Q&A periods
Submit all questions via the Chat function
Assessments & Accountability v 1.0
INTRODUCTION
3
Assessments & Accountability v 1.0
Introduction
BENEFITS TO LEAs
 Complete assessment data is available for a student as soon
as the student is enrolled in your LEA*
 LEA performance data is available on demand*
− Current and previous years detail and summary
− Comparison of LEA to County & State
 AYP/API data will be available on demand*
− Current and previous years summary
− Students included & not included with reasons
 Use of CALPADS will reduce vendor dependence ($$)
− Demographic data corrections in CALPADS (Future enhancement)
 Student data used in reporting is improved
− Student data is more consistent between vendor, LEA and State
reports
4
* Initially, only 2010-2011 data available
Assessments & Accountability v 1.0
Introduction
FUNCTIONS
Basic functions are included for …
 CDE to set-up the testing calendar
 CDE to load assessment results from the vendor into
CALPADS for each Program Administration
−
−
−


STAR ADMIN (i.e. ANNUAL)
CAHSEE ADMINs (e.g. JUL, OCT, NOV, etc.)
CELDT ADMINs (e.g. JUL, AUG, SEP, etc.)
LEAs to match assessment results with students when
CALPADS is unable to do so (Match Result = LEA Suspense)
If necessary, CDE to associate assessment results with
students when an LEA is unable to do so (Match Result =
CDE Suspense)
5
Assessments & Accountability v 1.0
Introduction
FUNCTIONS (Cont)
Basic functions are included for (cont) …
 LEAs to view/report assessment results
 LEAs to view/report accountability results
 Eventually providing CALPADS data to AYP/API
calculations
6
Assessments & Accountability v 1.0
Introduction
ARCHITECTURE OVERVIEW
State Users
CALPADS
Portal
LEA
A
CALPADS
Operational
Data Store
(ODS)
Assessment
Vendors
CALPADS
Staging
Area
LEA Systems
Local
CALPADS
ZIS
CALPADS
Integration
Hub
(ZIS, FTP,
ESB)
B
CALPADS
State
Reporting
Snapshots
C
CALPADS
Operational
Data Store
Replicated
(ODSR)
CALPADS
Assessment &
Accountability
Data Store
(AADS)
Other Systems
D
Solution Components
–
–
–
7
–
Yellow = New Component
Red Solid Line = Additional use for existing function
Red Broken Line = New functionality
Grey Line = Functionality Not Implemented
Reporting from AADS
requires vendor test results
and CALPADS student data
Assessments & Accountability v 1.0
Introduction
ASSESSMENT MENU
Xx
X



8
CDE Only
Manage Program
Administrations
View Assessment
Event Status
Manage School
Administrations
Assessments & Accountability v 1.0
DATA VALIDATION OVERVIEW
9
Assessments & Accountability v 1.0
Data Validation Overview
SUSPENSE DATA IDENTIFICATION
When data are loaded, CALPADS …
 matches the SSID and demographic data (gender, date of birth
year) in the assessment results file with the SSID in CALPADS that
has the same demographics
 verifies that the student was enrolled in the results record LEA at the
time of testing (using LEA Testing Window)
 checks to see that the test vendor provided the date needed to
verify enrollment (using SSID Administration Date)
If one of these conditions is not met, CALPADS places
the record in suspense
SSID Administration Date: Date in an SSID’s assessment results record that is used to identify student profile
records that were valid at the time of testing. STAR = Testing Start Date; CAHSEE = ELA Test Date and Math Test
Date; CELDT = Date Testing Completed
10
Assessments & Accountability v 1.0
Data Validation Overview
SUSPENSE DATA RESOLUTION



Suspense data can be
managed both Online & in
Batch
Both methods are
accessed from the
Assessment menu
Functions allow for
management of Match
Results
–
–
–
11
LEA Suspense
LEA Matched
CDE Suspense
These components are
presented in the Suspense
Resolution training module
Assessments & Accountability v 1.0
REPORTING OVERVEW
12
Assessments & Accountability v 1.0
Reporting Overview
REPORTING PROCESS
 Assessment reports display vendor assessment results data
and the matched CALPADS Student Profile data
 These data are matched when …
− The results data are loaded for a Program Administration
(e.g. STAR ANNUAL Admin, CAHSEE JUL Admin, etc.)
− The LEA or CDE matches a results record that could not
be matched in the results load (i.e. Suspense Resolution)
− The nightly Suspense Process identifies that the data
condition no longer exists that placed a record in
suspense – due to data changes made by the LEA
13
Assessments & Accountability v 1.0
Reporting Overview
REPORTING PROCESS (Cont)


Once results data are matched with CALPADS data, the
data are available in the AADS for reporting
Report content for a Program Administration can continue
to change as long as suspense processing and data
loading are occurring for that Program Administration

A schedule for when data for the various assessment
programs are loaded is provided in the reporting
component of this Assessment and Accountability training

When assessment data are loaded, Assessment and
Accountability Coordinators will receive an email
14
Assessments & Accountability v 1.0
Reporting Overview
REPORTING PROCESS (Cont)

15
Report content will not change after CDE loads all of the
assessment data for a program administration and the last
snapshot is performed for that assessment program
administration
Assessments & Accountability v 1.0
Reporting Overview
REPORTS AVAILABLE

The following Assessment reports are available
(initially for
2010-2011 data)
–
–
–
–

The following AYP/API reports will be available
–
–

LEA and School summary of students included in the AYP/API
results by subgroup
Individual students included in the AYP/API results
The following individual student report is available
–
16
Summary LEA results for STAR, CAHSEE and CELDT, including
state comparisons
Individual student result detail supporting the summary results for
STAR, CAHSEE, and CELDT
Currently enrolled students missing CAHSEE
Currently enrolled students needing CELDT
Individual student assessment history (initially 2010-2011 data)
Assessments & Accountability v 1.0
Reporting Overview
REPORTS AVAILABLE (Cont)

Operational reports are available that provide the status for
suspense data
–
–
17
Summary Counts
Individual Students
Assessments & Accountability v 1.0
Reporting Overview
ACCESSING REPORTS
Two entry points
from Assessment
Menu
18
Assessments & Accountability v 1.0
Reporting Overview
REPORTS AVAILABLE
19
Assessments & Accountability v 1.0
Reporting Overview
REPORTS AVAILABLE (Cont)

xxxxxxxxx
Coming

Details of these reports are presented
in the training module for Reporting
20

CDE Only
50.1 Assessment
Upload – Detail
52.1 Assessment
Snapshots - Detail
Assessments & Accountability v 1.0
GETTING STARTED
21
Assessments & Accountability v 1.0
Getting Started
CDE SET-UP
CDE sets up the Calendar for each Program Administration,
which indicates the Testing Window for each LEA
STAR
The calendar for the
ANNUAL STAR
Administration is unique
to each LEA
The LEA Testing Window is determined from the schedule
for testing provided by the LEA to the testing vendor for
each Administration Type (MC, WA, EP). The vendor
provides the LEA level data to a CALPADS directory from
which it is retrieved nightly by an automated FTP process and
loaded into CALPADS. CALPADS calculates the Window.
The Begin date is the earliest First Test Date from all of an
LEA’s Administration Types. The end date is the latest Last
Test Date from all of the LEA’s Administration Types.
The Window can be extended by CDE in case of
emergencies, etc.if a school will test outside of the Window.
CAHSEE
The calendar for each
CAHSEE Administration
is the same for each LEA
The LEA Testing Window is determined by CALPADS from
the current year calendar, since CAHSEE Administrations
are defined as calendar months (e.g. JUL, OCT, NOV, etc.)
CELDT
The calendar for each
CELDT Administration is
the same for each LEA
The LEA Testing Window is determined by CALPADS from
the current year calendar, since CELDT Administrations are
defined as calendar months (e.g. JUL, AUG, etc.)
22
LEA Testing Window: The range of days that indicate an LEA’s valid testing days for an Administration that is used
to validate a student’s enrollment at the time of testing.
Assessments & Accountability v 1.0
Getting Started
CDE SET-UP (Cont)
Calendar online currently reports only for STAR
Administration Types for an LEA
STAR vendor calendar data, updated nightly, is available for viewing by the LEA
23
Assessments & Accountability v 1.0
Getting Started
LEA SET-UP
CALPADS LEA Administrator assigns Coordinator Roles
Assessment Coordinator Roles
– CALPADS LEA STAR Coordinator
– CALPADS LEA CAHSEE Coordinator
– CALPADS LEA CELDT Coordinator
Accountability Coordinator Role
– CALPADS LEA Accountability Coordinator
Assessment Coordinators can …
•
•
•
•
Access all online data and reports for the Program to which the role relates
Access operational reports for suspense
Access Suspense extract for the Program to which the role relates
Access Individual Student Profile-Assessment report
Accountability Coordinator can …
•
•
•
•
24
Access all online data and reports
Access operational reports for suspense
Access Suspense extracts
Access Individual Student Profile-Assessment report
Assessments & Accountability v 1.0
Getting Started
KEY POINTS
•
•
•
No special submission of student data by LEAs. Data
being maintained in the ODS is made available to the
Assessment and Accountability ODSR on a real-time (i.e.
transaction) basis.
Setting up security is the only CALPADS activity
required for LEAs to get started.
When the vendor calendar file has been loaded,
notification that the calendar is available for viewing will
be …
–
–
Displayed in CALPADS Notifications on the Home page
Emailed to the following roles:


25
LEA STAR Coordinator for STAR data load
LEA Accountability Coordinator
Assessments & Accountability v 1.0
Getting Started
KEY POINTS (Cont)
•
When a vendor assessment results file has been
loaded, notification that reports are available for viewing
will be …
–
–
Displayed in CALPADS Notifications on the Home page
Emailed to the following roles:


26
LEA Assessment Coordinator for the assessment loaded
LEA Accountability Coordinator
Assessments & Accountability v 1.0
WRAP-UP
27
Assessments & Accountability v 1.0
Wrap-Up
Questions
28
Assessments & Accountability v 1.0