Transcript What Works? Heide Spruck Wrigley

Assessing Your Data System
Do You Need an MIS Tune-up?
American Institutes for Research
February 2005
NRS Data System Checkup
NRS Data System Characteristics








2
Functionally Complete
Reliable
Easy to Use
Accessible to Users
Not Resource Hungry
Able to Mine Data to Learn About
Opportunities/Needs?
Takes Advantage of Data Synergies
Other Considerations
NRS Data System Checkup
Functionality: Data for Monitoring
and Program Improvement
The Data System…
 Is a primary source of information on
programs
 Provides data for monitoring of
implementation of policies and procedures
 Is useful to program and State staff for
evaluation and program improvement
3
NRS Data System Checkup
Functionally Complete

Sufficiency and Granularity of Data

Report for useful levels and demographics
(program, site, class, teacher, ethnicity, age, etc.)

Support monitoring of key assessment
procedures (e.g., tests, forms, hours between
pre-/post-test)

Monitor follow-up procedures
(exit quarters, goal setting)
4
NRS Data System Checkup
Desk Monitoring Functionality:
Sample Data Elements

Performance Standards


Compliance Issues



Instructional hours offered
Grant requirements
Program Standards




5
NRS outcomes
Retention—student attendance
Pre-/post-test percentages
Staff—number and qualifications
Cost per student
NRS Data System Checkup
Able to Validate Data



6
Completeness and Quality of Data
Error Checks
Electronic Desk-monitoring Report
NRS Data System Checkup
Timeliness of Data

Monthly to Quarterly Submission


Ability to Evaluate Trends Across Years

7
To central State database, via Web or other
electronic means
Multi-year data
NRS Data System Checkup
Reliable



8
Operates in field without tech problems
Programs can get tables/data to state
Doesn’t crash or slow down under load
NRS Data System Checkup
Easy to Use



9
Screens are clear and concise
Obvious operational flow
All functions accessible
NRS Data System Checkup
Accessible


10
Data entry staff can access by web or have
properly equipped computer
Decision-makers/Administrators can get
reports easily
NRS Data System Checkup
Tech Support Hungry?



11
Usability issues
Reliability issues
Training issues
NRS Data System Checkup
Data Mining


12
Beyond NRS requirements, what else can
your data tell you?
What tools might help you understand
issues and trends?
NRS Data System Checkup
Data Synergies



13
Where are other useful data?
Are they accessible?
What might they be used for?
NRS Data System Checkup
Other Considerations



14
Bug fixes
New features
Pet peeves
NRS Data System Checkup