Transcript Online Testing - PearsonAccess.com

Online Testing: Past,
Present, and Future
Glenn Kirchner
Leanne Weddle
Director Online Testing
Student Assessment Division
Texas Education Agency
Program Manager
Online & Technology Implementation
Pearson
Bryan Bleil
Vice President
Online & Technology Implementation
Pearson
1
Mini-Session for Online Testing
Online Testing: TestNav
7.5, System Check
Utility, Proctor Caching
Mini-Sessions: Wednesday, 4:55 – 5:30 PM, Room 410
Thursday, 9:10 – 9:45 AM, Room 408
The online specialists will be in the Computer
Lab afterwards to answer questions about
online testing!
2
Mini-Session for Online Testing
What is a SRF and Why
Should I Care?
Mini-Session, Thursday, 4:15 – 4:50 PM, Room 410
The online specialists will be in the Computer
Lab afterwards to answer questions about
online testing!
3
Goals
• Look back at past technology changes and how
it has impacted online testing
• Tips to improve your experience for today’s
online testing
• Discuss tools available to help you with setting
up your environment
• Learn about research to be conducted for
tomorrow’s online testing
4
New Technology: When can I use it?
5
Online Testing Beginnings
6
Browser-Based TestNav
(TestNav 7.5)
https://testnav.com/tx
https://testnav.com/txtrng
7
Best Practices for Online Testing:
Communication
8
Communication with IT Staff is Critical
9
Sharing Communications
www.TexasAssessment.com/Communications
10
Technology Information
www.TexasAssessment.com/TechInfo
11
Best Practices for Online Testing:
Connectivity
12
Best Practices - Connectivity
•
•
•
•
•
•
13
Proctor caching & pre-caching
Configuring TestNav
Firewalls & content filters
Early Warning System (EWS)
Bandwidth challenges
Wireless computers in testing
Proctor Caching & Pre-caching
What?
•
One computer downloads test content
instead of multiple computers
•
Test content is stored on this computer
•
10 minutes to install and configure
•
Pre-cache (download) test content
before the test
Why?
•
Use less bandwidth
•
Faster test performance
•
Test even if Internet connection is lost
•
And you can use more computers for
online testing than if you don’t proctor
cache
14
Configuring TestNav
Home > Test Setup > Configure TestNav
• Configure TestNav
Organizations
Configurations
Sessions
Students
• Organizations are assigned to configurations
• Configurations are assigned to test sessions
• Test Sessions have students assigned
• Can specify a default configuration
• Can remove old configurations
15
Configuration Details
1st Step:
Create a new Configuration
2nd Step:
Add an Organization
16
Configuration Details
3rd Step:
Specify the
TestNav
Settings for
your
Configuration
17
Firewalls & Content Filters
Best Practice:
Add Pearson URLs and the proctor caching computer’s
IP address to district firewalls and content filters
18
Early Warning System (EWS)
TestNav is designed to tolerate interruptions in Internet service and to safeguard
against lost or inaccurate student response data.
The Early Warning System (EWS) is integrated functionality that gives TestNav a high
degree of fault tolerance and provides additional fail-safes in the event of
unexpected network disruptions during online testing.
19
Early Warning System (EWS)
Common EWS triggers:
• Anti-virus, auto-updates, screensavers, software update messages, etc.
• Student tries to access something outside the online testing environment
• Student doesn’t have appropriate read/write access to save locations
Best practices:
• Turn off updates, screensavers, etc.
• Install the manufacturer’s monitor and/or graphics drivers
o Generic drivers sometimes prevent EWS messages from being properly
displayed
• Ensure student accounts can read and write to designated save locations
20
Bandwidth
Best Practices:
•
•
•
•
•
Limit non-testing computer and network usage during testing
Adjust your network bandwidth “throttles”
Monitor network usage, before and during testing
Use Proctor Caching and ensure it is properly configured
Stagger student logins on the day of the test
• 1 room per minute (approximately)
21
Wireless Computers in Testing
What does my school use?
• What is 802.11?
– Technology standard
• 802.11g – most common
• 802.11n – fastest/newest
• 802.11b – oldest
22
Wireless Computers in Testing
Best Practices:
•
•
•
•
Wireless access points – More is better
Distance – closer is better
Limit number of computers per wireless access point
Try a small number first for proof of concept
– Do not roll out a few hundred on the first attempt
• Limit obstructions – walls will affect connection
• Avoid mixing standards
23
Best Practices for Online Testing:
Preparation
24
Documents & Downloads
Proctor Caching and TestNav:
TestNav 7 Combined Technical Guide
TestNav 7 and Proctor Caching Quick Start
www.TexasAssessment.com/TechInfo
Unified Texas Minimum System Requirements:
www.TexasAssessment.com/UnifiedSystemReqs
Proctor Caching Software – PC/Windows & Mac:
File Names: Proctor Caching – Windows
Proctor Caching – Mac
www.TexasAssessment.com/Downloads
(NEW!) TestNav 7 32/64 Bit Browser Configuration:
www.TexasAssessment.com/TechInfo
25
Online Testing System Check
www.TexasAssessment.com/SystemCheck
26
Online Testing System Check
1) Click the Start button to verify the
computer’s minimum system requirements
27
Online Testing System Check
2) Verify successful connection to TestNav
28
Online Testing System Check
3) Review your Capacity Estimate results
29
Online Testing System Check
4) Check your network speed – theoretical
@ 150 students (GREEN)
30
Training
Administration/Technology Staff
– Texas Assessment Management System Practice Center
• Flash Written Composition Tool — Texas Assessment Practice Administration
• Proctor Caching Testing Tool — Texas Assessment Practice Administration
• Texas Practice Test — Texas Assessment Practice Administration
– PearsonAccess Overview Training Modules
Students – Electronic Practice Assessment Tests (ePATS)
–
–
–
–
–
31
Texas Specific Testing Tools
TAKS Written Composition Tool
STARR End-of-Course Writing Tool
STAAR End-of-Course Analytical Essay Tool
TELPAS Online Reading Test Student Tutorials
Ongoing Changes in Technology:
Research in Response
32
Online Testing & Technology Innovation
Technology Markets – Always
Changing
– Innovation drives continual change in
technology markets
– As technology evolves, the testing
environment also changes
• Incremental updates: OS’s, browsers, Flash,
Java, HTML
• New hardware & devices: netbooks,
tablets, smartphones
• New network architectures: thin clients,
virtualization, cloud computing
• New human/computer interfaces: mouse,
touch, speech recognition, motioncontrolled interaction (eg, Wii, Xbox,
Kinnect)
– A transition to any technology-based
assessments is not a one-time change
The complete roadmap publication and additional resources are available
online at: www.PearsonAssessments.com/NextGenRoadmap
33
Diversity in the School Technology Environment
34
Comparability & “Standardized” Testing
Comparability between Paper and
Online Tests
– Decades of research looking at
differences in experience — and impact to
student performance — has resulted in:
• Scaled score adjustments
• Content & design changes
• Certain technology requirements
– Typically has treated online as the same
experience for all students
35
New Comparability Research Focus
Comparability between Devices
– Differences between devices are
becoming more pronounced
– New research is beginning to look at
differences within the “online” condition
Areas of Research
– Display size
– Text input – keyboards vs. on-screen
typing
– Interface – mouse vs. touch
• Cursor-based feedback
• Control & fine-point precision
• Ability to see through/around cursor
36
Display Size
37
Text Input
38
Mouse- & Touch-based Interfaces
39
Managing “Ongoing Change” in Testing
Supporting Research
– Only way to know comparability impact is through
research studies and field tests
– Expect that technology adoption will always be slowest
in the realm of “high-stakes” testing
Communication Always Helps
– Don’t hesitate to contact TEA or Pearson with
questions
– Please share what is happening with technology in
your schools
– Help educate your local technology staff about the
critical connection between technology at the student
level and statewide comparability
40
Online Testing: Past, Present & Future
Best Practices:
• Partner with your IT group
• Communication is key
Questions?
41
Glenn Kirchner
Laura Likon
Director
Online Testing
Student Assessment Division
Texas Education Agency
Program Manager
Online & Technology Projects
Texas Assessment Program
Pearson