Transcript MSHA Performance Analysis Briefing Report Presentation

MSHA Performance Analysis
Briefing Report Presentation
Joe Breighner
Allison Czapracki
Tangie Gray
Rashmi Jain
Abi Jones
October 23, 2006
Agenda









Statement of Work
Background
Performance Analysis Overview
Drivers and Barriers
Preliminary Data
Task Analysis
Design Approach
Conclusion
Next Steps
Statement of Work

The overall goal of this project is to develop a
systematic and effective training strategy and
course lessons for underground coal mine
supervisors based on


State-of-the-art instructional design principles, processes,
and learning technologies
The extensive and validated mine supervisor Job Task
Analysis (JTA) developed by the Mine Safety and Heath
Administration (MSHA) in cooperation with the U.S. Navy
Background
50% of the electricity produced in the U.S. is fueled by coal
Background



In 2004 58.3% of coal miners
were above the age of 45
In 2004, 3.4% of coal miners
were under the age of 25
Coal mine positions expected to
increase by 10,000 over 20 years
“[The mining industry] will need to replace a major portion, approximately
50% of the underground coal mining workforce in the next 5 to 7 years.”
Bruce Watzman, V.P. Safety, Health and Human Resources for the National Mining Association
Background



Contributing factors to personnel shortage

Diminishing pool of human resources

Ever-changing production methods

Increasing high technology environment
“How these skills will be gained in advance of
employment is a continuous challenge,”
Bruce Watzman
Mine Safety & Health Administration’s (MSHA)
challenge: Formalize underground coal
mine supervisor training program
Background

2005-06 Research

The future high turnover in the coal mine industry

The lack of trained and experienced coal mine
supervisors

2006-07 Immersion team to transition training
prototype to accessible online training materials

The training must be

508 compliant

Developed in Workforce Connections, a Learning
Content Management System (LCMS)
Performance Analysis
The performance analysis was conducted to


Analyze and validate the prototype created
by the 2005-06 MSHA Immersion Team
Propose next steps for the task analysis
and content analysis phases of the project
Performance Analysis
Process


Held a meeting with members of the 2005-06
MSHA Immersion Team
Collected data from subject matter experts (SME),
prototype evaluations, online resources, and extant
data resources

Identified gaps in last year’s prototype from SME
interviews

Identified the drivers that promote the project

Identified the barriers that hinder the project
Performance Analysis
Optimal situation

Mine supervisors would possess

Overall knowledge of the mining process and
specific knowledge in the following areas:







Safety issues
Regulations
Technical skills (e.g., ventilation/fluid dynamics,
roof and rib control)
Management skills
Organizational skills
Logical thinking
Problem solving
Performance Analysis
Optimal situation


(contd…)
Mine supervisors would possess the ability to

Communicate effectively and develop a good
rapport with co-workers

Respond appropriately and competently during
emergencies and unusual situations
Job task analysis (JTA) spiders would be
translated into an engaging, practical and
effective training strategy
Performance Analysis
Actual situation




Expected shortage of experienced mine
supervisor candidates due to attrition
Few mine supervisor training programs are
available
Current training programs are mostly
On-the-Job Training (OJT)
Smaller mines do not have formal training
programs
Drivers

Access to








SME’s, MSHA personnel, and mine environments
Extensive mine safety resources
Compiled data from 2005-06 MSHA team
Target audience as usability and content testers
Single expert source to validate training content
High number of mining fatalities during 2006
High rate of impending retirement of
experienced miners
Critical role of mine supervisors and the
complexity of associated tasks
Barriers

Limitations of LCMS in light of Section 508
and SCORM compliance

Access to experienced miners and mine
supervisors as usability and content testers

Development cycle restricted to academic
year

Need for supplemental training, on or
off-site
Barriers

“Creativity” of mine supervisors, reliance on
prior knowledge

Miners showed preference for face-to-face
training over online training

Ongoing MSHA administration and support
of training LCMS and bulletin boards (new
equipment, procedures, safety regulations)
Preliminary Data
Human Resources


Stakeholder

Mr. Jeffrey Duncan, MSHA




Wants a training solution with “…a
management/engineering perspective [that
goes] beyond compliance to understanding”
Stressed creating online training for
underground coal mine supervisors
Training to include development of six training
modules for 2006-07 in Workforce Connections
MSHA will position the training as professional
development for miners
Preliminary Data

Human Resources (contd…)

SMEs


Formative evaluations of the 2005-06 training
prototype
Interviews
Preliminary Data

Non Human Resources

Hard Data Resources










MSHA Statement of Work
Title 30 Code of Federal Regulations
Multimedia Training Materials
NIOSH Latent Imaging Exercises
Colorado State Mining Exam Preparation DVD
Commonwealth of Pennsylvania Mine Safety Multimedia Mine Materials
MSHA Informational Reports
P&M Mine Job Task Analysis
Section 508 Website
Online Resources




http://www.msha.gov
http://www.cdc.gov/niosh
http://www.msha.gov/interactivetraining/tasktraining/index.html
http://www.section508.gov
Task Analysis

Cognitive task analysis divided the twelve
generic duties into two rule-using categories



Procedural
Principle
Further analysis of JTAs helped refine the
task analyses for Pre-Shift Examination and
Emergencies and Unusual Situations
Design Approach

Training Environment Proposal

Visually stimulating and interactive

adaptive to the individual miner's level of experience

Customizable and flexible

Performance based


508 and Sharable Courseware Object Reference
Model (SCORM) compliant
Rich with multiple views and guided scenarios
Design Approach


Web-based Electronic Performance
Support System (EPSS)
Scenario-driven Strategy
Conclusion

The performance analysis has provided:




An overview of the current state of the coal mining
industry
A closer look at the coal mine supervisory workforce
A clearer understanding of the viability of the
training prototype
Our challenge: bridging the gap between
miners’ preference for “hands-on practice”
and the cognitive-building advantages of
computer-based training.
Next Steps

Continued Task Analysis

A continued review of extant data

A synthesis of the information collected

Work on the user interface presentation and functionality

Finalizing the instructional strategy for the entire training, as
well as the multiple views and scenario based views.
Next Steps

Content Analysis

Synthesis of the information collected into applicable
and appropriate training modules

Reviewing examples of MSHA courses in Workforce
Connections

Selecting appropriate scenarios for the different
lesson topics

Developing appropriate objectives and instructions to
guide users through the modules
MSHA Performance Analysis
Briefing Report Presentation
Joe Breighner
Allison Czapracki
Tangie Gray
Rashmi Jain
Abi Jones