Transcript ICAEA_Shawcross_Rome Training for proficiency

Training for Proficiency or
Training for success in a test?
Philip Shawcross
ICAEA
ICAO LPRI workshop, ENAC, Rome, 4th March 2010
Proficiency or success?
Training for Proficiency or
Training for success in a test?
1.
2.
3.
4.
5.
6.
What are the concerns?
Forms of negative washback
Different types of assessment
How can proficiency be trained for?
How do we know we are getting it right?
Conclusion
What are the concerns? (1)







Wide variety of test types and quality
No international test accreditation process
A test may have too narrow a focus
A test may not adequately assess all skills
A test may not sufficiently simulate
operational conditions
Many tests have well-defined & well known
tasks
Encourages use of “easiest” test
What are the concerns? (2)






Training to a test does not necessarily
prepare for the real world
“Taking our eye off the ball”
Detrimental to learners long-term view of
language
Targeted proficiency has wider scope than
any test
Proficiency to be defined in operational terms
Need for sustainable levels of proficiency
Forms of negative washback (1)





Communication content may be limited by
test content
Communication functions may be limited by
test format
Particular skills (e.g. interaction) may not be
sufficiently trained
Tendency to train to narrow focus
Excessively modular approach to language
Forms of negative washback (2)





Tendency to train only to minimum level
Training may “ape” test rather than prepare
for real world
Tendency to learn “parrot-fashion”
Lack of separation between training and
testing processes and staff
Publication of a bank of test questions
Different types of assessment

Benchmark / prognostic tests
Placement tests
Entry tests
Progress tests
Exit tests

Proficiency tests (licensing)




How can proficiency be trained for? (1)
Training should have its eye on:








The “big” picture
The long term
Operational realities
Whole range of communicative functions
The acid test of communicating safely
Ability to manage the unexpected
A safety margin
Sustainability
How can proficiency be trained for? (2)
How can this be put into practice?
Aviation English training should:





Be modelled on operations, not testing
Provide sufficient practice to achieve a solid
level of proficiency
Be approved by SMEs
Explore a wide range of situations
Be applicable to operational situations (lexis)
and communicative functions (structure)
How can proficiency be trained for? (3)






Take students beyond minimum Level 4
Prioritize expression, fluency & interactions
(classroom)
Adopt a holistic approach to language
Make language training a corporate project
Incorporate language maintenance
strategies & recurrent training
Receive feedback from operations for
adjustment
How can proficiency be trained for? (4)
… and more generally





Foster operational effectiveness rather
than linguistic correctness
Develop appropriate cognitive processes
Encourage flexibility & adaptability in
language use
Respect the students’ different learning
styles & speeds
Build self-confidence & self-esteem
How do we know we are getting it right?(1)





Integrate language training as a core
institutional activity, not a peripheral activity
---> a closed loop for greater awareness &
visibility
Do not only rely on progress & exit tests
-- more holistic assessment
Develop students’ own pedagogical selfawareness
Consult SMEs on students’ performance
How do we know we are getting it right?(2)



Use feedback from operational monitoring
Pay particular attention to holistic skills
(fluency, interactions & discourse
management) as criteria of proficiency
Ask “Would I entrust my life to this person
in an emergency?”
Conclusions
Training





High stakes
Operations-driven
Integrated set of skills
Targets sustainable proficiency
Part of life-long learning
Training for Proficiency or
Training for success in a test?
Thank you very much
for listening
[email protected]
ICAO LPRI workshop, ENAC, Rome, 4th March 2010