Transcript Essentials_day1_session1 - Granite School District MyAccess!

Essentials of
Effective Writing Instruction and Assessment
Copyright © Vantage Learning. All Rights Reserved.
Scoring Student Writing
in MY Access!
IntelliMetric™ Scoring
•The “Computer in the Sky:” Artificial intelligence engine which
emulates the process of human scorers
•How is the scoring done? IntelliMetric™ scores student writing
based on knowledge derived from a anchor/ training set of student
papers that was previously scored by expert human scorers
•IntelliMetric™ scores are prompt-specific and tied to descriptive
feedback based on a writer’s area of need
Copyright © Vantage Learning. All Rights Reserved.
THE PROCESS:
How Prompts Become IntelliMetric™
Students write to pilot prompts
and submit their responses
for scoring
Two expert scorers must
agree on the score based
on the rubric
Expert Scoring Team
1
6
4
Approximately
1200-1500 papers
ranging from 1 - 6
1
2
Copyright © Vantage Learning. All Rights Reserved.
3
4
5
6
THE PROCESS:
How Prompts Become IntelliMetric™
IntelliMetric
™ Prompt
Anchor
Set
1
2
Copyright © Vantage Learning. All Rights Reserved.
3
4
5
6
Scoring Student Writing
in MY Access!
Pilot Prompt Scoring
• Pilot prompts are developed by schools, districts
and/or Vantage
• Cannot be scored by IntelliMetric™ until a training set
has been developed
• TWO options for scoring: Approximator, an alternate AI
scoring engine, and/or the Vantage Scoring Center
• Approximator instantly provides an approximate
holistic score based on a 6 point rubric
• Scoring Center scores student responses and adds
these to the training/anchor set
•[email protected]
Copyright © Vantage Learning. All Rights Reserved.
Scoring Student Writing
in MY Access!
MY Prompt
• Teacher,
school or district -created
• Only available to the creator and the students who
are assigned a MY Prompt
• Cannot be scored by IntelliMetric ™
• Two scoring options: Approximator or teacherscored
Copyright © Vantage Learning. All Rights Reserved.