Source Provenance: https://ged.com/wp-content/uploads/assessment_guide_for_educators_science.pdf Authority Tier:
TIER_1_OFFICIAL| License:PROPRIETARY_SPEC| SHA-256:65143c24a2910e2f...
Assessment_Guide_For_Educators_Science (Page 24)
24 Assessment Guide for Educators: Science Chapter 3: The Development Cycle of a Short Answer Item automated engine replicates human scoring and is then used to score items on the operational tests, ensuring that test-takers are not only measured on their demonstration of higher-order thinking skills, but that they also receive feedback on their test scores as quickly as possible. Short Answer Scoring Process
- First Stage: Scoring Guide Development – Test developers create a scoring guide for each item which lists all the possible correct answers
- Second Stage: Rangefinding – Exemplars, or optimal sample responses for each score point, are pulled from the pool of test-taker responses from field-testing – The SA scoring guides may be updated to incorporate additional answers or common phrasings based on the test-taker responses during the field test – The scoring guides are used with the exemplars to train human scorers – The scoring guides and exemplars are used to train the automated scoring engine