Piloting Assessment Design, User Interface, and Instructions for Innovative Reading and Listening Item Types

8:15 - 9:45am

Grand Hall CD

Presented at: American Association for Applied Linguistics 2013 Conference

This poster presents research undertaken to pilot the overall design, user interface, and examinee instructions for a computer-delivered diagnostic assessment featuring innovative reading and listening item types. It focuses on the three-step process used to refine the instructions for unfamiliar item types to ensure the efficacy and validity of the assessment. Introspective data collection techniques were employed to investigate examinee thought processes while completing the assessment. The poster describes the think aloud and cognitive laboratory methodology and results, including trends in participant feedback regarding balancing thoroughness and clarity with considerations of design in presentation of instructions and action buttons.