Portal Assessment Design System for Educational Testing

摘要

A Portal Assessment Design System includes a system for designing assessment models and assessments (e.g., standardized tests). In assessment design, specifications are organized around three basic elements: 1) what knowledge, skill or abilities are important to measure; 2) what is necessary evidence of that knowledge, skill or ability; 3) what performance situations are needed to elicit the required evidence from students and other assessment users. The system includes three modules (i.e., Domain Analysis, Domain Modeling, Conceptual Assessment Framework), each of which targets a specific phase of the design process, for designing an assessment in accordance with the three basic elements. The sequence of modules represents the structure of a design process that helps assessment developers work through successive stages or phases of assessment design, from the gathering of raw information to the creation of a complete set of specifications for an assessment product. Each module has its own set of objects for organizing information, such as knowledge skills and abilities of interest of the students being tested, evidence of these, and situations structured to elicit this evidence. The modules and objects of the system are implemented as a software application executing in a client-server environment.

主权项

1. A computer-implemented method of designing an assessment, the method comprising:
generating one or more trifles using a processing system, each trifle being based on subject matter information or requirements information, wherein a trifle provides a reference to a source of the subject matter information or the requirements information on which the trifle is based for subsequent access to the source, wherein the subject matter information is related to one or more subject matters of an assessment, and wherein the requirements information is related to one or more requirements for the assessment; generating one or more task models using the processing system, each task model (i) defining features of a group of tasks having similar content and response requirements, and (ii) being based on at least one trifle of the one or more trifles; and generating one or more tasks using the processing system, wherein each task is based on at least one task model of the one or more task models, and wherein the one or more tasks are included in the assessment.