Test Assembly

Stochastic Programming for Individualized Test Assembly With Mixture Response Time Models (RR 15-01)

by Bernard P. Veldkamp and Marianna Avetisyan, University of Twente, Enschede, the Netherlands

Many standardized tests are now administered via computer rather than paper and pencil. The computer-based delivery mode brings with it certain advantages, such as the ability to record not only the test taker해외 카지노 추천™s response to each item (i.e., question), but also the amount of time the test taker spends considering and answering each item. The analysis of response times (RTs) is still a developing area of research.

Early RT research assumed that a test taker would show consistent RTs over the course of a test. Such models may be unrealistic for various reasons해외 카지노 추천”some items require more time than others to answer, a warm-up effect may cause a test taker to respond more quickly after completing the early items, fatigue may cause a test taker to slow down toward the end of a test, or as time runs out the test taker may quickly guess the answers to the last items on a test. To take these variable RTs into account, mixture RT models have recently been investigated.

Until now, mixture RT models have only been applied for post hoc analyses. This research expands the use of these models by exploring their application in the context of test assembly. Various strategies were applied and the strengths and weaknesses of each described. In general, it was concluded that the application of mixture RT models should prove especially useful for tests with a heterogeneous testing population.

Back to report gallery

Request the full report

Additional reports in this collection

Robust Text Similarity and Its Applications for the LSAT...

Text similarity measurement provides a rich source of information and is increasingly being used in the development of new educational and psychological applications. However, due to the high-stakes nature of educational and psychological testing, it is imperative that a text similarity measure be stable (or robust) to avoid uncertainty in the data. The present research was sparked by this requirement. First, multiple sources of uncertainty that may affect the computation of semantic similarity between two texts are enumerated.

Read More

Applications of Uniform Test Assembly for the LSAT...

In a large-scaled high-stakes testing program such as the Law School Admission Test (LSAT), it is necessary to maintain a large bank of test items to support the demand for a new test form at nearly every administration. To assure that the item bank can support the test assembly requirements, ongoing monitoring of the quality of the item bank is necessary to identify deficiencies and direct item development efforts.

Read More