Standard Setting: A Review of Methods

Abstract

In the field of education and assessment, cutoff scores are often used to distinguish between levels of achievement on a particular test or assessment. Standard setting is the process of establishing these cutoff scores, which are used to determine passing or failing grades, determine eligibility for certain programs, or identify individuals who may need additional support or intervention. Arbitrary cutoff scores are frequently utilized in many nations and institutions, and most commonly is the 60 % threshold. However, are students scoring around 60% considered competent and proficient? Is this passing threshold acceptable in professions where graduates will be treating and managing patients like Medicine and Dentistry? When implementing standard-setting techniques and when determining the right cutoff point, all of these issues need to be taken into consideration. Rather than using an arbitrary cutoff score of 60% as the passing level, it must be based on a methodical approach that adheres to a scientific technique with a history of validity and reliability. There are many methods which can be used to determine the cut off scores for different examinations. These can be based on judgements of borderline test takers, and these include for examples: Angoff, Nedelsky, and yes and no methods. In general, these methods depend on judges to determine characteristics of certain students who are defined as borderline, where judges evaluate test items before the examination, and assign numerical values for each item based on their belief whether these borderline students can answer these question items or not. Other methods may depend on judgements of examinees. These may include: borderline group, or contrasting group methods. These methods depend on the actual information about individual test takers including their test score and their level of knowledge and skills. Other methods to mention include: bookmark method, body of work, and compromise method.