The purpose of this information is to assist writers in preparing well-constructed, multiple-choice items to be used in the CVE certification exam.
This writing guide provides authors with a format for writing consistent and valid questions. Effectively written exam items can measure many kinds of skills and knowledge, from knowledge of simple facts to the ability to analyze, infer, evaluate, and synthesize information. The following general guidelines reflect good item writing practices and should be followed for every item. Also see Sample Items and the Item Checklist.
General
- Avoid measuring trivia or knowledge that is soon outdated or that is not important for the rehabilitation professional to know.
- The knowledge called for should be generally known. Do not use sources that are not readily available or not generally known in the field. Use only nationally-known professional journals or tests directly relevant to the rehabilitation profession. The published reference source must be provide (see reference section).
- Present one idea. Each item should present one, and only one, central idea or problem.
The Stem
- The item should present the problem clearly and completely in no more than 50 words. Include in the stem only the information absolutely necessary to answer the item. Avoid incomplete stems, such as, "A rehabilitation counselor is..." or "A client who has cerebral palsy..." followed by a set of alternatives. Try to end the stem in an action verb whenever possible.
- Present items positively. Constructions such as, "All of the following EXCEPT..." or "Which of the following are NOT..." are unacceptable.
The Alternatives
- There should be one and only one clearly correct answer. Where there is a possibility of philosophical disagreement or where one or more alternatives could be considered at least partially correct, or where several variables might be important in differing degrees, it is safest to ask "Which of the following best accomplishes the goal..." or "Which of the following is the most important consideration..." rather than "An important consideration ..."
- The correct answer should not be an expression of opinion. When referring to the work of a well-known expert in the field, use terms like "According to Super..." or "Holland's theory
maintains that..."
- Provide four alternatives for each item. They should be parallel in form and structure as well as in content. They should not be a series of unrelated statements.
- Do not use "all of the above" or "none of the above" as an alternative.
- Incorrect alternatives should be logical and feasible rather than highly unlikely or obviously wrong. They should not be capable of being eliminated automatically by someone who does not know the material.
- Alternatives must be grammatically consistent with the stem. Watch tenses, plurals vs. singulars, nouns vs. verbs or participles, and a, an, usage before vowels and consonants.
- Do not make correct responses longer or more technical than the other in a given item, although it is acceptable to have pairs of the same approximate length - i.e. two long, two short.
References
- Only widely known and readily available references may be used as source material for
items. Referenced studies should generally be considered authoritative, with findings that are generalizable.
- References must clearly support the correct answer.
- Attach a photocopy of the referenced source, and provide all the necessary bibliographic information:
- Author's name(s)
- Year of publication (or copyright date for a book)
- Title of article or book
- For journals, name of journal, volume number and page number(s)
- For books, page number(s)
- For books, name of publisher and city of publication
- Examples
Bolton, B.F. (2001). Handbook of measurement and evaluation in rehabilitation (3rd ed.). Gaithersburg, MD: Aspen Publishers. pp 94-18.
Dowd, L.R. (Ed). (1993). Glossary of terminology for vocational assessment, evaluation and work adjustment. Menomonie, WI: University of Wisconsin-Stout, Materials Development Center. pp. 176-178.
|