{"id":30,"date":"2015-05-11T18:00:00","date_gmt":"2015-05-11T18:00:00","guid":{"rendered":"http:\/\/proftesting.com\/blog\/?p=30"},"modified":"2018-02-17T03:48:25","modified_gmt":"2018-02-17T03:48:25","slug":"2015511innovative-item-types-strengths-and-weakness","status":"publish","type":"post","link":"https:\/\/www.proftesting.com\/blog\/2015\/05\/11\/2015511innovative-item-types-strengths-and-weakness\/","title":{"rendered":"Innovative Item Types: Strengths and Weakness"},"content":{"rendered":"

Adrienne Cadle, Ph.D.<\/a> and Cynthia G. Parshall, Ph.D.<\/a><\/p>\n

Do you have multiple choice items that are not accurately assessing the content of an exam?\u00a0 If so you may want to implement innovative items.\u00a0 In our workshop at the 2015 ATP Conference<\/a> we presented four innovative item types, along with when each one should be used.<\/p>\n

The key factor that should be considered before adding an innovative item type is whether it can improve the measurement quality of the exam.\u00a0 The first step in implementing innovative items is choosing the right type.\u00a0 To help guide your decision on which types to implement, it is helpful to have a general understanding of the structure, strengths, and weaknesses of each item type.<\/p>\n

Short Answer Items<\/strong>
\nShort Answer items have a stem that asks the test taker a question and the test taker responds to, or answers, the question by writing or typing a response.\u00a0 This is a constructed-response item type because test takers are constructing their answer.\u00a0 Some of the strengths of this item type are that they are efficient in measuring certain content, they measure recall rather than recognition (as with multiple choice items), and cueing and guessing are largely removed (since the candidate is constructing their response instead of choosing from a list of responses).\u00a0 One weakness of this item type is that it can be difficult for item writers to write stems that are clear, yet avoid cluing; another is that short answer items can be difficult to score automatically (i.e., on a computer-based test) due to the potential variations in responses.<\/p>\n

Audio Items<\/strong>
\nAn Audio item is an item in which test takers listen to audible content, then respond to a question or prompt usually by selecting the correct response from several response options.\u00a0 Some examples of audio sounds include speech sounds, music, physiological sounds, and equipment or machinery.\u00a0 One of the most significant strengths of the Audio item is that it can expand test content into new regions.\u00a0 For example, an item on a medical assessment could include lung or breath sounds to measure auscultation skills, rather than providing a text description of the breath sounds. \u00a0One consistent challenge when adding Audio items is the need to provide alternatives for examinees with hearing disabilities.<\/p>\n

Hotspot Items<\/strong>
\nA Hotspot item is basically a graphical multiple choice item.\u00a0 Test takers answer the question asked of them, or respond to the prompt, by clicking somewhere on an image.\u00a0 In most Hotspot items there is only one right choice.\u00a0 Some of the advantages of this item type are that they are very good for measuring visual content and they may provide better fidelity by allowing the test taker to respond directly on the item (e.g., asking an acupuncturist to click on the location on which he or she would place a needle).\u00a0 Some of the weaknesses of this item type are that they often target only lower cognitive levels (i.e., recall) and they may be difficult to interpret if the images used are poorly sized or ambiguous.<\/p>\n

Drag and Drop Items<\/strong>
\nDrag and Drop items are items in which test takers respond to a question by dragging tokens onto a region.\u00a0 Drag and Drop items are often used for sequencing or ranking\/prioritizing.\u00a0 A strength of Drag and Drop items is that they can often be used to measure higher cognitive levels than traditional multiple choice items (i.e., analysis rather than basic knowledge or recall). \u00a0And for some content areas they can provide a more direct measurement than traditional multiple choice items (e.g., asking a sonographer to label anatomy on an ultrasound image by placing labels directly on the image).\u00a0 One potential weakness of Drag and Drop items are that they can require too much knowledge and\/or time for a single score point. \u00a0Similarly, the interface can be complex for test takers (i.e., it may be difficult for test takers to understand how to respond to the item).<\/p>\n

Summary <\/strong>
\nIn summary, every item type has its own strengths and weaknesses.\u00a0 Whether or not an item type is appropriate for any certification exam depends on the content being assessed on the certification exam.\u00a0 This purpose of this post is to help you choose which innovative item type may improve your certification exam. For more on this topic, see the series “Alternative Item Types<\/a>.”<\/p>\n","protected":false},"excerpt":{"rendered":"

Do you have multiple choice items that are not accurately assessing the content of an exam?  If so you may want to implement innovative items.  In our workshop at the 2015 ATP Conference<\/a> we presented four innovative item types, along with when each one should be used.<\/p>

The key factor that should be considered before adding an innovative item type is whether it can improve the measurement quality of the exam.  The first step in implementing innovative items is choosing the right type.  To help guide your decision on which types to implement, it is helpful to have a general understanding of the structure, strengths, and weaknesses of each item type.<\/p>","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[144,43],"class_list":["post-30","post","type-post","status-publish","format-standard","hentry","category-industry-news","tag-atp18","tag-atp17"],"_links":{"self":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/30","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/comments?post=30"}],"version-history":[{"count":2,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/30\/revisions"}],"predecessor-version":[{"id":936,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/30\/revisions\/936"}],"wp:attachment":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/media?parent=30"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/categories?post=30"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/tags?post=30"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}