Professional Testing, Inc.
Providing High Quality Examination Programs

From the Item Bank

The Professional Testing Blog

 

Archives for Reed Castle, Ph.D.

Tools of the Trade

February 15, 2017  | Published by  | Leave a comment

What is the role of a psychometrician and software in the development and maintenance of a certification examination program? As... View Article





What is Measurement Error and What is its Relationship to Reliability?

October 13, 2016  | Published by  | Leave a comment

When discussing the statistical properties of an exam, one may hear the term “error” or measurement error used by psychometricians.... View Article





The Use of Certification and Licensure Programs in Developing Career Path Models

April 27, 2016  | Published by  | Leave a comment

Over the past few years there has become increasing interest in the number of ISO/IEC 17024 accredited certification bodies certifying... View Article





Equating Test Forms for Fairness

November 5, 2015  | Published by  | 1 Comment

Co-authored by: Reed Castle, Ph.D. and Vincent Lima

Certification examination programs often have more than one examination form (set of questions, or items) in use at a time, and they require routine updates. The exam forms represent the same content, but have different items. As new items come into use, they may be easier or harder than the first set of items. As a result, exam forms can have varying degrees of difficulty. These variations need to be taken into account when reporting scores and pass/fail decisions over time and exam forms.





Testing Essentials: Scoring QC

September 17, 2015  | Published by  | Leave a comment

Reed Castle, Ph.D.

The primary goal of any testing program is to treat test takers in a fair and equitable manner and to assure that inferences made from an exam score are appropriate. To do so, one component is to maintain proper scoring and reporting procedures. 





Reliability and Decision Consistency

August 12, 2015  | Published by  | Leave a comment

There are many philosophical debates as to what constitutes validity or the validity of test score inferences. Within certification we hear things like “a job analysis is typically conducted every five years unless the content changes more or less frequently.” You may have also heard that more than eight SMEs are required for test development activities, while others suggest six or more is sufficient. Some suggest that SMEs should not overlap with separate test development meetings.  So in essence psychometricians will typically say “it depends” in response to questions about the appropriate way to design a certification examination program.





Computer Adaptive Testing: An Overview and Considerations

June 24, 2015  | Published by  | 1 Comment

Computer Adaptive Testing (CAT) is a testing methodology that weds two processes—adaptive testing and computer administration—for efficient measurement and administration. When compared to fixed length exams delivered linearly on a computer, CAT exams measure a candidate’s ability with fewer delivered exam questions and higher precision. By precision, it is suggested that error is reduced and reliability is increased. 





Transitioning an Exam Program in the Modern Age

April 1, 2015  | Published by  | Leave a comment

Transitioning an exam program from paper to computer-based administrations may appear to be a very straightforward process but there are a variety of variables to consider when a sponsor is making this decision.