ISO\/IEC 17024: Conformity Assessment \u2013 General requirements for bodies operating certification of persons was originally published by the International Organization for Standardization (ISO) in 2003.\u00a0 The standard was revised and republished in 2012.\u00a0 Now that the standard has been around for 13 years, what has been the success (or not) of implementation of the standard around the world?<\/p>\n
The International Accreditation Forum (IAF) is a body comprised of Accreditation Bodies (ABs) such as the American National Standards Institute (ANSI).\u00a0 IAF deals with implementation issues associated with standards as well as determining when there is a need for a guidance document associated with the implementation of a standard.\u00a0 For example, ISO\/IEC 17024:2003 had an IAF guidance document associated with it, IAF GD24.\u00a0 Since the 2012 version of ISO\/IEC 17024 has been implemented, the former guidance document was eliminated as many of the guidance concepts were incorporated into the 2012 version of the standard.\u00a0 IAF established a 3 year implementation period so accredited CBs had to be operating under the 2012 version by 2015.<\/p>\n
In 2016, knowing all CBs had to have implemented the 2012 version, IAF conducted an ISO\/IEC 17024 implementation survey to identify any difficulties or issues certification bodies (CBs) and ABs were having with the 2012 version.\u00a0 ABs and CBs from 51 different countries responded to the survey with 56 ABs indicating they had accredited one or more CBs to ISO\/IEC 17024:2012.\u00a0 Ten ABs indicated they had not yet accredited any CBs to ISO\/IEC 17024: 2012.<\/p>\n
The implementation survey identified that ABs were having the most difficulty with clause 8 (certification schemes) and clause 9 (certification processes) of ISO\/IEC 17024 while CBs were having the most difficulty with clause 4 (general requirements).\u00a0 This is an interesting finding but consistent with what I have personally experienced when conducting ISO\/IEC 17024 workshops for AB Assessors all over the world.\u00a0 In many parts of the world, the concepts of measurement and psychometrics are not as familiar as they are in the US. \u00a0And measurement and psychometrics are mostly contained in clauses 8 and 9 of the standard.<\/p>\n
Certification of persons in some countries has been implemented by educational institutions, employers and other inappropriate bodies and sometimes based on qualifications (education only or experience only) instead of demonstrated competence (knowledge and skills to achieve intended results).\u00a0 And it is not uncommon to find that ABs in some countries have accredited CBs who have not followed a valid and acceptable process for developing their schemes.\u00a0 Not understanding that the knowledge and skills being measured by the certification program should be related to a job as demonstrated through a Job\/Task Analysis (JTA), some of these programs are based on the \u201copinion\u201d of one or two experts as to what should be measured by the certification program.\u00a0 Frequently, outside of the US, the CBs and ABs have never even heard of a JTA or Practice Analysis.<\/p>\n
Other areas where lack of understanding is frequent include not having any kind of an examination blueprint (thus no ability to ensure consistent content when creating the exam forms), no evidence of any kind of passing or cut score standard being set (random pass standards of 75 percent are still the norm in many places in the world), no evidence of any kind of an examination analysis or item analysis being conducted, and no evidence of any examination security being in place.<\/p>\n
I can remember sitting on one international meeting and talking about evaluating examination forms by conducting examination analyses and item analyses and looking at the statistics associated with the overall exam and the specific test items and their distractors, and being told, \u201cWell that\u2019s how you do it in the US.\u00a0 We don\u2019t do it that way over here in Europe.\u201d\u00a0 When asked how they did it, I was told the professor who developed the exam simply looked at it and determined it was fine.\u00a0 That was how they did it.<\/p>\n
Standardization is a process.\u00a0 The world has taken some baby steps towards standardization since ISO\/IEC 17024:2003 was launched.\u00a0 We now have most ABs and CBs understanding that awarding a certification only based on completion of education or work experience without any kind of an assessment of knowledge and skills is not acceptable.\u00a0 That is a big step for most of the world.<\/p>\n
But we still have a long way to go.\u00a0 As ISO\/IEC 17024 matures and we orient more of the world to the standard and what the clauses mean, we can expect that ABs and CBs around the world will become more familiar with the meaning of the clauses in ISO\/IEC 17024 and thus more standardized in what they are accepting and accrediting.\u00a0 It is incumbent on those of us familiar with best measurement practices to share the word with the rest of the world.\u00a0\u00a0 Presenting at international conferences and other venues helps to promote an understanding of measurement practices.<\/p>\n
Only when the world is looking at ISO\/IEC 17024 and seeing the clauses in the same way and understanding the meaning behind the clauses in the same way, will we have true standardization.<\/p>\n","protected":false},"excerpt":{"rendered":"ISO\/IEC 17024: Conformity Assessment \u2013 General requirements for bodies operating certification of persons was originally published by the International Organization for Standardization (ISO) in 2003.\u00a0 The standard was revised and republished in 2012.\u00a0 Now that the standard has been around for 13 years, what has been the success (or not) of implementation of the standard… View Article<\/a>","protected":false},"author":12,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41],"tags":[74,48,63,75],"class_list":["post-676","post","type-post","status-publish","format-standard","hentry","category-regulatory-power","tag-isoiec","tag-isoiec-17024","tag-jta","tag-standardization"],"_links":{"self":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/676","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/comments?post=676"}],"version-history":[{"count":1,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/676\/revisions"}],"predecessor-version":[{"id":677,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/676\/revisions\/677"}],"wp:attachment":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/media?parent=676"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/categories?post=676"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/tags?post=676"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}