{"id":31,"date":"2015-04-29T18:00:00","date_gmt":"2015-04-29T18:00:00","guid":{"rendered":"http:\/\/proftesting.com\/blog\/?p=31"},"modified":"2016-01-29T14:23:26","modified_gmt":"2016-01-29T14:23:26","slug":"2015429careful-selection-of-subject-matter-experts-is-the-key-to-a-successful-jta-meeting","status":"publish","type":"post","link":"https:\/\/www.proftesting.com\/blog\/2015\/04\/29\/2015429careful-selection-of-subject-matter-experts-is-the-key-to-a-successful-jta-meeting\/","title":{"rendered":"Careful Selection of Subject Matter Experts is the Key to a Successful JTA Meeting"},"content":{"rendered":"<p>A job\/task analysis is (JTA) is a very close look at a job, portion of a job, or concept job in order to identify the tasks and associated knowledge, skills and abilities (KSAs) required to competently perform the job.\u00a0 A JTA is the foundation for the development of a certification program or a certificate program.\u00a0 Only after the KSAs have been identified can a certification body or educational program determine how to measure competence of the KSAs or how to teach the KSAs.\u00a0 There are multiple methods for conducting a JTA including using focus groups, structured interviews, job shadowing and observations, and surveying practitioners.\u00a0 When conducting a JTA as the basis for a certification program, the method used is not as important as making sure the right subject-matter-experts (SMEs) participate in the process.<\/p>\n<p>Professional Testing frequently utilizes a modified DACUM approach.\u00a0 DACUM stands for <strong>D<\/strong>eveloping <strong>A<\/strong> <strong>C<\/strong>urricul<strong>UM<\/strong> and is a structured, consensus-based focus group process where a group of expert practitioners, led by a trained facilitator, identify tasks associated with a job over the course of three days.\u00a0 Professional Testing uses a modified version of the DACUM process that identifies the knowledge and skills associated with each task at the same meeting.\u00a0 This process has been referred to as \u201cTurbo DACUM\u201d by some users, including Ferris State University and the National Occupational Testing Institute (NOCTI).<\/p>\n<p>The key to a successful DACUM JTA meeting is predicated upon the careful selection of a representative sample of SMEs.\u00a0 Failure to select the right SMEs for the meeting can result in a failure of the JTA to identify the right tasks and associated KSAs, or a lack of consensus.\u00a0 Several dimensions should be considered by certification bodies or organizations selecting SMEs to participate in a JTA.\u00a0 These dimensions include number of SMEs, expertise of SMEs, occupation of SMEs, years of experience of SMEs, and personality of SMEs.\u00a0 Each of these will be further explored.<\/p>\n<p>The number of SMEs selected to serve on a JTA panel is important.\u00a0 The optimum number is somewhere between 10 and 15 SMEs with a minimum of about 7 or 8, and a maximum of about 17 or 18.\u00a0 Size considerations should be based on the smallest number of SMEs that can adequately represent the depth and breadth of the job being defined.\u00a0 Less than about 7 or 8 and the panel probably will not be able to sufficiently identify all of the tasks and associated KSAs with doing the job.\u00a0 More than about 17 or 18 and the group sometimes becomes unwieldy.\u00a0 I have successfully facilitated a JTA meeting with 22 members, but nearly failed completing a JTA meeting with 30 SMEs.\u00a0 The JTA with 30 SMEs proceeded very slowly as each SMEs wanted to voice his or her opinion and it took much more effort to reach consensus with so many varying opinions in the room.\u00a0 This was a case of \u201ctoo much of a good thing\u201d was in fact not good.<\/p>\n<p>The careful consideration of the expertise of SMEs is also critical when selecting a JTA panel.\u00a0 Having the world\u2019s best expert in a particular field can be good, or it can be bad.\u00a0 It is always good to have tremendous expertise on a JTA panel, but sometimes the world\u2019s best expert can take control of the meeting while the remainder of the SMEs sit back and say nothing.\u00a0 I have also facilitated a meeting where two of the world\u2019s best experts disagreed and had to leave the room to work it out among themselves before the meeting could progress.\u00a0 Rather than selecting the world\u2019s best expert, what is most important is that the SMEs represent the depth and breadth of expertise.\u00a0 But if famous, experts are selected, the facilitator needs to be strong enough to ensure that the expert doesn\u2019t dominate the meeting and all of the SMEs have an opportunity to contribute equally.<\/p>\n<p>Normally SMEs seated for a JTA are practicing experts.\u00a0 That means they currently or recently performed the job.\u00a0 However, there are situations where others can contribute to the JTA.\u00a0 For example, sometimes trainers\/educators can offer perspectives that practitioners don\u2019t think about.\u00a0 And often researchers and regulators bring another dimension to a JTA focus group, but the majority of the SMEs should be practitioners.<\/p>\n<p>All experts selected for a JTA focus group should be familiar with the job and competent on the job.\u00a0 However, a competent new worker may have a different perspective of the job, the tasks and the associated KSAs than a worker who has 25 years of experience on the job.\u00a0 Additionally, a newer worker may be more familiar with trends and technologies, so it\u2019s important to be sure the JTA focus group is comprised of a cross-section of job incumbents.<\/p>\n<p>Finally, JTA focus groups can be derailed by SMEs with ulterior motives or challenging personalities!\u00a0 I have facilitated a meeting where several SMEs participated only because they wanted the process to fail.\u00a0 In another case, I have facilitated a JTA where a SME was only interested in \u201cstealing\u201d the results of the JTA for his own use.\u00a0 Thus it is important that each SME is carefully selected to be sure they are participating for the right reasons.\u00a0 And it is important that a strong and experienced facilitator be present to hold back domineering SMEs and encourage the participation of quiet SMEs.<\/p>\n<p>Certification bodies and organizations selecting experts for a JTA focus group should thoughtfully select each participant based on some of the dimensions listed above.\u00a0 Testing companies such as Professional Testing and expert, trained JTA facilitators can assist organizations in seating the best panel possible for the JTA.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A job\/task analysis is (JTA) is a very close look at a job, portion of a job, or concept job in order to identify the tasks and associated knowledge, skills and abilities (KSAs) required to competently perform the job.&nbsp; A JTA is the foundation for the development of a certification program or a certificate program.&nbsp; Only after the KSAs have been identified can a certification body or educational program determine how to measure competence of the KSAs or how to teach the KSAs.&nbsp; There are multiple methods for conducting a JTA including using focus groups, structured interviews, job shadowing and observations, and surveying practitioners.&nbsp; When conducting a JTA as the basis for a certification program, the method used is not as important as making sure the right subject-matter-experts (SMEs) participate in the process.&nbsp;<\/p>","protected":false},"author":12,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[10,18,17,13,16],"class_list":["post-31","post","type-post","status-publish","format-standard","hentry","category-industry-news","tag-certification","tag-dacum","tag-job-task-analysis","tag-professional-testing","tag-subject-matter-expert"],"_links":{"self":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/31","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/comments?post=31"}],"version-history":[{"count":1,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/31\/revisions"}],"predecessor-version":[{"id":139,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/posts\/31\/revisions\/139"}],"wp:attachment":[{"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/media?parent=31"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/categories?post=31"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.proftesting.com\/blog\/wp-json\/wp\/v2\/tags?post=31"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}