{"id":1056,"date":"2019-01-30T09:46:03","date_gmt":"2019-01-30T09:46:03","guid":{"rendered":"http:\/\/www.proftesting.com\/blog\/?p=1056"},"modified":"2019-01-29T22:18:33","modified_gmt":"2019-01-29T22:18:33","slug":"delphi-method","status":"publish","type":"post","link":"https:\/\/www.proftesting.com\/blog\/2019\/01\/30\/delphi-method\/","title":{"rendered":"Conducting a Revalidation Job Analysis: How the Delphi Method May Prove Useful"},"content":{"rendered":"\n

Let us begin by defining the Delphi\nMethod for collecting data.  The Delphi\nMethod involves creating a questionnaire, administering it to a panel of\nstakeholders, soliciting feedback, updating the questionnaire based on the\nfeedback, and sending it out again, as illustrated below.  This iterative process may go for 2, 3, or\nmore rounds until consensus is obtained.<\/p>\n\n\n\n

\"Delphi<\/figure>\n\n\n\n

For example, let\u2019s pretend we were trying\nto identify the Top 10 best burger places in a specific city.  In our Round 1 questionnaire we might ask\nindividuals to name their Top 10 favorite burger places.  We would consolidate that feedback into a list\nof the most common places given by our stakeholders (let\u2019s pretend that there\nwere 15 places common across all stakeholder responses).  Then, our Round 2 questionnaire might ask\nthese same individuals to rank order the 15 burger places from best to\nworst.  For Round 2, we would look at the\nresponse options from all stakeholders and rank the burger places based on a\nconsolidation of all responses, hopefully eliminating the bottom 5\nrestaurants.  In our Round 3\nquestionnaire we would provide the Top 10 list of burger places ranked in order\nand ask individual to adjust the ranking, as necessary.  For example, the majority of our respondents\nmight be fine with our top two burger places, but might feel strongly that 3\nand 4 need to be swapped.  At this point\nwe should be nearing consensus, but if not, we would continue administering questionnaires\nuntil we have reached consensus.<\/p>\n\n\n\n

Now, how does this apply to a Job Analysis?  One could use this method to revalidate an existing job\/task analysis when a face-to-face focus group isn\u2019t feasible (either due to financial or geographical constraints).  In this instance, the existing job\/task analysis could be turned into a questionnaire.  For Round 1, we would present the existing job\/task analysis and ask our stakeholders if the current list of domains and subdomains is complete as-is, or if each should be updated (i.e., should content be added, removed, or changed).  If anything should be updated, how should it be updated?  The job analyst would consolidate all feedback and administer a Round 2 questionnaire asking the same questions.  Are the domains and subdomains fine as-is, or should they be updated?  And if so, how?  This process would continue until consensus is reached, as illustrated below.<\/p>\n\n\n\n

\"Delphi<\/figure>\n\n\n\n

Should you decide to utilize the Delphi\nMethod for a job\/task analysis revalidation, there are some additional\nconsiderations:<\/p>\n\n\n\n