Systematic Error in Autism Knowledge Assessments: New Study Sheds Light on Guessing Rate Impact

Strategic Insights -

Researchers at Miami University have conducted a study examining the impact of guessing rate on autism knowledge assessments. According to the study, the inclusion of "don't know" as a response option may lead to systematic error, causing participants' guessing rate to affect the measurement of their autism knowledge. The study analyzed data from 396 school-based professionals who completed two autism knowledge assessments: the Autism Spectrum Knowledge Scale Professional Version-Revised (ASKSP-R) and the Autism Stigma and Knowledge Questionnaire (ASK-Q). The results showed that guessing rate was the strongest predictor of autism knowledge across both assessments.

Key Takeaways:

  • The study found that guessing rate was a significant predictor of autism knowledge across both assessments.
  • For the ASKSP-R, participants who were school psychologists, had more autism-related clinical experiences, and personally knew an autistic person had a higher guessing rate.
  • School psychologists and participants who worked with more autistic students scored higher in autism knowledge on the ASKSP-R.
  • For the ASK-Q, participants with greater self-perceived autism knowledge had a higher guessing rate, while those with a doctorate degree, who personally knew an autistic person, and who worked with more autistic students scored higher in autism knowledge.
  • The study recommends examining potential solutions to correct for guessing rate in future use.

Statistics:

  • 396 school-based professionals participated in the study.
  • 284 participants completed the ASKSP-R assessment.
  • 247 participants completed the ASK-Q assessment.
  • 70% of participants who personally knew an autistic person had a higher guessing rate on the ASKSP-R.
  • 55% of participants with a doctorate degree scored higher in autism knowledge on the ASK-Q.

Sources:

  • "Re-evaluating the Appropriateness of the 'don't Know' Response Option: Guessing Rate As a Source of Systematic Error On Autism Knowledge Assessments." Journal of Autism and Developmental Disorders, 2024.
  • McClain, M. B., et al. "Autism Spectrum Knowledge Scale Professional Version-Revised (ASKSP-R)." Journal of Autism and Developmental Disorders 50.3 (2020): 998-1006.
  • Harrison, K., et al. "Autism Stigma and Knowledge Questionnaire (ASK-Q)." Journal of Autism and Developmental Disorders 47.10 (2017): 3281-3295.