Developing AI Literacy Assessments for Non-Technical Individuals: A Critical Need

Strategic Insights -

A new research study by University of South Alabama has emphasized the need for developing and validating assessment tools to measure AI literacy among non-technical individuals, particularly teachers. The study found that pre- and in-service teachers have a moderate level of AI literacy, with in-service teachers performing slightly better than pre-service teachers. However, the results also indicate that teachers may possess an ambiguous understanding of certain AI concepts.

Key Takeaways:

  • The global economic impact of AI is expected to reach $15.7 trillion by 2030, making AI literacy a critical skill for non-technical individuals.
  • The study developed and validated an assessment tool for measuring AI literacy among non-technical individuals, using a well-established AI literacy framework.
  • The assessment tool comprises 25 objective-based items, reduced from an originally 31-item assessment, and was validated using statistical methodology.
  • Pre- and in-service teachers have a moderate level of AI literacy, with in-service teachers performing slightly better than pre-service teachers.
  • Teachers may possess an ambiguous understanding of certain AI concepts, as indicated by inconsistent answers across various AI concepts.
  • The study highlights the need for assessing AI literacy among non-technical individuals using objective and reliable metrics.
  • Lu Ding, Sohee Kim, and R. Allan Allday are the authors of the study, which was published in the journal Contemporary Educational Technology.

Statistics:

  • 196 responses were collected from pre- and in-service teachers in the United States.
  • 186 responses were included in the analysis to validate the assessment.
  • The assessment tool comprises 25 objective-based items.
  • The global economic impact of AI is expected to reach $15.7 trillion by 2030.
  • Pre- and in-service teachers have a moderate level of AI literacy.

Sources:

  • Development of an AI literacy assessment for non-technical individuals: What do teachers know?. Contemporary Educational Technology, 2024,16(3).
  • ORCID information for the authors: Lu Ding (orcid.org/0000-0002-1454-1532), Sohee Kim (orcid.org/0000-0002-7460-9412), R. Allan Allday (orcid.org/0000-0003-2311-5620).