Artificial Intelligence in Teaching & Learning

How can we effectively assess student learning in the age of artificial intelligence? Researchers have actually been working on this question for some time. In this presentation, Dr. Phillip Dawson considers "generative artificial intelligence in the context of future-authentic assessment, a way of assessing that considers both current and future realities of a discipline. With tools like ChatGPT now a part of life, work and civic engagement, should capability with these tools be considered a learning outcome in and of itself?"

The following advice is summarized from CRADLE Suggests...Assessment and genAI (Deakin University, 2023). See more guidance on assessment in the Assessment for Learning LibGuide.

Designing Effective Assessments

• Use high stakes assessment when it matters most.
• Use formative assessment (improvement focused feedback) to help students learn.
• Support students to develop metacognitive skills and evaluative judgement.
• Use principles of Universal Design for Learning (UDL) to make assessments more equitable.
• Gather evidence that learning outcomes are being met through sequences of tasks.

Adapting Existing Assessments

• Talk about AI with students.
• Revise rubrics and assessment criteria to focus on higher-level thinking skills.
• Be explicit about when it is and is not appropriate to use AI.
• Give students the opportunity to demonstrate originality.
• Devote time to developing and assessing digital literacy.

The assessment structure outlined below was adapted from an intro-level history course. The format can be used in a variety of course and discipline settings. In responding to AI, many useful strategies are actually old ones:

• build relationships with (and among) students,
• scaffold larger assignments so they are broken down into their component tasks,
• build in opportunities for formative feedback from both peers and the instructor,
• connect the assessment to real examples and applications,
• align learning activities with assessments and learning outcomes.

Integrating learning activities and assessments with formative feedback

Start by discussing the goals of the assignment with students. Why are you asking them to do this work? How will their efforts be rewarded both in and outside the classroom?

Use active learning strategies to explore ideas with students and start building component skills.

Provide opportunities for peer-based discussion and real-time feedback.

Employ collaborative decision-making tasks with instructor-facilitated discussion and debrief.

Repeat the above processes with new inputs so that students have the opportunity to practice/master key skills.

Create structured outputs (e.g., worksheets, templates) to guide students toward an acceptable end product which can be used to illustrate achievement of key learning outcomes.

Provide opportunities for students to share drafts and receive feedback. Use the assignment criteria to co-construct a grading rubric with students and then discuss examples and drafts in relation to the rubric.

Celebrate all your/their hard work!