海角黑料

Speaker's Name: Kevin Pimbblet
Speaker's Affiliation: School of Digital and Physical Sciences, University of Hull
Speaker's Research Theme(s): Teaching and Learning in Maths Higher Education,
Abstract:
Is education as we know it dead? Released in November 2022, ChatGPT is now regularly being used by students and instructors alike for a variety of different purposes within academia. Recent releases of ChatGPT and its analogues have shown incredible promise to scale and be able to pass elements of degree courses. In this talk, we will show our results of applying ChatGPT to an entire Physics BSc degree and how it achieves a (caveated) pass at a 2:1 standard. If it were not for laboratories (or performances in other disciplines), the implementation of invigilated exams, and vivas, it could achieve this outcome undetected. In general, coding tasks are performed exceptionally well, along with simple single-step solution problems. Multiple step problems and longer prose are generally poorer along with interdisciplinary problems, although there are ways to coax better performance. We strongly suggest that there is now a necessity to urgently re-think and revise assessment practice in physics (and other disciplines) due to the existence of AI such as GPT-4. We will describe its current form and limitations and predict what the future might hold including consideration of how AI can be embedded within the disciplinary context using a two lane approach.

Venue: Physics C27