Cambridge study reveals ‘telltale signs’ of AI essays
ChatGPT performed poorly on analysis and comparison skills compared to humans, according to a new report
A new study by Cambridge researchers has identified the “key features” of AI-written essays, as faculties rush to clarify their policies ahead of exam season.
The study, conducted by Cambridge University Press and Assessment, compared ChatGPT assisted essays written by three university students to 164 GCSE essays.
The AI essays contained “telltale” signs including repetition of words and phrases, starting paragraphs with ‘however’, ‘overall’ or ‘moreover’, and use of numbered lists and latinate vocabulary.
The study also found ChatGPT assisted work performed poorly on analysis and comparison skills. It performed well on information and reflection skills.
This study comes as university departments rush to clarify AI usage policy during exam season. Cambridge currently has a total ban on the use of AI technology in assessed work, treating it as academic misconduct, but use guidance for non-assessed work varies by department.
In recent open letter circulated to all HSPS students, the course’s directors of undergraduate studies stated: “Don’t let genAI rob you of your chance to learn!”
The department, acknowledging that the line of appropriate use was becoming increasingly hard to draw, told students that tools which “actually write or edit your writing for you” are “not appropriate” for use. Tools which alter grammar and spelling are permitted, however.
English students were told earlier this month that AI can be useful for “sketching a bibliography on a given topic” and “assist[ing] early stages of the research process” but this should be done in consultation with their supervisor.
Some engineering students were told that the use of Chat GPT to structure coursework is acceptable, as long as they disclosed that they had used it and included the prompts that they used.
- Comment / The case for handwritten exams10 January 2025
- News / Competitive tiddlywink trio return to celebrate 70th anniversary 13 January 2025
- Features / An investigation into women and sex at Cambridge7 January 2025
- Sport / Netball for net-all: it’s time to take mixed netball seriously13 January 2025
- Comment / Cambridge’s outreach departments deserve some love14 January 2025