Skip to content
Longterm Wiki
Back

Ai Detection Assessment 2025

web

Relevant to AI deployment and governance in educational contexts; largely peripheral to core AI safety topics but touches on evaluation reliability and the gap between AI capabilities and detection methods.

Metadata

Importance: 32/100organizational reportanalysis

Summary

A 2025 update from the UK National Centre for AI on the state of AI detection tools in higher education, reviewing evidence that AI can pass coursework assessments, the limitations of automated detection technology, and the challenges of maintaining academic integrity as AI use policies evolve. The post concludes that detection technology has not meaningfully advanced while AI capabilities have significantly improved.

Key Points

  • AI can trivially pass coursework in at least some subjects without sophisticated prompting, as demonstrated by studies like the 'Turing Test' university exam experiment.
  • No major advances in AI detection technology have occurred since 2023, while AI writing capabilities have grown substantially.
  • The field has shifted away from automated AI detection, leaving institutions relying on human judgment or assessment redesign.
  • AI assessment scales (e.g. traffic-light systems) help guide appropriate use but create new integrity verification challenges.
  • UK JCQ guidance still references AI detection tools as part of a holistic approach to assessing authenticity of student work.

Cited by 1 page

PageTypeQuality
AI-Powered Consensus ManufacturingRisk64.0

Cached Content Preview

HTTP 200Fetched Mar 20, 202627 KB
[Skip to the content](https://nationalcentreforai.jiscinvolve.org/wp/2025/06/24/ai-detection-assessment-2025/#site-content)

Close Menu

![Decorative - a magnifying glass on papers.](https://nationalcentreforai.jiscinvolve.org/wp/files/2025/06/AdobeStock_1203979708-300x168.jpeg)

This blog post is an update to two previous entries that focused on AI detection tools: _‘ [AI Detection: Latest Recommendation](https://nationalcentreforai.jiscinvolve.org/wp/2023/09/18/ai-detection-latest-recommendations/) s’_ (September 2023) and _‘ [AI Writing Detectors – Concepts and Considerations](http://xn--ai%20writing%20detectors%20%20concepts%20and%20considerations-ie32b/)’_ (March 2023). As we look ahead to the next academic year, this feels like an opportune moment to revisit the topic.

The core concepts and conclusions from those earlier posts still stand, but much has changed. There have been significant advances in AI tools since I last wrote on the subject. We now have more evidence of AI’s capability to complete coursework and on the difficulty humans face in detecting its use. However, there have been no major developments in AI detection technology itself.

This update is partly prompted by the rise of AI assessment scales, traffic-light systems and similar tools. These approaches are undoubtedly helpful in supporting students to understand how AI can be used appropriately. Yet, they also present challenges. I’ll use the [assessment scale proposed by Mike Perkins, Leon Furze, Jasper Roe, and Jason MacVaugh](https://aiassessmentscale.com/) as an example, although the same challenges apply to many other approaches, such as ‘amber’ traffic light indicators. In this scale, we have these two levels amongst the five:

- **AI Planning:** _You may use AI for planning, idea development, and research. Your final submission should show how you have developed and refined these ideas._
- **AI Collaboration:** _You may use AI to assist with specific tasks such as drafting text, refining and evaluating your work. You must critically evaluate and modify any AI-generated content you use._

This then leads to the question: how do we ensure integrity in assessments that fall into these categories?

The general mood has shifted decisively away from automated AI detection. However, for many assignments, this leaves us relying solely on human detection – unless the assessment is substantially redesigned.

It’s also worth noting that whilst perhaps AI detection has very limited use in colleges and universities, the [JCQ guidance for colleges](https://www.jcq.org.uk/wp-content/uploads/2025/04/AI-Use-in-Assessments_Apr25_FINAL.pdf) makes several references to AI detection and note:

> _“The use of detection tools, where used, should form part of a holistic approach to considering the authenticity of students’ work; all available information must be considered when reviewing any malpractice concerns.”_

It’s also notable that many of the examples cited by JCQ include the use 

... (truncated, 27 KB total)
Resource ID: d76578865d5d2c15 | Stable ID: MGUyYTM4NW