search
HomeTechnology peripheralsAIA new detection tool that can identify scientific texts generated by AI is released, claiming an accuracy rate of over 99%

IT House News on June 8th: Earlier this year, Som Biswas, a radiologist at the Tennessee Health Science Center in the United States, attracted attention because he published an article in the journal Radiology powered by the artificial intelligence chatbot ChatGPT. Assisted in writing an article titled "ChatGPT and the Future of Medical Writing." He expressed his use and modification of ChatGPT-generated text in an effort to raise awareness of the utility of the technology. According to him, he published 16 journal articles using ChatGPT over the next four months. Some journal editors report that they receive a large number of articles authored by ChatGPT.

A new detection tool that can identify scientific texts generated by AI is released, claiming an accuracy rate of over 99%

In order to deal with this situation, Heather Desaire, a professor of chemistry at the University of Kansas, and her team developed a new AI detection tool that can efficiently and accurately distinguish whether scientific texts are generated by humans or ChatGPT. Their research results were published In the journal Cell Reports Physical Science.

Professor Desaire said she and her team first analyzed 64 "Perspectives" articles in the journal Science, which are review articles that review and evaluate current research. Next, they analyzed 128 articles generated by ChatGPT on the same research topic. They compared the two and found 20 features that could be used to determine the identity of the author of a scientific text.

They found that human scientists and ChatGPT differed significantly in paragraph complexity, sentence length, punctuation, and vocabulary usage. Compared to symbols such as brackets, dashes, question marks, semicolons, and capital letters, ChatGPT uses them less often, while human scientists use them more. Human scientists are more likely to use vague language such as “however,” “although,” “but,” etc. ChatGPT tends to have a relatively even distribution of sentence length, while human scientists may use both short and long sentences in their writing..

Based on these 20 features, they used a ready-made machine learning algorithm XGBoost to train their AI detection tool. They tested the performance of their AI detection tool on 180 articles and found that it was very good at judging an Whether this scientific article was written by a human or ChatGPT. "This method has an accuracy of over 99%," Professor Desaire said, adding that it was much better than existing tools, which are trained on a wider range of text types rather than specifically For scientific texts.

Professor Desaire said that this AI detection tool can help journal editors deal with a large number of articles written using ChatGPT, allowing them to prioritize which articles are worthy of review. She added that the tool could be adapted for different areas, such as detecting plagiarism in students, as long as it was trained on the appropriate language. Once you identify useful features, you can adapt it for any domain you want. ”

IT House noticed that not everyone thinks this AI detection tool is of great use. Dr Vitomir Kovanović from the Center for Change and Complexity Learning (C3L) at the University of South Australia said the comparison made by Professor Desaire and her team was unrealistic because they only compared 100% AI-generated and 100% human-generated text without taking into account collaboration between humans and AI. He said that when scientists use ChatGPT, there is often some degree of human-machine collaboration, such as the scientist editing the AI-generated text. Rewritten sentence: This is necessary because ChatGPT can occasionally make errors and even generate false references. But because the researchers only compared two extreme cases, their success rate was improved.

Dr. Lingqiao Liu of the University of Adelaide’s Machine Learning Institute also believes that in the real world, the accuracy of such AI detection tools may be reduced, leading to more misclassifications. Dr. Liu, an expert in developing algorithms to detect AI-generated images, said: "Methodologically, this is fine, but there are certain risks in using it."

On the other hand, Dr. Liu pointed out that it is also possible for people to instruct ChatGPT to write in a specific way, so that 100% text written by AI will pass detection. In fact, some commentators have even spoken of an “arms race,” referring to the competition between those trying to make machines more human-like and those seeking to expose those using the technology for nefarious purposes.

Dr Kovanović believes the competition is pointless given the technology’s momentum and potential positive impact. He suggested that AI detection has not yet reached a critical point, so we should invest our energy in making better use of AI. He opposes the use of anti-plagiarism software to measure whether college students use AI in their writing, arguing that it would put unnecessary pressure on students.

The above is the detailed content of A new detection tool that can identify scientific texts generated by AI is released, claiming an accuracy rate of over 99%. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:搜狐. If there is any infringement, please contact admin@php.cn delete
What is Model Context Protocol (MCP)?What is Model Context Protocol (MCP)?Mar 03, 2025 pm 07:09 PM

The Model Context Protocol (MCP): A Universal Connector for AI and Data We're all familiar with AI's role in daily coding. Replit, GitHub Copilot, Black Box AI, and Cursor IDE are just a few examples of how AI streamlines our workflows. But imagine

Building a Local Vision Agent using OmniParser V2 and OmniToolBuilding a Local Vision Agent using OmniParser V2 and OmniToolMar 03, 2025 pm 07:08 PM

Microsoft's OmniParser V2 and OmniTool: Revolutionizing GUI Automation with AI Imagine AI that not only understands but also interacts with your Windows 11 interface like a seasoned professional. Microsoft's OmniParser V2 and OmniTool make this a re

I Tried Vibe Coding with Cursor AI and It's Amazing!I Tried Vibe Coding with Cursor AI and It's Amazing!Mar 20, 2025 pm 03:34 PM

Vibe coding is reshaping the world of software development by letting us create applications using natural language instead of endless lines of code. Inspired by visionaries like Andrej Karpathy, this innovative approach lets dev

Replit Agent: A Guide With Practical ExamplesReplit Agent: A Guide With Practical ExamplesMar 04, 2025 am 10:52 AM

Revolutionizing App Development: A Deep Dive into Replit Agent Tired of wrestling with complex development environments and obscure configuration files? Replit Agent aims to simplify the process of transforming ideas into functional apps. This AI-p

Runway Act-One Guide: I Filmed Myself to Test ItRunway Act-One Guide: I Filmed Myself to Test ItMar 03, 2025 am 09:42 AM

This blog post shares my experience testing Runway ML's new Act-One animation tool, covering both its web interface and Python API. While promising, my results were less impressive than expected. Want to explore Generative AI? Learn to use LLMs in P

Top 5 GenAI Launches of February 2025: GPT-4.5, Grok-3 & More!Top 5 GenAI Launches of February 2025: GPT-4.5, Grok-3 & More!Mar 22, 2025 am 10:58 AM

February 2025 has been yet another game-changing month for generative AI, bringing us some of the most anticipated model upgrades and groundbreaking new features. From xAI’s Grok 3 and Anthropic’s Claude 3.7 Sonnet, to OpenAI’s G

How to Use YOLO v12 for Object Detection?How to Use YOLO v12 for Object Detection?Mar 22, 2025 am 11:07 AM

YOLO (You Only Look Once) has been a leading real-time object detection framework, with each iteration improving upon the previous versions. The latest version YOLO v12 introduces advancements that significantly enhance accuracy

Elon Musk & Sam Altman Clash over $500 Billion Stargate ProjectElon Musk & Sam Altman Clash over $500 Billion Stargate ProjectMar 08, 2025 am 11:15 AM

The $500 billion Stargate AI project, backed by tech giants like OpenAI, SoftBank, Oracle, and Nvidia, and supported by the U.S. government, aims to solidify American AI leadership. This ambitious undertaking promises a future shaped by AI advanceme

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
1 months agoBy尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
4 weeks agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft