dhairyashah
Portfolio

Jan 18th, 2023

How to detect ChatGPT generated content?

Author Picture

Dhairya Shah

Software Engineer

On November 30, 2022, OpenAI released a prototype AI chatbot, commonly known as ChatGPT. It is built on OpenAI’s GPT-3 language model.

ChatGPT’s versatility and improvisation skills include its ability to write and debug computer programs, compose music, teleplays, fairy tales, and student essays; answer test questions (sometimes, depending on the test, at a level above the average human test-taker); and write poetry and song lyrics.

Problems arising from ChatGPT content

Deceiving in Education

California high school teacher and author Daniel Herman wrote that ChatGPT would usher in “The End of High School English”.

Professor Darren Hick of Furman University described noticing ChatGPT’s “style” in a paper submitted by a student. An online GPT detector claimed the paper was 99.9% likely to be computer-generated, but Hick had no hard proof.

Source: Wikipedia

ChatGPT results enable educators and teachers to determine whether the essay or assignment was written by a student or by ChatGPT. This is where teachers require a tool to detect AI or ChatGPT content.

Risk of malicious content

It was discovered that ChatGPT was capable of writing phishing emails and malware programs, especially when combined with OpenAI Codex (which is used to power GitHub Copilot).

And OpenAI’s team would be constantly working on this issue.


So let’s come back on the main topic of the article.

How to detect GPT content?

The good news is that there a tools available in market to detect ChatGPT content accurately.

OpenAI is developing a watermarking security feature, that could help detect ChatGPT content with more efficiency and accuracy.

OpenAI GPT-2 Output Detector Demo

OpenAI developed a tool that is capable of detecting GPT generated content which is hosted on Hugging Face and it is called GPT Output Detector Demo.

It is based on the roberta-base-openai-detector model.

AIDetective - AI Content Checker

AIDetective is a AI content detection tool which is built on the top of roberta-base-openai-detector.

It has simple and slick UI and easy to use interface.

P.S This tool is created by me :)

Conclusion

Here in this article, I have discussed the problems arising due to ChatGPT content and also shared two tools to detect ChatGPT generated content.

In conclusion, detecting ChatGPT generated content is important for a variety of reasons, including protecting against fraud and plagiarism, and ensuring the authenticity of information.

Thank you for reading!