Will ChatGPT get you caught? Rethinking of Plagiarism Detection
By Mohammad Khalil, Erkan Er. Interacción, 2023
340 citations recorded by the source corpus.
The rise of Artificial Intelligence (AI) technology and its impact on education has been a topic of growing concern in recent years. The new generation AI systems such as chatbots have become more accessible on the Internet and stronger in terms of capabilities. The use of chatbots, particularly ChatGPT, for generating academic essays at schools and colleges has sparked fears among scholars. This study aims to explore the originality of contents produced by one of the most popular AI chatbots, ChatGPT. To this end, two popular plagiarism detection tools were used to evaluate the originality of 50 essays generated by ChatGPT on various topics. Our results manifest that ChatGPT has a great potential to generate sophisticated text outputs without being well caught by the plagiarism check software. In other words, ChatGPT can create content on many topics with high originality as if they were written by someone. These findings align with the recent concerns about students using chatbots for an easy shortcut to success with minimal or no effort. Moreover, ChatGPT was asked to verify if the essays were generated by itself, as an additional measure of plagiarism check, and it showed superior performance compared to the traditional plagiarism-detection tools. The paper discusses the need for institutions to consider appropriate measures to mitigate potential plagiarism issues and advise on the ongoing debate surrounding the impact of AI technology on education. Further implications are discussed in the paper.
Subfields: Artificial Intelligence, Health Informatics, Safety Research
View Paper: https://www.semanticscholar.org/paper/4cd3ae84e24cfff89ef022e36991df314aac83e2
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Health Informatics
In Safety Research
Citations in the corpus
- Summary of ChatGPT/GPT-4 Research and Perspective Towards the Future of Large Language Models (2023, background): “[35] on the originality of content generated by ChatGPT.”
- On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspective (2023, background): “There are reflections and discussions from law [10], education [17, 22, 26, 44], human-computer interaction [45], medicine [21], and writing [5].”
- New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution (2023, background): “Since AI chatbots often produce original content, the off-the-shelves anti-plagiarism software is not well-suited to detect AI plagiarized content [94].”
- ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning (2023, background): “…evaluation discusses the potential impacts and risks of the technology for the broader society, e.g., in education (Susnjak, 2022; Khalil and Er, 2023), law (Choi et al., 2023), medical (Kung et al., 2022), ethnics (Shen et al., 2023), human-computer collaboration (Lanzi and Loia-cono,…”
- Determinants of Intention to Use ChatGPT for Educational Purposes: Findings from PLS-SEM and fsQCA (2023, neutral): “(Khalil & Er, 2023; Williamson et al., 2023).”
- Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models (2023, background): “Khalil et al. [39] on the originality of content generated by ChatGPT.”
- The effects of over-reliance on AI dialogue systems on students' cognitive abilities: a systematic review (2024, background): “Khalil and Er (2023) have reported that popular plagiarism detection tools, such as Turnitin and iThenticate, show a significant limitation in identifying plagiarism in essays that are based on existing literature.”