تقرير
HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpus
العنوان: | HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpus |
---|---|
المؤلفون: | Su, Zhenpeng, Wu, Xing, Zhou, Wei, Ma, Guangyuan, Hu, Songlin |
سنة النشر: | 2023 |
المجموعة: | Computer Science |
مصطلحات موضوعية: | Computer Science - Computation and Language, Computer Science - Artificial Intelligence |
الوصف: | ChatGPT has gained significant interest due to its impressive performance, but people are increasingly concerned about its potential risks, particularly around the detection of AI-generated content (AIGC), which is often difficult for untrained humans to identify. Current datasets utilized for detecting ChatGPT-generated text primarily center around question-answering, yet they tend to disregard tasks that possess semantic-invariant properties, such as summarization, translation, and paraphrasing. Our primary studies demonstrate that detecting model-generated text on semantic-invariant tasks is more difficult. To fill this gap, we introduce a more extensive and comprehensive dataset that considers more types of tasks than previous work, including semantic-invariant tasks. In addition, the model after a large number of task instruction fine-tuning shows a strong powerful performance. Owing to its previous success, we further instruct fine-tuning T\textit{k}-instruct and build a more powerful detection system. Comment: This paper has been accepted by CIKM2023 workshop |
نوع الوثيقة: | Working Paper |
URL الوصول: | http://arxiv.org/abs/2309.02731 |
رقم الأكسشن: | edsarx.2309.02731 |
قاعدة البيانات: | arXiv |
الوصف غير متاح. |