تقرير
People cannot distinguish GPT-4 from a human in a Turing test
| العنوان: | People cannot distinguish GPT-4 from a human in a Turing test |
|---|---|
| المؤلفون: | Jones, Cameron R., Bergen, Benjamin K. |
| سنة النشر: | 2024 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Human-Computer Interaction, Computer Science - Artificial Intelligence |
| الوصف: | We evaluated 3 systems (ELIZA, GPT-3.5 and GPT-4) in a randomized, controlled, and preregistered Turing test. Human participants had a 5 minute conversation with either a human or an AI, and judged whether or not they thought their interlocutor was human. GPT-4 was judged to be a human 54% of the time, outperforming ELIZA (22%) but lagging behind actual humans (67%). The results provide the first robust empirical demonstration that any artificial system passes an interactive 2-player Turing test. The results have implications for debates around machine intelligence and, more urgently, suggest that deception by current AI systems may go undetected. Analysis of participants' strategies and reasoning suggests that stylistic and socio-emotional factors play a larger role in passing the Turing test than traditional notions of intelligence. Comment: 23 pages, 13 figures |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2405.08007 |
| رقم الأكسشن: | edsarx.2405.08007 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |