DrawTalking: Building Interactive Worlds by Sketching and Speaking

التفاصيل البيبلوغرافية
العنوان: DrawTalking: Building Interactive Worlds by Sketching and Speaking
المؤلفون: Rosenberg, Karl Toby, Kazi, Rubaiat Habib, Wei, Li-Yi, Xia, Haijun, Perlin, Ken
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Human-Computer Interaction, Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Emerging Technologies, Computer Science - Graphics, H.5.2, D.2.2, I.2.7, D.1.7, H.5.1
الوصف: We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study with our prototype shows that the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to inspire and inform research in future natural interfaces for creative exploration and authoring.
Comment: 25 pages, 27 figures; Matching version accepted at UIST 2024
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2401.05631
رقم الأكسشن: edsarx.2401.05631
قاعدة البيانات: arXiv