MotionTrace: IMU-based Field of View Prediction for Smartphone AR Interactions

التفاصيل البيبلوغرافية
العنوان: MotionTrace: IMU-based Field of View Prediction for Smartphone AR Interactions
المؤلفون: Islam, Rahul, Xu, Vasco, Ahuja, Karan
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Human-Computer Interaction
الوصف: For handheld smartphone AR interactions, bandwidth is a critical constraint. Streaming techniques have been developed to provide a seamless and high-quality user experience despite these challenges. To optimize streaming performance in smartphone-based AR, accurate prediction of the user's field of view is essential. This prediction allows the system to prioritize loading digital content that the user is likely to engage with, enhancing the overall interactivity and immersion of the AR experience. In this paper, we present MotionTrace, a method for predicting the user's field of view using a smartphone's inertial sensor. This method continuously estimates the user's hand position in 3D-space to localize the phone position. We evaluated MotionTrace over future hand positions at 50, 100, 200, 400, and 800ms time horizons using the large motion capture (AMASS) and smartphone-based full-body pose estimation (Pose-on-the-Go) datasets. We found that our method can estimate the future phone position of the user with an average MSE between 0.11 - 143.62 mm across different time horizons.
Comment: Accepted to IEEE International Conference on Wearable and Implantable Body Sensor Networks (BSN 2024)
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2408.01850
رقم الأكسشن: edsarx.2408.01850
قاعدة البيانات: arXiv