Analysis of Immersive Mid-Air Sketching Behavior, Sketch Quality, and User Experience in Design Ideation Tasks

March 2026

What is the paper about?

The paper explores user behavior, the quality of sketches, and user experience when creating 3D sketches in Virtual Reality (VR) using mid-air gestures. It focuses on understanding how people create sketches in three different tasks: tracing over a model, copying a model, and designing something from their imagination. The goal is to identify how users’ techniques and efficiency change when the focus shifts from accuracy (tracing/copying) to creativity (design ideation). The findings aim to help improve VR sketching tools to better support problem-solving, idea generation, and communication in virtual environments.

What are the results?

• Technique: Users moved their heads more during design tasks compared to tracing and copying, suggesting more dynamic exploration when expressing personal ideas. They also started strokes closer to their dominant hand, probably to avoid arm fatigue.
• Efficiency: In design tasks, users sketched faster and with greater velocity but erased or redid strokes more frequently, indicating a trial-and-error approach to expressing ideas.
• Quality: Tracing tasks resulted in straighter lines, but overall sketch quality did not vary much between tasks.
• Experience: Users reported less time pressure in design ideation tasks and found it easier to start lines. However, higher sketch quality ratings were often linked to lower enjoyment, possibly due to the effort needed for precision.

What are possible fields of application?

• Education: Enhancing creativity and spatial understanding in virtual classrooms or design studios.
• Product Design: Allowing designers to quickly sketch out and explore new ideas in 3D.
• Architecture and Engineering: Supporting early-stage sketching and team collaboration.
• Entertainment and Media: Enabling artists to draw and experiment freely in immersive environments.

How does the research in the paper contribute to shaping the metaverse?

The study provides insights into how people interact with 3D sketching tools in VR when they are being creative or trying to explain ideas. By identifying how different sketching tasks influence user experience, it informs the development of more intuitive and efficient design tools for the metaverse. These insights could foster collaboration, creativity, and communication in virtual spaces, which are core aspects of the metaverse. The findings also highlight the importance of balancing user effort with engagement to enhance immersive experiences.

Reference

Monty, S., Kern, F. & Latoschik, M. E. (2024). Analysis of Immersive Mid-Air Sketching Behavior, Sketch Quality, and User Experience in Design Ideation Tasks. IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 269–278, doi: 10.1109/ISMAR62088.2024.00041