Does Voice Matter? The Effect of Verbal Communication and Asymmetry on the Experience of Collaborative Social XR
March 2026
Paper: Does Voice Matter? The Effect of Verbal Communication and Asymmetry on the Experience of Collaborative Social XR
What is the paper about?
The paper investigates how verbal communication and using different hardware setups influence the user experience in a shared virtual space (social XR). It compares scenarios where both users employ fully immersive VR headsets (symmetric configuration) to situations where one user uses a VR headset while the other uses a desktop setup (asymmetric configuration). The study explores how these setups affect self-perception, perception of others, and task perception in collaborative settings.
What are the results?
- Self-Perception: Verbal communication and higher immersion devices (VR headsets) increased the sense of presence and embodiment. However, verbal communication did not improve the sense of embodiment significantly.
- Perception of Others: Verbal communication significantly enhanced social presence and the perceived quality of interactions. In asymmetric configurations, the quality of social interaction was lower for the less immersed users (desktop setup), but highly immersed users (VR headset) maintained high interaction quality.
- Task Perception: The type of device and verbal communication had minimal impact on task perception, possibly due to the simple nature of the task, which relied on clear visual indicators rather than social cues.
What are possible fields of application?
- Remote Collaboration: Enhancing professional meetings and teamwork in virtual environments, particularly in hybrid setups where not all participants have high-end VR equipment.
- Education: Supporting collaborative learning by integrating verbal communication and cross-device compatibility in virtual classrooms.
- Healthcare and Therapy: Facilitating remote counseling or collaborative rehabilitation programs where verbal communication and presence play critical roles.
- Entertainment and Gaming: Creating inclusive multiplayer experiences that cater to users with varying levels of immersion and hardware.
How does the research in the paper contribute to shaping the metaverse?
The study highlights the importance of integrating verbal communication and supporting diverse hardware configurations in social XR experiences. These findings are crucial for designing inclusive metaverse environments where users with varying levels of immersion can collaborate effectively. By addressing interaction quality in asymmetric setups, this research provides guidance for creating accessible, engaging, and realistic social spaces in the metaverse. It underscores the need to optimize verbal and non-verbal social cues to ensure a cohesive experience for all participants, regardless of their device’s immersion level.
Reference
Merz, C., Wienrich, C. & Latoschik, M. E. “Does Voice Matter? The Effect of Verbal Communication and Asymmetry on the Experience of Collaborative Social XR,” in 2024 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Bellevue, WA, USA, 2024, pp. 1127-1136, doi: 10.1109/ISMAR62088.2024.00129.

