Designing captivating user experiences in VR and MR
Immersive UX design

Target group preferences and considerations for input methods

The choice of input method significantly influences the user experience in XR, and the effectiveness of different interface approaches can vary depending on the input method:

• • 6DoF Controller: Well suited for interacting with both diegetic elements (pressing virtual buttons) and non-diegetic interfaces (pointing and clicking on floating panels). The precision of controllers can be beneficial for both.

• Hand tracking: Excellent for interacting with diegetic interfaces that mimic real-world manipulation. Grasping a virtual lever or pressing a virtual button with your hand feels natural. However, delays and inaccuracies can make interaction with smaller non-diegetic targets difficult.
• Eye tracking: Can be used to select elements on both diegetic and non-diegetic interfaces. However, the precision limitations for small targets are particularly relevant when interacting with densely packed non-diegetic panels or small diegetic controls.

Best practices for creating captivating VR/MR experiences

With these considerations in mind, here are some best practices for designing effective VR/MR experiences:

• Apply user-centered design: As with any UX project, understanding your target audience and their needs is paramount. Conduct thorough user research and testing and gather feedback throughout the design process, paying attention to interface preferences.
• Prioritize natural and intuitive interactions: Use real-world metaphors and design interactions that feel natural and intuitive. Mimicking physical actions, especially with diegetic interfaces and hand tracking where appropriate, can lead to a more seamless experience.
• Offer several input options: Ideally, XR applications should support multiple input methods (controller, hand tracking, voice) to accommodate different user preferences and the requirements of different tasks, and the interface approach should be compatible with these options.
• Select interface approaches strategically according to the experience goal:
  • Prioritize diegetic interfaces for deep immersion: If the primary goal is to create a highly immersive and credible experience, prioritize diegetic interfaces for core interactions. Invest in the design and development to make these elements functional and intuitive.
  • Use non-diegetic interfaces for utility and information management: When efficiency in information delivery and access to system-wide controls are paramount, non-diegetic interfaces can be effective. Design them thoughtfully to minimize immersion breaks and potential clutter.
  • Use hybrid approaches for practicability and balance: Often a hybrid approach offers the best balance. Use diegetic elements for interactions directly related to the virtual world objects and non-diegetic panels for additional information or controls that do not fit naturally into the environment. Ensure a clear visual and interaction hierarchy between these elements.
  • Consciously weigh up compromises: Consciously weigh the trade-offs between immersion and information density, naturalness and efficiency when choosing an interface approach for specific tasks.
• Test both approaches comprehensively: Prototype and test both diegetic and non-diegetic interface elements with your target group for specific tasks. Pay close attention to user feedback on intuitiveness, usability, immersion effect and information accessibility.
• Maintain consistency: Regardless of the approach (or combination thereof), strive for consistency in visual design, interaction patterns and feedback mechanisms across all interface elements.
• Optimize for the input method: Consider how different input methods (controller, hand tracking, eye tracking) interact with both diegetic and non-diegetic interfaces. Design interfaces that are operable and comfortable with the intended input methods. For example, ensure that the touch targets on non-diegetic panels are large enough for reliable hand-tracking input.
• Create a clear visual hierarchy: Whether diegetic or non-diegetic, ensure a clear visual hierarchy to direct the user's attention and make interactive elements and important information easily recognizable.
• Minimize overloading: Especially with non-diegetic interfaces, avoid overwhelming the user with too much information or too many panels at the same time. Consider the gradual disclosure of information as required.
• Consider ergonomics and comfort: Ensure that interaction with both types of interfaces is comfortable and does not require excessive physical effort. For example, avoid placing frequently used non-diegetic panels in awkward positions that require constant head turning.
• Quickly iterate and create prototypes: VR/MR design is highly iterative. Create prototypes early and often to test your ideas in the target environment and gather valuable feedback on the usability of the interface.
• Pay attention to performance and stability: Lags and performance issues can quickly destroy immersion and make interacting with interfaces frustrating, regardless of the approach.
• Working together across disciplines: Successful VR/MR experiences require close collaboration between designers, developers, artists and sound designers to ensure seamless interface integration.
• Provide clear onboarding and tutorials: Explain clearly how to interact with both diegetic and non-diegetic interface elements within the experience.
• Provide clear visual and haptic feedback: Reinforce the sense of physicality for diegetic interactions and provide clear feedback for selections on non-diegetic panels.
• Continuously learn and adapt: Stay up to date with the latest interface design patterns and best practices for VR/MR.