00 engagement
01 problem
Validating multi-screen automotive HMI systems on traditional 2D flat displays lacks spatial context, making it difficult to evaluate ergonomics, reachability, and visual continuity across displays. Building physical rig hardware for every design variation is costly and slow, creating a bottleneck during early-stage spatial HMI testing.
02 approach
Configured ProtoPie Connect to stream four simultaneous live scenes (Car Color Changer, cluster, large central display, and small central display) across local web sockets.
Built two dedicated Unity VR scenes (IAA_scene01_2 for exterior configuration and IAA_scene02_1 for the interior cockpit) targeting Unity Editor 2022.3.23f1.
Embedded Vuplex 3D WebView components across virtual screen GameObjects to map live ProtoPie browser URLs directly onto 3D surfaces in real time.
Linked bi-directional C# messaging scripts (communication.cs and ExternalSceneLoader.cs) to sync real-time user input and local IP socket communication with Meta Quest Link.
03 stack
04 outcome
The VR prototype connects digital UI design to spatial ergonomics, letting designers and engineers test multi-display interactions and vehicle color customization inside a 3D virtual cockpit, without a physical hardware rig.