img(height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=2939831959404383&ev=PageView&noscript=1")

Software will put realistic people in VR buildings

Words:
Stephen Cousins

You can make realistic buildings with VR, but what about the people that populate your presentations? New facial and eye tracking tools aim to bring avatars to life

Are clients happy or sad to see your latest creation? - HTC’s Focus 3 Facial Tracker brings their emotions to life in VR
Are clients happy or sad to see your latest creation? - HTC’s Focus 3 Facial Tracker brings their emotions to life in VR Credit: HTC

Virtual reality has transformed the way architects experience their creations but even the most advanced systems struggle to mimic the intimacy of real-life human interaction. Effective collaboration and immersion in a 3D world is harder to achieve when you’re surrounded by blank-faced avatars looking like characters in a 1980s video game.

VR device maker HTC is changing all that with its new facial and eye tracking tools intended to help users more easily convey emotion when plugged into its business VR headset Vive Focus 3.

According to a release from the company, the Focus 3 Facial Tracker device attaches to the Vive headset via a USB port and features a mono tracking camera that accurately captures facial expressions and mouth movements across the lips, jaw, cheeks, chin, teeth, and tongue. These can be mapped onto VR avatars in real time in VR collaboration software to more naturally convey emotions and help other users read intentions.

Fabian Nappenbach, director of product marketing at HTC Vive said: ‘Capturing 38 different blend shapes across the lower face enables users to enhance their avatars in VR collaboration tools like VIVE Sync and precisely capture true-to-life facial expressions and mouth movements.’

The 60Hz tracking rate and ‘optimised runtime for facial tracking’ synchronises lips to voice with minimal latency, so when a client tells you you’ve ruined their vision for the pool house you’ll feel that sense of crushing despair even more immediately.

The Focus 3 Eye Tracker is a lightweight module that attaches magnetically to the headset, exploiting a dual camera to capture realistic eye movements and blinks to project onto avatars. This helps better convey collaborators’ non-verbal cues and the focus of their attention – are they directing it to your beautifully detailed brickwork or simply gazing into virtual space?

The technology is capable of capturing data on gaze origin and direction, pupil size and position, and eye openness, which could help designers improve their designs

The technology is capable of capturing data on gaze origin and direction, pupil size and position, and eye openness, which we assume could help designers improve their understanding of how clients experience a project in VR and hone their designs in response. So it could prove useful to measure and adapt their presentation skills.

According to HTC, eye tracking can also lighten GPU loads by prioritising rendering on areas where users are actually focused.

Commenting on the benefits of the tools, David Munro, senior consultant at development consultancy Cityscape Digital, said: ‘From a planning point of view it helps us to validate the visual impact of a newly proposed building from a human perspective. From a vision and early design viewpoint it helps us to connect with our end user and appreciate what is important to them. This leads to real engagement with the audience and ultimately enables us to build better places.’

HTC Vive’s eye and facial trackers support the games engines Unity, Unreal and Native and cost £216 and £83 respectively.

Latest

Tuesday 19 November 2024

PiP Webinar: Bespoke House Design

Reimagine a park for the local community, build versatility and adaptability into an exhibition space, bid for a place on a four-year framework - some of the latest architecture contracts and competitions from across the industry

Latest: £2.5m historic London park revamp

The revamped RIBA/NBS platform is now live, with enhanced features to help you meet your CPD requirements

Revamped RIBA/NBS platform is now live, with enhanced features to help you meet your CPD requirements

There’s no missing the Midland Metropolitan University Hospital, both for its imposing size and its ambition to nurture wellbeing and recovery

Cagni Williams, HKS and Sonnemann Toon deliver MMUH building that nurtures wellbeing and recovery

Arup Hong Kong head of design Freddie Hai talks about his role as an authorised person, which combines aspects of principal designer, building control approver and building inspector

Arup Hong Kong head of design Freddie Hai talks about his role as an authorised person,