img(height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=2939831959404383&ev=PageView&noscript=1")

Software will put realistic people in VR buildings

Words:
Stephen Cousins

You can make realistic buildings with VR, but what about the people that populate your presentations? New facial and eye tracking tools aim to bring avatars to life

Are clients happy or sad to see your latest creation? - HTC’s Focus 3 Facial Tracker brings their emotions to life in VR
Are clients happy or sad to see your latest creation? - HTC’s Focus 3 Facial Tracker brings their emotions to life in VR Credit: HTC

Virtual reality has transformed the way architects experience their creations but even the most advanced systems struggle to mimic the intimacy of real-life human interaction. Effective collaboration and immersion in a 3D world is harder to achieve when you’re surrounded by blank-faced avatars looking like characters in a 1980s video game.

VR device maker HTC is changing all that with its new facial and eye tracking tools intended to help users more easily convey emotion when plugged into its business VR headset Vive Focus 3.

According to a release from the company, the Focus 3 Facial Tracker device attaches to the Vive headset via a USB port and features a mono tracking camera that accurately captures facial expressions and mouth movements across the lips, jaw, cheeks, chin, teeth, and tongue. These can be mapped onto VR avatars in real time in VR collaboration software to more naturally convey emotions and help other users read intentions.

Fabian Nappenbach, director of product marketing at HTC Vive said: ‘Capturing 38 different blend shapes across the lower face enables users to enhance their avatars in VR collaboration tools like VIVE Sync and precisely capture true-to-life facial expressions and mouth movements.’

The 60Hz tracking rate and ‘optimised runtime for facial tracking’ synchronises lips to voice with minimal latency, so when a client tells you you’ve ruined their vision for the pool house you’ll feel that sense of crushing despair even more immediately.

The Focus 3 Eye Tracker is a lightweight module that attaches magnetically to the headset, exploiting a dual camera to capture realistic eye movements and blinks to project onto avatars. This helps better convey collaborators’ non-verbal cues and the focus of their attention – are they directing it to your beautifully detailed brickwork or simply gazing into virtual space?

The technology is capable of capturing data on gaze origin and direction, pupil size and position, and eye openness, which could help designers improve their designs

The technology is capable of capturing data on gaze origin and direction, pupil size and position, and eye openness, which we assume could help designers improve their understanding of how clients experience a project in VR and hone their designs in response. So it could prove useful to measure and adapt their presentation skills.

According to HTC, eye tracking can also lighten GPU loads by prioritising rendering on areas where users are actually focused.

Commenting on the benefits of the tools, David Munro, senior consultant at development consultancy Cityscape Digital, said: ‘From a planning point of view it helps us to validate the visual impact of a newly proposed building from a human perspective. From a vision and early design viewpoint it helps us to connect with our end user and appreciate what is important to them. This leads to real engagement with the audience and ultimately enables us to build better places.’

HTC Vive’s eye and facial trackers support the games engines Unity, Unreal and Native and cost £216 and £83 respectively.

Latest

20 May 2025 from 9am to 11.30am

RIBAJ Spec: Architecture for Housing and Residential Development Webinar

A decade after a £600 million scheme to demolish and rebuild swathes of its city centre collapsed, Sheffield is returning life to its historic buildings as it regenerates its heart

After a major redevelopment scheme collapsed, Sheffield is nurturing historic buildings as it regenerates its city centre

The Architects Registration Board’s commission on the future of professional practice experience for architecture students has issued its findings. Their aims are laudable, but questions remain around implementing them, writes Alex Wright

Alex Wright breaks down the findings of the ARB’s commission on the future of professional training for architecture students

Flat roofs require many considerations, from practicality and appearance to material selection, performance, cost and maintenance. Mark Austin, technical director at SpecStudio, lists the elements to review to develop a thorough specification

Mark Austin, technical director at SpecStudio, lists the elements to review to develop a thorough flat roof specification

Great architects deeply understood, and responded to, their context. We should talk the language of now, but never let the status quo limit us, argues Muyiwa Oki

We should talk the language of now, but never let the status quo limit us, argues Muyiwa Oki