Back to feed

Nuance Labs presented the Emma avatar with instant response

Startup Nuance Labs has unveiled the Nuplex 1.0 audio-visual model and an interactive avatar, Emma, operating in real time.

Traditional digital avatars use cascade processing of sound via STT and TTS, which creates a delay of up to 3 seconds.

Nuplex combines perception and generation into a single neural network, eliminating intermediate data processing stages.

The system continuously reads the interlocutor's intonations and synchronously streams realistic facial expressions and speech without pauses.

Avatar Emma can simultaneously listen and respond with nods or smiles directly during the user's speech.

According to test results, the model matched the reaction speed of a living person in 89% of cases.

Access to the avatar is open in the browser without registration, and developers have access to a preview API.

The appearance is licensed from a real actress, while direct cloning of third-party faces and voices is blocked.

5.5K views

More from this channel Metavershche and AIshche

Similar in this category Technology