A leaked video seems to depict a Sony director in discussion with a prototype of AI Aloy

Characters from major PlayStation series are reportedly being utilized in an artificial intelligence prototype.

A leaked clip seems to feature Sharwin Raghoebardajal, PlayStation's software engineering director, interacting with a preliminary AI version of Aloy.

The footage was initially provided to The Verge, but was later removed from the internet due to a Sony copyright claim. It showed Raghoebardajal conducting a brief demonstration of an AI-driven Aloy, capable of responding to verbal prompts in both the AI prototype and Horizon Forbidden West.

Raghoebardajal remarked, "This is just a glimpse of what is possible," as he showcased Aloy providing players with lore and background information when asked.

The AI version of Aloy does not replicate the in-game voice, yet the character model answers questions with corresponding facial movements and expressions. Raghoebardajal mentioned this is an internal demonstration created at Sony.

As per The Verge, this AI setup operates using OpenAI's whisper for converting speech to text, while GPT-4 and Llama 3 facilitate communication and decision-making. Sony’s proprietary Mockingbird technology underpins the audio-to-facial animation, and Emotional Voice Synthesis (EVS) enables the speech functions.

The prototype, although tested on a PC, is anticipated by Sony to perform similarly on PS5 consoles with minimal adjustments.

Elsewhere, French voice actors from Apex Legends have reportedly declined contracts that would permit the use of their voices for AI training purposes.