A leaked internal video reveals Sony's exploration of AI-driven PlayStation characters.

The Verge reported on a leaked video from PlayStation Studios' advanced technology group, featuring Aloy from the Horizon series to showcase AI-driven game characters.

The video was removed from YouTube after a copyright claim by Muso, an internet enforcement firm reportedly linked to Sony Interactive Entertainment, indicating its authenticity. IGN has reached out to Sony for comment.

According to The Verge, the video shows Sony Interactive Entertainment’s director of software engineering, Sharwin Raghoebardajal, engaging in a dialogue with an AI-driven Aloy using voice prompts, with AI-generated speech and facial animations.

The setup uses OpenAI’s Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony’s Emotional Voice Synthesis (EVS) for speech, and Sony’s Mockingbird technology for facial animations.

In the demo, Raghoebardajal asks Aloy about her well-being, and she responds: "Hi, I’m doing okay, just battling a sore throat. How about you?"

The voice from Aloy is not that of Ashly Burch, the character’s usual voice actor, but a robotic tone akin to common text-to-speech generators used in social media. AI Aloy’s facial movements appear rigid, with lifeless eyes during the conversation.

When asked about her search for her mother, Aloy says: "I learned I’m a clone of Dr. Elizabeth Sobeck, which helped me understand my purpose and origins."

On being a clone, she adds: "Being a clone feels special, tying me to the past while letting me shape my own future."

The demo shifts to the Horizon Forbidden West game world, where Raghoebardajal continues the conversation while playing. The interaction feels unusual as the player talks to a character they control, and the irony of using Aloy, given the Horizon series’ themes, stands out.

What’s the Top PlayStation 5 Game?

Choose a winner

The prototype, developed with Guerrilla Games, was created to demonstrate the technology internally at Sony. “This is just a peek at what’s possible,” Raghoebardajal notes in the video. While Sony is clearly investing in AI-driven PlayStation characters, there’s no confirmation of plans to integrate this tech into public-facing PlayStation products, and it’s unclear if it’s feasible for PS5 games at this stage.

Sony’s efforts align with industry trends, as competitors like Microsoft, which recently unveiled an AI called Muse for game design ideation, are also heavily investing in AI.

Generative AI remains a hot topic in gaming and entertainment, industries hit hard by recent layoffs. It faces criticism from players and creators over ethical concerns, rights issues, and its struggle to create engaging content. For example, Keywords Studios’ attempt to build a game entirely with AI failed, with the company noting to investors that AI “couldn’t replace talent.”

In September, EA called AI “the very core” of its business, while Capcom recently shared it’s experimenting with generative AI to generate “hundreds of thousands” of ideas for in-game environments.

Asad Qizilbash, head of PlayStation Productions and product at PlayStation Studios, emphasized AI’s role in appealing to Gen Z and Gen Alpha gamers, who value “personalization across everything.”

“Non-player characters could respond to players’ actions, creating a more personal experience,” Qizilbash explained. “This matters to younger Gen Z and Gen Alpha audiences, who grew up in a digital world and seek meaningful, tailored experiences.”

Activision recently acknowledged using generative AI for certain Call of Duty: Black Ops 6 assets, sparking backlash over an “AI-generated” zombie Santa loading screen.