Sony is actively exploring AI-powered gaming characters. A leaked internal video reveals a prototype version of Aloy from Horizon Forbidden West featuring AI-driven conversations and facial animations. The video appeared on YouTube but was quickly removed after Muso, a rights enforcement company representing Sony Interactive Entertainment (PlayStation), issued a copyright claim.
The video, narrated by Sharwin Raghoebardajal, a director of software engineering at Sony Interactive Entertainment, showcases Aloy engaging in voice-based conversations with players. Using AI-generated speech and facial movements, the prototype allows Aloy to respond dynamically to in-game queries.
Sony’s AI-driven system integrates several technologies:
- OpenAI’s Whisper for speech-to-text processing
- GPT-4 and Llama 3 for AI-driven conversations and decision-making
- Sony’s Emotional Voice Synthesis (EVS) for realistic speech generation
- Sony’s Mockingbird technology for audio-to-face animation
Although the demo runs on PC, Sony has reportedly tested the technology on PlayStation 5 with minimal performance overhead. The project, developed alongside Guerrilla Games, was first showcased internally a year ago, followed by a more advanced demo at Sony Technology Exchange Fair (STEF) in Tokyo in November 2024.
What This Means for the Future of Gaming Characters
“This is just a glimpse of what is possible,” Raghoebardajal stated in the video. However, the prototype raises critical questions:
- Does it make sense to have AI-powered conversations with characters you control, like Aloy?
- What impact will AI-generated voices have on voice actors and game developers?
Sony isn’t the only company exploring AI-powered characters:
- Nvidia’s Ace system allows players to speak freely with AI-powered NPCs and has been demonstrated several times throughout 2024.
- Microsoft is collaborating with Inworld AI to bring generative AI characters and dynamic storylines to Xbox.
- Microsoft’s Muse AI model enables developers to generate gameplay environments, streamlining game prototyping.
With AI integration in gaming on the rise, many developers express concerns about its impact. A Game Developers Conference (GDC) 2024 survey found that 49% of respondents reported AI tools are already in use at their workplaces, with 31% personally using them.
As GDC 2025 approaches, Sony’s experiments with AI-powered PlayStation characters are sure to fuel discussions on the future role of AI in gaming. The industry is already experiencing mass layoffs, and AI’s growing influence in game development raises concerns about job security and creative integrity.
Sony has yet to comment on the leaked video or confirm its removal from YouTube. However, as AI-driven gaming continues to evolve, the debate over its ethical and creative implications is just beginning.
