Sony’s AI Aloy: PlayStation’s Leap into Conversational Gaming Characters
Staff Editor Sony Unveils Prototype AI-Powered PlayStation Character
Sony has taken a significant step forward in gaming technology with the development of a prototype AI-powered PlayStation game character. An internal video, which has since been removed from YouTube due to a copyright claim, showcased an AI version of Aloy from the popular game “Horizon Forbidden West.”
The demonstration, narrated by Sony director Sharwin Raghoebardajal, revealed that the AI-driven Aloy can engage in conversations with players using voice prompts. This advanced system utilizes synthesized voice and facial movements to create a more immersive gaming experience.
According to the video, the prototype was developed in collaboration with Guerrilla Games and incorporates several cutting-edge technologies. These include OpenAI’s whisper for speech-to-text conversion, GPT-4 and Llama 3 for conversations and decision making, Sony’s Emotional Voice Synthesis (EVS) system for speech generation, and Mockingbird technology for audio-to-face animation.
While the demo currently runs on PC, it has been tested on PlayStation 5 hardware. Raghoebardajal emphasized the prototype nature of the technology, which was first demonstrated internally a year ago and later at the Sony Technology Exchange Fair.
This development comes amid similar advancements in the gaming industry. Nvidia recently showcased its Ace technology for AI-powered NPCs, while Microsoft has partnered with Inworld AI for AI characters on Xbox and is developing the Muse AI model for gameplay generation.
However, these advancements have raised concerns within the industry about the potential impact of AI on game development and voice acting. Some fear that AI could affect the creative process, especially in light of recent industry layoffs.
A recent Game Developers Conference (GDC) 2024 survey indicated significant use of generative AI tools in the industry, highlighting the growing influence of this technology.
As the gaming world prepares for the upcoming Game Developers Conference, Sony’s AI experiments are likely to spark further discussions about the future of game development and player interaction. Sony has not yet commented on the leaked video or its removal.
