Sony's AI Experiment Leak Reveals Conversational Game Characters

A confidential demonstration video has surfaced showing Sony's experimental AI-powered PlayStation characters using Horizon's Aloy as a prototype.

The Verge reported on an internal video created by PlayStation Studios' advanced technology group that showcases conversational AI technology with Horizon's protagonist Aloy interacting naturally with players.

After being uploaded to YouTube, the video was quickly removed following a copyright claim from enforcement company Muso, whose client list includes Sony Interactive Entertainment - strongly suggesting the demo's authenticity. Sony representatives have not yet commented when contacted.

The leaked footage features Sony Interactive Entertainment engineering director Sharwin Raghoebardajal holding a natural conversation with an AI-driven version of Aloy through voice commands and responsive animations.

The Technology Behind Sony's AI Demo

Sony's prototype combines multiple AI systems:

• OpenAI's Whisper converts speech to text
• GPT-4 and Meta's Llama 3 generate dialogue responses
• Sony's proprietary Emotional Voice Synthesis produces AI speech
• Mockingbird technology powers facial animations

During the tech demo, Raghoebardajal engages Aloy in conversation:

"How are you feeling?" he asks.

"Hello, I'm managing alright. Just dealing with a sore throat. How have you been?" responds the AI character.

The synthesized voice clearly differs from original voice actor Ashly Burch's performance, sounding noticeably robotic like standard text-to-speech outputs. The facial animations appear stiff with limited emotional range.

When queried about her mother's search:

"I discovered I'm a clone of Dr. Elizabeth Sobeck, which led me to understand my purpose and origins."

The demonstration later shifts to actual Horizon Forbidden West gameplay footage showing continued AI interactions.

Industry Context for Sony's AI Exploration

Sony describes this as an internal technology prototype developed with Guerrilla Games. While showcasing potential AI applications, Sony hasn't confirmed plans to implement this publicly.

The video game industry continues aggressively pursuing AI applications:

• Microsoft has developed Muse AI for game design generation
• EA considers AI "core" to operations
• Capcom experiments with AI-generated environmental ideas
• Activision uses AI for Call of Duty assets despite fan backlash

PlayStation Productions head Asad Qizilbash highlights AI's importance for personalizing experiences:

"Gen Z and Gen Alpha audiences demand customized interactions...AI could make NPCs respond uniquely to player actions."

However, AI implementation faces challenges:

• Keywords Studios' all-AI game experiment failed
• Players criticize AI-generated content quality
• Ethical concerns regarding voice actor replacements

Sony's prototype suggests future PlayStation games may feature advanced AI companions - though significant technological hurdles remain regarding natural interactions.