Sony's New AI Patent Predicts Next Button Press Using Finger-Camera Tech

May 06,25

Sony's latest patent, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," showcases the company's innovative approach to reducing latency in future gaming hardware. This patent, first highlighted by Tech4gamers, aims to streamline the "timed release of user commands" by predicting the player's next move.

With the introduction of PlayStation Spectral Super Resolution (PSSR) in the PlayStation 5 Pro, Sony has already demonstrated its commitment to enhancing visual quality through upscaling to 4K. However, advanced graphics technologies like frame generation can introduce additional latency, impacting the responsiveness of games. This is a challenge that GPU manufacturers like AMD and Nvidia have tackled with solutions like Radeon Anti-Lag and Nvidia Reflex, respectively.

Sony's proposed solution involves a multifaceted approach, integrating a machine-learning AI model with external sensors. The AI model is designed to predict the user's next input, while sensors, such as a camera focused on the controller, can detect which button the player is about to press. The patent specifically mentions, "In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command."

Moreover, Sony considers the potential use of controller buttons as sensors, leveraging their experience with analog buttons in past controllers. This technology, while possibly not implemented exactly as described in the PlayStation 6, indicates Sony's forward-thinking strategy to combat latency issues without sacrificing game responsiveness.

This advancement could significantly benefit genres like twitch shooters, where both high frame rates and low latency are crucial. As rendering technologies like FSR 3 and DLSS 3 continue to gain popularity, Sony's efforts to mitigate their inherent latency could set a new standard in gaming performance.

While it remains to be seen if this patent will translate into future hardware, Sony's exploration of these technologies underscores their dedication to enhancing the gaming experience.

This new Sony patent could be a game-changer for PlayStation. Image credit: Sony Interactive Entertainment.

Top News
MORE
Copyright © 2024 yuzsb.com All rights reserved.