New Sony Patent Could Use AI and a Camera Pointed at Your Fingers to Work Out What Button You’ll Press Next

Sony's New Patent Aims to Reduce Gaming Latency with AI and Sensors

A recently filed Sony patent reveals a potential solution to reduce input latency in future gaming hardware. The patent, titled "TIMED INPUT/ACTION RELEASE" (WO2025010132), focuses on predicting user inputs to minimize the delay between action and on-screen response. This is particularly relevant given the increasing use of frame generation technologies like FSR 3 and DLSS 3, which, while enhancing visuals, can introduce latency.

Current solutions from AMD (Radeon Anti-Lag) and Nvidia (Nvidia Reflex) address this issue, and Sony appears to be developing its own approach. The patent describes a system incorporating a machine-learning AI model to predict the next user input. This prediction is aided by an external sensor, potentially a camera monitoring the controller, to anticipate button presses. The patent explicitly mentions using "camera input as an input to a machine learning (ML) model."

Alternatively, the sensor could be integrated directly into the controller itself, possibly utilizing analog button technology—a feature Sony has championed in past controllers.

While the patent's specifics may not directly translate to the PlayStation 6, it demonstrates Sony's commitment to mitigating latency issues. The technology could significantly benefit fast-paced games requiring both high frame rates and low latency, such as first-person shooters. The ultimate implementation of this technology in future hardware remains uncertain.