A jailbroken PlayStation 5 can now run AI models at more than 100 tokens per second. The speed comes from an updated version of PS5LM, a project that lets users run AI chat models on the console. A recent Reddit post brought this to light when a gamer posted his fork of PS5LM, a llama.cpp port on the PS5 to run AI LLMs locally, with a massive improvement.
Qwen 27B at ~20 tok/s on a jailbroken PS5's GPU. I forked PS5LM and turned it into a native app
by u/AdIllustrious7246 in LocalLLM
The new version works as a native app and uses the PS5’s graphics chip to speed up responses. Tests show that some smaller models can reach 124 tokens per second. Larger models run more slowly but can still deliver useful results. This lets the PS5 handle AI tasks on the device instead of sending every request to an online service.
Reportedly, the app supports several models, including Llama 3.2 3B, which reaches 124 tokens per second, and Gemma 4 E4B, which runs at around 61 tokens per second. There’s even a larger Qwen 3.8 27B model that reaches about 20 tokens per second.
The app also shows details such as speed, memory use, power use, and temperature. Users can open its chat page through a web browser on another device connected to the same network. However, it only works on a jailbroken PS5, not a regular console.
GPU Access Makes a Big Difference
The new version uses a Vulkan-based GPU system through a port of the RADV graphics driver. This lets the app use the PS5’s graphics chip more directly. It also makes around 11.4GB of memory available to the model and its context, compared with about 6GB in the earlier setup. More memory gives larger models more room to work, while GPU access helps them produce answers faster.
The project shows that a PS5 can do more than run games. Still, speed depends on the model being used. The app also remains unofficial and requires a jailbroken console, so most PS5 owners cannot try it as it is.