leonardo-alegria/garlic-llm
App
Can I trust it?
Worth a closer look before you use it.
Warnings Check
Very new: it was created 6 days ago. Wait a little before installing it.
Stars from real accounts No data
We haven't checked its stars for fakes yet.
Active OK
Last change today.
Licence Check
GPL-3.0: free to use. If you distribute software that includes it, you must publish your code under the same licence.
Quick checks from public data. They help, but they are no guarantee.
What it is
A homebrew app for the PlayStation 4 that runs the Qwen3.5-9B language model on the console's GPU, offline. It offers text chat, voice conversation, dictation, and a mode where the model writes MicroPython code that the console runs. It can also serve an OpenAI-compatible API on…
Who it's for
PS4 homebrew users and developers interested in running local language models on game consoles
How to use it
Ready-made installers, when the project publishes them, are on its latest release.
Ask your AI to set it up
Paste this into Claude, ChatGPT or your coding assistant.
Help me install and set up leonardo-alegria/garlic-llm in my project. Follow its README: https://github.com/leonardo-alegria/garlic-llm. Explain each step and check it is safe before running anything.
Star curve
Get alerts for repos like this
We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.
What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy
For maintainers
Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.
[](https://repoalerts.com/repo/leonardo-alegria/garlic-llm?ref=badge)Similar repos
- cobanov/PS5LM
A PS5 homebrew app that runs llama.cpp on the console's GPU and serves GGUF models over OpenAI- and Anthropic-compatible HTTP APIs on the local network, with a TV interface and a decision-model endpoi
- abhi245y/PS5LM-Plus
A native app that runs llama.cpp on a jailbroken PlayStation 5 using its GPU via Vulkan. It loads GGUF models from internal or USB storage, shows a dashboard on the TV, and exposes a chat UI and OpenA
- orailnoor/cross-platform-llm-client
A Flutter chat client for Android and iOS that runs GGUF language models on-device via llama.cpp with Vulkan or Metal acceleration, and also connects to OpenAI, Anthropic, Google Gemini and Kimi cloud
- samir-sarwar/samir-vllm
A learning-oriented LLM inference engine written in C++17 and CUDA that runs Llama 3.2 1B Instruct. It loads safetensors weights to the GPU, implements tokenizer, prefill and decode with paged KV cach
- runboubou/boubou
A command-line tool for talking with AI out loud. Runs open models locally on your machine, with microphone input, spoken replies, echo cancellation and speech detection. Also serves a browser or phon
- manuelgscom/inside-llm
A native binary that loads one or two GGUF models via llama.cpp and shows in the browser per-token probabilities, discarded alternatives, sampler effects, and the token where two models' outputs diver