RepoAlerts

leonardo-alegria/garlic-llm

App

Can I trust it?

Worth a closer look before you use it.

  • Warnings Check

    Very new: it was created 6 days ago. Wait a little before installing it.

  • Stars from real accounts No data

    We haven't checked its stars for fakes yet.

  • Active OK

    Last change today.

  • Licence Check

    GPL-3.0: free to use. If you distribute software that includes it, you must publish your code under the same licence.

Quick checks from public data. They help, but they are no guarantee.

What it is

A homebrew app for the PlayStation 4 that runs the Qwen3.5-9B language model on the console's GPU, offline. It offers text chat, voice conversation, dictation, and a mode where the model writes MicroPython code that the console runs. It can also serve an OpenAI-compatible API on…

Who it's for

PS4 homebrew users and developers interested in running local language models on game consoles

How to use it

Ready-made installers, when the project publishes them, are on its latest release.

Downloads (if any)

Ask your AI to set it up

Paste this into Claude, ChatGPT or your coding assistant.

Help me install and set up leonardo-alegria/garlic-llm in my project. Follow its README: https://github.com/leonardo-alegria/garlic-llm. Explain each step and check it is safe before running anything.

Read the README

Star curve

131From 0 to 131 stars between 11 Nov 2026 and 17 Nov 2026.

Get alerts for repos like this

We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.

What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy

For maintainers

Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.

[![leonardo-alegria/garlic-llm on RepoAlerts](https://repoalerts.com/badge/leonardo-alegria/garlic-llm.svg)](https://repoalerts.com/repo/leonardo-alegria/garlic-llm?ref=badge)
Share on X

  • cobanov/PS5LM

    A PS5 homebrew app that runs llama.cpp on the console's GPU and serves GGUF models over OpenAI- and Anthropic-compatible HTTP APIs on the local network, with a TV interface and a decision-model endpoi

    AppModels & inferenceC++ · 853 stars · +26 this week · 46 days old · HN 375 pts

  • abhi245y/PS5LM-Plus

    A native app that runs llama.cpp on a jailbroken PlayStation 5 using its GPU via Vulkan. It loads GGUF models from internal or USB storage, shows a dashboard on the TV, and exposes a chat UI and OpenA

    Models & inferenceC++ · 523 stars · +8 this week · 39 days old

  • orailnoor/cross-platform-llm-client

    A Flutter chat client for Android and iOS that runs GGUF language models on-device via llama.cpp with Vulkan or Metal acceleration, and also connects to OpenAI, Anthropic, Google Gemini and Kimi cloud

    AppApps & desktopC++ · 2,379 stars · +316 this week · 206 days old

  • samir-sarwar/samir-vllm

    A learning-oriented LLM inference engine written in C++17 and CUDA that runs Llama 3.2 1B Instruct. It loads safetensors weights to the GPU, implements tokenizer, prefill and decode with paged KV cach

    ResourceModels & inferenceC++ · 223 stars · +64 this week · 82 days old · HN 80 pts

  • runboubou/boubou

    A command-line tool for talking with AI out loud. Runs open models locally on your machine, with microphone input, spoken replies, echo cancellation and speech detection. Also serves a browser or phon

    AppModels & inferenceRust · 95 stars · +93 this week · 15 days old

  • manuelgscom/inside-llm

    A native binary that loads one or two GGUF models via llama.cpp and shows in the browser per-token probabilities, discarded alternatives, sampler effects, and the token where two models' outputs diver

    AppModels & inferenceTypeScript · 90 stars · +90 this week · 2 days old