RepoAlerts
SponsorGet alerts

jayleaton/localrouter

App

Get alerts like thisView on GitHubShare on X

Can I trust it?

No red flags in our checks.

  • Stars from real accounts No data

    We haven't checked its stars for fakes yet.

  • Active OK

    Last change today.

  • Licence OK

    Apache-2.0: you can use it for free, also in a commercial product. Keep the licence notice.

Quick checks from public data. They help, but they are no guarantee.

What it is

A local AI routing daemon written in Zig for one NVIDIA DGX Spark. It runs chat, voice, speech recognition, image and video models on the box, loads them on demand, manages GPU memory, and exposes all tools through one MCP server and an OpenAI-compatible API. Early preview.

Who it's for

Developers running local AI models on their own NVIDIA DGX Spark who want MCP and OpenAI-compatible access to chat, voice, image and video

How to use it

Install

tools/install/bootstrap.sh --profile jarvis-gb10 --accept

From its README. Check it there before running it.

Ready-made installers, when the project publishes them, are on its latest release.

Downloads (if any)

Ask your AI to set it up

Paste this into Claude, ChatGPT or your coding assistant.

Help me install and set up jayleaton/localrouter in my project. Follow its README: https://github.com/jayleaton/localrouter. Explain each step and check it is safe before running anything.

Star curve

50From 0 to 50 stars between 8 Oct 2026 and 23 Oct 2026.

Get alerts for repos like this

We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.

19,302 GitHub repos watched and ranked every hour. Figures as of 23 October 2026.

What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy

For maintainers

Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.

[![jayleaton/localrouter on RepoAlerts](https://repoalerts.com/badge/jayleaton/localrouter.svg)](https://repoalerts.com/repo/jayleaton/localrouter?ref=badge)
Share on X
  • Generated-Computers/Locals

    A local inference server for Apple Silicon Macs that runs many AI agents at once, with tool calls constrained to each tool's schema and prompt caching across turns. It works with coding agents such as

    AppAI agentsPython · 299 stars · +283 this week · 10 days old

  • MiaAI-Lab/DeepSeek-v4.1-Flash-1017-2x-DGX-Sparks

    Serves the DeepSeek-V4.1-Flash-1017 model split across two NVIDIA DGX Sparks through an OpenAI-compatible API on port 8888. Uses the TensorFold native Zig engine, a 2.9 bpw EXL3 quantization, a 1,048,

    AppModels & inferenceShell · 249 stars · +249 this week · 4 days old

  • VecSzn/PolyStrata

    Runs large open-weight language models locally on an NVIDIA GPU, with OpenAI- and Anthropic-compatible API endpoints served on localhost. Includes a second, experimental inference engine for several m

    AppModels & inferenceC++ · 396 stars · +248 this week · 16 days old

  • NVIDIA/flare-local-inference

    A local inference server for NVIDIA SM120/SM121 GPUs aimed at long conversations, coding agents and repeated tool use. Models are prepared at build time with PyTorch, Transformers and FlashInfer, then

    AppModels & inferencePython · 613 stars · +613 this week · 3 days old

  • justxor/deepseek-local-guide-ru

    A Russian-language guide for installing and running DeepSeek models locally on PC, Mac and servers. Covers Ollama, llama.cpp, LM Studio, vLLM, SGLang and Open WebUI, plus API usage, RAG, agents and fi

    Models & inferenceShell · 133 stars · +133 this week · 6 days old

  • JosssphZhou/groki-bot

    Firmware and computer-side gateway for a desktop robot built on an M5Stack CoreS3 with a Stack-chan base. The gateway runs on macOS and adds wake-word voice, face tracking with servo steering, and a l

    AI agentsC++ · 181 stars · +122 this week · 30 days old