RepoAlerts

mw00/project-maya

Can I trust it?

No red flags in our checks.

  • Stars from real accounts No data

    We haven't checked its stars for fakes yet.

  • Active OK

    Last change today.

  • Licence OK

    MIT: you can use it for free, also in a commercial product. Keep the licence notice.

Quick checks from public data. They help, but they are no guarantee.

What it is

A C++ engine, server and dashboard for running the GLM-5.3-Flash and DeepSeek-V4.1-Flash models locally on one to sixteen NVIDIA or AMD GPUs, on Linux or Windows. It offers OpenAI- and Anthropic-compatible APIs with tool calls, several concurrent requests, a browser chat and…

Who it's for

Developers and power users who want to self-host very large mixture-of-experts LLMs on their own GPUs, and connect coding agents to a local API

How to use it

Ask your AI to set it up

Paste this into Claude, ChatGPT or your coding assistant.

Help me install and set up mw00/project-maya in my project. Follow its README: https://github.com/mw00/project-maya. Explain each step and check it is safe before running anything.

Read the README

Star curve

1.2KFrom 0 to 1,225 stars between 6 Oct 2026 and 20 Oct 2026.

Alternatives

Similar projects named in its profile. Each link searches the directory.

Get alerts for repos like this

We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.

18,263 GitHub repos watched and ranked every hour. Figures as of 20 October 2026.

What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy

For maintainers

Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.

[![mw00/project-maya on RepoAlerts](https://repoalerts.com/badge/mw00/project-maya.svg)](https://repoalerts.com/repo/mw00/project-maya?ref=badge)
Share on X

  • VecSzn/PolyStrata

    Runs large open-weight language models locally on a PC with NVIDIA GPUs, using a PolyStrata engine for several models and the Strata engine for Qwen3.8-Flash-Next. Offers OpenAI- and Anthropic-compati

    Models & inferenceC++ · 305 stars · +194 this week · 14 days old

  • justxor/deepseek-local-guide-ru

    A Russian-language guide for installing and running DeepSeek models locally on PC, Mac and servers. Covers Ollama, llama.cpp, LM Studio, vLLM, SGLang and Open WebUI, plus API usage, RAG, agents and fi

    Models & inferenceShell · 124 stars · +124 this week · 3 days old

  • deepseek-ai/DeepInfer

    Open-source offline inference framework for DeepSeek models, offering optimized kernels, MoE expert and attention parallelism, speculative decoding, asynchronous scheduling, deterministic sampling and

    Models & inferencePython · 10,955 stars · +10,955 this week · 4 days old · HN 1888 pts

  • MiaAI-Lab/DeepSeek-v4.1-Flash-1017-2x-DGX-Sparks

    Serves DeepSeek-V4.1-Flash-1017 across two NVIDIA DGX Sparks through an OpenAI-compatible API, using TensorFold's native Zig engine and a 2.9 bpw EXL3 quantization. Supports long context up to 1,048,5

    Models & inferenceShell · 157 stars · +157 this week · 2 days old

  • prabanta-dev/janas

    A C inference engine for running large mixture-of-experts language models on ordinary computers, with or without a GPU. Weights stay on disk, and the experts each token needs are streamed from an NVMe

    Models & inferenceC · 452 stars · +156 this week · 30 days old · HN 220 pts

  • Indras-Mirror/Xolotl

    A C++ inference engine and OpenAI/Anthropic-compatible server, forked from Strata, that runs large MoE models such as DeepSeek-V4.1-Flash (552B) on one 24 GB NVIDIA GPU by tiering expert weights acros

    Models & inferenceC++ · 226 stars · +210 this week · 14 days old