StargazerX0/SpecPilot
Agent
Can I trust it?
Worth a closer look before you use it.
Warnings Check
Very new: it was created 6 days ago. Wait a little before installing it.
Stars from real accounts No data
We haven't checked its stars for fakes yet.
Active OK
Last change 3 days ago.
Licence OK
Apache-2.0: you can use it for free, also in a commercial product. Keep the licence notice.
Quick checks from public data. They help, but they are no guarantee.
What it is
Agentic loop that discovers lossless optimizations for speculative decoding, shipping tuned serving engines for six deployments of Qwen3.8-27B and Muse-Glimmer-30B with DFlash2 and DSpark drafters on H100 and RTX PRO 6000 GPUs, with scripts to serve, benchmark and verify them…
Who it's for
ML engineers serving large language models with speculative decoding on H100 or RTX PRO 6000 GPUs
How to use it
Install
bash scripts/setup_env.shFrom its README. Check it there before running it.
Ask your AI to set it up
Paste this into Claude, ChatGPT or your coding assistant.
Help me install and set up StargazerX0/SpecPilot in my project. Follow its README: https://github.com/StargazerX0/SpecPilot. Explain each step and check it is safe before running anything.
Star curve
Get alerts for repos like this
We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.
What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy
For maintainers
Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.
[](https://repoalerts.com/repo/StargazerX0/SpecPilot?ref=badge)Similar repos
- eagle-hq/EAGLE-4
Official inference code for EAGLE-4, a speculative decoding system whose drafter adapts its speculation to batch size, hardware and workload. It serves EAGLE-4 drafts on SGLang, vLLM and TokenSpeed th
- inclusionAI/ASpec
A high-throughput training framework for speculative decoding draft models. It optimizes draft forward and backward passes, overlaps training with target feature generation, and shares compatible targ
- apple-aiml-research/ml-rsi-inference-bench
A long-horizon benchmark for coding agents that improve the inference stack of large language models in vLLM or SGLang. Tasks cover supporting a model on day 0, optimizing it after launch, and repairi
- vixhal-baraiya/qwenGPU
An experimental model: Qwen3.5-2B with a SIMT GPU compiled into its weights as 45 extra layers. The model executes CUDA kernels compiled to PTX, with its Gated DeltaNet layers holding registers and me
- RustingStudio/RustingStrata
Pure-Rust inference engine for Qwen3.5/3.6 MoE GGUF models, with CUDA kernels compiled at run time via NVRTC and a Vulkan backend. Runs experts that do not fit in VRAM on the CPU alongside the GPU and
- synchopate/llama-modchip
Describes a research write-up and engineering approach for running a 30B hybrid Mamba-2 MoE model (Nemotron) on a Ryzen 9 9955HX CPU with a 256K context window, using llama.cpp with custom AVX-512 ker