ShinMegamiBoson/lookatmyquant
Library
Can I trust it?
No red flags in our checks.
Stars from real accounts No data
We haven't checked its stars for fakes yet.
Active OK
Last change today.
Licence OK
MIT: you can use it for free, also in a commercial product. Keep the licence notice.
Quick checks from public data. They help, but they are no guarantee.
What it is
A quantization compiler for neural network models. It measures how much each stored weight piece degrades output when compressed, then assigns a quantization code to each piece so the whole model fits a given size budget with minimal loss. Reports lower KL divergence than Q4_K_M…
Who it's for
Developers and researchers compressing large language models into smaller GGUF or MLX files for local inference
How to use it
Ask your AI to set it up
Paste this into Claude, ChatGPT or your coding assistant.
Help me install and set up ShinMegamiBoson/lookatmyquant in my project. Follow its README: https://github.com/ShinMegamiBoson/lookatmyquant. Explain each step and check it is safe before running anything.
Star curve
On the radar
Its place among the radar's top 100, day by day, with #1 at the top. Gaps are days it was out of the top 100.
Records
- Best place on RepoAlerts: #3, on 22 Nov 2026
- On the Hacker News front page on 21 Nov 2026
Alternatives
Similar projects named in its profile. Each link searches the directory.
On Hacker News
- Inkling-2-Mini in 5.4 GB Memory550 points · 131 comments · 21 Nov 2026
Get alerts for repos like this
We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.
What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy
For maintainers
Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.
[](https://repoalerts.com/repo/ShinMegamiBoson/lookatmyquant?ref=badge)Similar repos
- RustingStudio/RustingStrata
Pure-Rust inference engine for Qwen3.5/3.6 MoE GGUF models, with CUDA kernels compiled at run time via NVRTC and a Vulkan backend. Runs experts that do not fit in VRAM on the CPU alongside the GPU and
- manuelgscom/inside-llm
A native binary that loads one or two GGUF models via llama.cpp and shows in the browser per-token probabilities, discarded alternatives, sampler effects, and the token where two models' outputs diver
- JakeATX/llamAmpere
A fork of llama.cpp tuned for NVIDIA RTX 30-series Ampere GPUs, especially the RTX 3090 and 3090 Ti. It runs Qwen3.8 models, including Qwen3.8-27B with its built-in MTP draft head and a Flash-Next var
- apple-aiml-research/ml-rsi-inference-bench
A long-horizon benchmark for coding agents that improve the inference stack of large language models in vLLM or SGLang. Tasks cover supporting a model on day 0, optimizing it after launch, and repairi
- AmSach/maple
Research project that prunes low-activation experts from Mixture-of-Experts LLMs using routing statistics from a calibration corpus, with a reference Gemma 4 26B-A4B model reduced to about 4.75 GB for
- duliangkuan/raise-an-ai
A browser-based educational simulator for LLM inference stages (loading, prefill, decode) that runs without a GPU. It uses illustrative formulas and preset text; it does not execute DeepInfer or load