RepoAlerts

ShinMegamiBoson/lookatmyquant

Library

Can I trust it?

No red flags in our checks.

  • Stars from real accounts No data

    We haven't checked its stars for fakes yet.

  • Active OK

    Last change today.

  • Licence OK

    MIT: you can use it for free, also in a commercial product. Keep the licence notice.

Quick checks from public data. They help, but they are no guarantee.

What it is

A quantization compiler for neural network models. It measures how much each stored weight piece degrades output when compressed, then assigns a quantization code to each piece so the whole model fits a given size budget with minimal loss. Reports lower KL divergence than Q4_K_M…

Who it's for

Developers and researchers compressing large language models into smaller GGUF or MLX files for local inference

How to use it

Ask your AI to set it up

Paste this into Claude, ChatGPT or your coding assistant.

Help me install and set up ShinMegamiBoson/lookatmyquant in my project. Follow its README: https://github.com/ShinMegamiBoson/lookatmyquant. Explain each step and check it is safe before running anything.

Read the README

Star curve

532From 0 to 532 stars between 31 Oct 2026 and 22 Nov 2026.

On the radar

22 Nov 2026: #3
Best place #3, on 22 Nov 2026. In the top 100 on 1 of the last 36 days.

Its place among the radar's top 100, day by day, with #1 at the top. Gaps are days it was out of the top 100.

Records

  • Best place on RepoAlerts: #3, on 22 Nov 2026
  • On the Hacker News front page on 21 Nov 2026

Alternatives

Similar projects named in its profile. Each link searches the directory.

On Hacker News

Get alerts for repos like this

We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.

What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy

For maintainers

Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.

[![ShinMegamiBoson/lookatmyquant on RepoAlerts](https://repoalerts.com/badge/ShinMegamiBoson/lookatmyquant.svg)](https://repoalerts.com/repo/ShinMegamiBoson/lookatmyquant?ref=badge)
Share on X

  • RustingStudio/RustingStrata

    Pure-Rust inference engine for Qwen3.5/3.6 MoE GGUF models, with CUDA kernels compiled at run time via NVRTC and a Vulkan backend. Runs experts that do not fit in VRAM on the CPU alongside the GPU and

    AppModels & inferenceRust · 342 stars · +106 this week · 43 days old

  • manuelgscom/inside-llm

    A native binary that loads one or two GGUF models via llama.cpp and shows in the browser per-token probabilities, discarded alternatives, sampler effects, and the token where two models' outputs diver

    AppModels & inferenceTypeScript · 118 stars · +118 this week · 7 days old

  • JakeATX/llamAmpere

    A fork of llama.cpp tuned for NVIDIA RTX 30-series Ampere GPUs, especially the RTX 3090 and 3090 Ti. It runs Qwen3.8 models, including Qwen3.8-27B with its built-in MTP draft head and a Flash-Next var

    AppModels & inferenceC++ · 411 stars · +30 this week · 76 days old

  • apple-aiml-research/ml-rsi-inference-bench

    A long-horizon benchmark for coding agents that improve the inference stack of large language models in vLLM or SGLang. Tasks cover supporting a model on day 0, optimizing it after launch, and repairi

    AI agentsPython · 181 stars · +16 this week · 37 days old

  • AmSach/maple

    Research project that prunes low-activation experts from Mixture-of-Experts LLMs using routing statistics from a calibration corpus, with a reference Gemma 4 26B-A4B model reduced to about 4.75 GB for

    Models & inferencePython · 65 stars · +14 this week · 15 days old · HN 21 pts

  • duliangkuan/raise-an-ai

    A browser-based educational simulator for LLM inference stages (loading, prefill, decode) that runs without a GPU. It uses illustrative formulas and preset text; it does not execute DeepInfer or load

    AppModels & inferenceJavaScript · 103 stars · 33 days old