RepoAlerts

huawei-csl/MACaQ

Library

Can I trust it?

Worth a closer look before you use it.

  • Warnings Check

    Very new: it was created 6 days ago. Wait a little before installing it.

  • Stars from real accounts No data

    We haven't checked its stars for fakes yet.

  • Active OK

    Last change 4 days ago.

  • Licence OK

    Apache-2.0: you can use it for free, also in a commercial product. Keep the licence notice.

Quick checks from public data. They help, but they are no guarantee.

What it is

A model-agnostic quantization toolkit that quantizes text, image, video and audio models to low-bit formats, including 2/3/4-bit GGUF for llama.cpp and W4A4 checkpoints for vLLM, Diffusers and PyTorch. It also refines quantized GGUF weight codes in its MACaQ-R method.

Who it's for

ML engineers and developers quantizing and running LLMs, diffusion and speech models locally or on vLLM

How to use it

Ask your AI to set it up

Paste this into Claude, ChatGPT or your coding assistant.

Help me install and set up huawei-csl/MACaQ in my project. Follow its README: https://github.com/huawei-csl/MACaQ. Explain each step and check it is safe before running anything.

Read the README

Star curve

318From 0 to 318 stars between 10 Nov 2026 and 16 Nov 2026.

On the radar

12 Nov 2026: #8013 Nov 2026: #76
Best place #76, on 13 Nov 2026. In the top 100 on 2 of the last 30 days.

Its place among the radar's top 100, day by day, with #1 at the top. Gaps are days it was out of the top 100.

Records

  • Best place on RepoAlerts: #76, on 13 Nov 2026
  • In the top 100 for 2 days since 12 Nov 2026
  • On the Hacker News front page on 11 Nov 2026

Alternatives

Similar projects named in its profile. Each link searches the directory.

On Hacker News

Get alerts for repos like this

We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.

What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy

For maintainers

Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.

[![huawei-csl/MACaQ on RepoAlerts](https://repoalerts.com/badge/huawei-csl/MACaQ.svg)](https://repoalerts.com/repo/huawei-csl/MACaQ?ref=badge)
Share on X

  • manuelgscom/inside-llm

    A native binary that loads one or two GGUF models via llama.cpp and shows in the browser per-token probabilities, discarded alternatives, sampler effects, and the token where two models' outputs diver

    AppModels & inferenceTypeScript · 62 stars · +62 this week · 1 day old

  • JakeATX/llamAmpere

    A fork of llama.cpp tuned for NVIDIA RTX 30-series Ampere GPUs, especially the RTX 3090 and 3090 Ti. It runs Qwen3.8 models, including Qwen3.8-27B with its built-in MTP draft head and a Flash-Next var

    AppModels & inferenceC++ · 383 stars · +83 this week · 70 days old

  • vladimirrott/mojo-dllm

    Local inference runtime for the diffusion language models LLaDA-8B and Dream-7B from quantized GGUF files, on CPU or NVIDIA GPU. The GGUF reader, tokenizer, quantized matrix multiply, GPU kernels, tra

    LibraryModels & inferencePython · 540 stars · +44 this week · 43 days old

  • divagr18/QwenPU

    A Qwen3.5-4B model modified with a 32-bit RISC-V CPU and a vector unit compiled into its weights, which runs Karpathy's stories260K Llama as a C program inside the model's forward passes. It is a rese

    ModelModels & inferencePython · 139 stars · +8 this week · 16 days old

  • mw00/project-maya

    Runs GLM-5.3-Flash and DeepSeek-V4.1-Flash-1017 locally on one or more NVIDIA or AMD GPUs, with an engine, server, browser dashboard, quantization tools and OpenAI- and Anthropic-compatible API. Exper

    AppModels & inferenceC++ · 2,941 stars · +224 this week · 41 days old

  • zzzz7788990213-ops/EvoVLM

    Research code for LLM-guided evolutionary search over vision-language inference programs. It mutates prompts, image preprocessing, generation budgets and answer extraction for a frozen Qwen3-VL-2B mod

    Models & inferencePython · 5 stars · 45 days old