Aevonix/FlashAlign
App
Can I trust it?
Worth a closer look before you use it.
Warnings Check
Very new: it was created yesterday. Wait a little before installing it.
Stars from real accounts No data
We haven't checked its stars for fakes yet.
Active OK
Last change today.
Licence Check
AGPL-3.0: free to use. If you include it in something you distribute, or even only run as an online service, you must publish your code under the same licence.
Quick checks from public data. They help, but they are no guarantee.
What it is
Applies alignment profiles per request to models served through an inference engine, using abliteration for approved users and channels or keeping a profile active on all routed requests. Works with supported base and quantized weights without permanently modifying them, and…
Who it's for
Developers running self-hosted LLMs on vLLM, SGLang, llama.cpp or TensorFold who need per-request model alignment control
How to use it
Install
bash ./install.sh --autoFrom its README. Check it there before running it.
Ready-made installers, when the project publishes them, are on its latest release.
Ask your AI to set it up
Paste this into Claude, ChatGPT or your coding assistant.
Help me install and set up Aevonix/FlashAlign in my project. Follow its README: https://github.com/Aevonix/FlashAlign. Explain each step and check it is safe before running anything.
Star curve
Get alerts for repos like this
We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.
23,615 GitHub repos watched and ranked every hour. Figures as of 1 November 2026.
What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy
For maintainers
Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.
[](https://repoalerts.com/repo/Aevonix/FlashAlign?ref=badge)Similar repos
- modelsphere/modelsphere
An open-source LLM inference platform for Kubernetes that deploys models via Helm charts, with routing, autoscaling, and request recovery components. It supports NVIDIA GPUs, Huawei Ascend and other a
- Indras-Mirror/Xolotl
Local inference engine for large MoE and dense LLMs (DeepSeek-V4.1-Flash, GLM-5.3-Flash, Qwen3.8 models) on a single NVIDIA GPU, with expert weights tiered across VRAM, pinned RAM and NVMe. Serves Ope
- apple-aiml-research/ml-rsi-inference-bench
A long-horizon benchmark for coding agents that improve the inference stack of large language models in vLLM or SGLang. Tasks cover supporting a model on day 0, optimizing it after launch, and repairi
- freriadoc/Avalon
A fork of llama.cpp tuned for running the Qwen3.8-Flash-Next 125B MoE model on a single consumer AMD GPU with experts offloaded to system RAM. It uses an expert cache in VRAM, CPU computation of missi
- synchopate/nemotron-30b-cpu-256k
Describes a research write-up and engineering approach for running a 30B hybrid Mamba-2 MoE model (Nemotron) on a Ryzen 9 9955HX CPU with a 256K context window, using llama.cpp with custom AVX-512 ker
- heterodoxin/AbliteratedOutTheBox
A llama.cpp fork that reads refusal and disclaimer directions from each prompt at inference and removes them from activations when a look-ahead gate fires, without modifying the stored model weights.