RepoAlerts

Veloresearch/kinetic

CLI tool

Can I trust it?

Worth a closer look before you use it.

  • Warnings Check

    Very new: it was created 6 days ago. Wait a little before installing it.

  • Stars from real accounts No data

    We haven't checked its stars for fakes yet.

  • Active OK

    Last change today.

  • Licence OK

    Apache-2.0: you can use it for free, also in a commercial product. Keep the licence notice.

Quick checks from public data. They help, but they are no guarantee.

What it is

A Rust inference engine that runs GGUF models, the llama.cpp format, on CPU and on NVIDIA, AMD and Intel GPUs from one binary. It includes speculative decoding and prompt-state reuse for faster generation, and claims output identical to plain decoding.

Who it's for

Developers and users who want to run local LLMs on their own computer, on CPU or GPU, from a command line or a server

How to use it

Install

cargo install --locked --git https://github.com/Veloresearch/kinetic kinetic-cli

From its README. Check it there before running it.

Ask your AI to set it up

Paste this into Claude, ChatGPT or your coding assistant.

Help me install and set up Veloresearch/kinetic in my project. Follow its README: https://github.com/Veloresearch/kinetic. Explain each step and check it is safe before running anything.

Star curve

89From 0 to 89 stars between 10 Nov 2026 and 15 Nov 2026.

Alternatives

Similar projects named in its profile. Each link searches the directory.

Get alerts for repos like this

We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.

What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy

For maintainers

Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.

[![Veloresearch/kinetic on RepoAlerts](https://repoalerts.com/badge/Veloresearch/kinetic.svg)](https://repoalerts.com/repo/Veloresearch/kinetic?ref=badge)
Share on X

  • RustingStudio/RustingStrata

    Pure-Rust inference engine for Qwen3.5/3.6 MoE GGUF models, with CUDA kernels compiled at run time via NVRTC and a Vulkan backend. Runs experts that do not fit in VRAM on the CPU alongside the GPU and

    AppModels & inferenceRust · 253 stars · +103 this week · 37 days old

  • samir-sarwar/samir-vllm

    A learning-oriented LLM inference engine written in C++17 and CUDA that runs Llama 3.2 1B Instruct. It loads safetensors weights to the GPU, implements tokenizer, prefill and decode with paged KV cach

    ResourceModels & inferenceC++ · 223 stars · +190 this week · 81 days old · HN 80 pts

  • openlake-project/openlake

    A Rust storage engine built on io_uring for GPU workloads. It offers KV cache offload for LLM inference across GPU hosts, plus an S3-compatible object store for checkpoints and training data. The READ

    AppDev infrastructureRust · 3,095 stars · +246 this week · 203 days old

  • freriadoc/Avalon

    A fork of llama.cpp tuned for running the Qwen3.8-Flash-Next 125B MoE model on a single consumer AMD GPU with experts offloaded to system RAM. It uses an expert cache in VRAM, CPU computation of missi

    LibraryModels & inferenceC++ · 436 stars · +50 this week · 38 days old

  • manuelgscom/inside-llm

    A native binary that loads one or two GGUF models via llama.cpp and shows in the browser per-token probabilities, discarded alternatives, sampler effects, and the token where two models' outputs diver

    AppModels & inferenceTypeScript · 59 stars · +59 this week · 1 day old

  • simplexai-labs/PolyStrata

    Runs large open-weight language models locally on an NVIDIA GPU, with OpenAI- and Anthropic-compatible API endpoints served on localhost. Includes a second, experimental inference engine for several m

    AppModels & inferenceC++ · 1,085 stars · +151 this week · 41 days old