happyme531/open_rknpu2_lm_infer
Can I trust it?
Worth a closer look before you use it.
Warnings Check
Very new: it was created 10 days ago. Wait a little before installing it.
Stars from real accounts No data
We haven't checked its stars for fakes yet.
Active OK
Last change today.
Licence Check
AGPL-3.0: free to use. If you include it in something you distribute, or even only run as an online service, you must publish your code under the same licence.
Quick checks from public data. They help, but they are no guarantee.
From the GitHub description
Fully open-source, high-performance LLM inference engine for the RK3588 NPU
We haven't written this repo up yet. It gets a summary once it enters the radar's top.
How to use it
Ask your AI to set it up
Paste this into Claude, ChatGPT or your coding assistant.
Help me install and set up happyme531/open_rknpu2_lm_infer in my project. Follow its README: https://github.com/happyme531/open_rknpu2_lm_infer. Explain each step and check it is safe before running anything.
Star curve
Get alerts for repos like this
We'll email you when something in Models & inference starts rising. Free, once a week, only what matches.
19,777 GitHub repos watched and ranked every hour. Figures as of 24 October 2026.
What arrives: one email on Mondays with the repos that match, never more. See last week's. Privacy
For maintainers
Add this badge to your README. It shows the repo's place on the radar, updates every hour and links back to this page.
[](https://repoalerts.com/repo/happyme531/open_rknpu2_lm_infer?ref=badge)Similar repos
- deepseek-ai/DeepInfer
Inference framework for serving DeepSeek models at scale, released as an offline inference build. Provides optimized kernels, attention and MoE parallelism, speculative decoding, asynchronous scheduli
- SoMarkAI/OXR
An open-source document parsing model that converts PDFs and document images into Markdown or JSON with layout coordinates. It recognizes 13 element types, including tables, formulas and chemical stru
- deepseek-ai/deepseek-recipe
A collection of Rust libraries and Python bindings that convert Messages, Chat Completions and Responses API requests into a common Conversation format, render it into DeepSeek V4 and V4.1 prompts, en
- Alejandros17487/ai-jailbreaks
Collection of about 35 jailbreak prompts, system prompts and agent configuration files aimed at bypassing safety behavior in various AI models, including Ollama Modelfiles. The README states it is int
- eagle-hq/EAGLE-4
Official inference code for EAGLE-4, a speculative decoding system whose drafter adapts its speculation to batch size, hardware and workload. It serves EAGLE-4 drafts on SGLang, vLLM and TokenSpeed th
- misakano7545/workbuddy2api-panel
A self-hosted Go gateway that wraps Tencent CodeBuddy accounts into an OpenAI-compatible API (chat completions, Responses and Anthropic Messages endpoints). It pools multiple accounts with rotation, c