ZOYKUHot Board
ZOYKU · Open Source Intelligence · Repository archive

tiiny-ai/powerinfer

High-speed Large Language Model Serving for Local Deployment

C++MITInactivity warning · Pushed 182d ago#large-language-models#llama#llm#llm-inference#local-inference
DocumentationOpen on GitHub
stars
9.9k
forks
618
issues
134
Daily star gain
—
days old
3d
6-Axis Combat Radar

Combat Limits & Architectural Persona

Compare with other repos ->
Architectural Persona
Specialized Tactical Vanguard
Distinct edge and dedicated footprint in specialized territory
Combat Score
58
/ 100
7-Day Star Velocity
0
Fork/Star Adoption
6.3%

Cumulative stars

Next Milestone: 10k (126 stars to go)+2 (3d)
2026-11-09: 9.9k
Daily star gain
Max: +1 / day

Similar projects · shared language & topics

tensorflow/tensorflow201.4kggml-org/llama.cpp133.8kreact/react-native126.9kelectron/electron123.8kgodotengine/godot119.9kmicrosoft/terminal105.4k
Maintainer Badge Studio

Embed GitHub README Live Badge

Embed dynamic SVG badges into your README to reflect real-time rankings and documentation mirrors.

Preview240 x 64 px SVG
GitHub Dark ThemeGitHub Hot Rank - tiiny-ai/powerinfer Dark Preview
GitHub Light ThemeGitHub Hot Rank - tiiny-ai/powerinfer Light Preview
GitHub README <picture> (Auto Dark/Light)
<a href="https://git.zoyku.com/en/repo/tiiny-ai/powerinfer" target="_blank" rel="noopener noreferrer">
  <picture>
    <source media="(prefers-color-scheme: dark)" srcset="https://git.zoyku.com/api/badge/card/tiiny-ai/powerinfer?theme=dark&lang=en" />
    <img alt="GitHub Hot Rank - tiiny-ai/powerinfer" src="https://git.zoyku.com/api/badge/card/tiiny-ai/powerinfer?theme=light&lang=en" height="64" />
  </picture>
</a>