Dev
GitHub repos gaining traction - what high-signal users are starring and what's climbing the board, captured daily and enriched from GitHub. Raw material for spotting new tech and patterns worth building on.
2,235
repos tracked
175
surfaced this week
194
created < 30d
Python
top language
9 repos
-
A high-throughput and memory-efficient inference and serving engine for LLMs
-
SGLang is a high-performance serving framework for large language models and multimodal models.
-
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
-
FlashInfer: Kernel Library for LLM Serving
-
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
-
Fused MoE kernel
-
Compact and Agent-Native MoE Training System
-
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)