Dev
GitHub repos gaining traction - what high-signal users are starring and what's climbing the board, captured daily and enriched from GitHub. Raw material for spotting new tech and patterns worth building on.
3,195
repos tracked
105
surfaced this week
193
created < 30d
Python
top language
11 repos
-
A high-throughput and memory-efficient inference and serving engine for LLMs
-
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
-
SGLang is a high-performance serving framework for large language models and multimodal models.
-
Note taking & PDF library
-
Halo is an open-source framework built by White Circle for training large language and multimodal models
-
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
-
FlashInfer: Kernel Library for LLM Serving
-
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
-
Fused MoE kernel
-
Compact and Agent-Native MoE Training System