Dev
GitHub repos gaining traction - what high-signal users are starring and what's climbing the board, captured daily and enriched from GitHub. Raw material for spotting new tech and patterns worth building on.
3,195
repos tracked
105
surfaced this week
193
created < 30d
Python
top language
8 repos
-
Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
-
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
-
FlashInfer: Kernel Library for LLM Serving
-
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
-
A Datacenter Scale Distributed Inference Serving Framework
-
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
-
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
-
KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.