Dev
GitHub repos gaining traction - what high-signal users are starring and what's climbing the board, captured daily and enriched from GitHub. Raw material for spotting new tech and patterns worth building on.
3,195
repos tracked
105
surfaced this week
193
created < 30d
Python
top language
29 repos
-
An open-source inference engine for AI functions in SQL
-
A high-throughput and memory-efficient inference and serving engine for LLMs
-
A high-throughput and memory-efficient inference and serving engine for LLMs
-
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
-
Multimodal RL training framework for diffusion & omni models
-
A high-throughput and memory-efficient inference and serving engine for LLMs
-
A high-throughput and memory-efficient inference and serving engine for LLMs
-
TPU inference for vLLM, with unified JAX and PyTorch support.
-
AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods
-
Halo is an open-source framework built by White Circle for training large language and multimodal models
-
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
-
★ 0 jxmorris12/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
-
A high-performance and light-weight router for vLLM large scale deployment
-
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
-
A high-throughput and memory-efficient inference and serving engine for LLMs
-
Accurate, large-scale, and extensible simulator for LLM inference Systems
-
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
-
A Datacenter Scale Distributed Inference Serving Framework
-
vLLM 0.25.1 serving stack for poolside/Laguna-S-2.1-NVFP4 with DFlash speculative decoding — DGX Spark & RTX 6000 PRO
-
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
-
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
-
Working recipe to serve DeepSeek-V4-Flash across two NVIDIA DGX Spark (GB10) nodes with vLLM (TP=2, FP8 KV, MTP) over a RoCE/RDMA link — Docker image, launch scripts, RDMA/NCCL setup, and the gotchas.
-
A PyTorch native library for training speculative decoding models
-
Build configuration for vLLM
-
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
-
An LLM post-training framework with vLLM for RL Scaling
-
Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.
-
KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.