Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 48.9k 7.8k

2. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 3.4k 274

3. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 14.9k 1.9k