Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 2.5k 332

2. kubernetes-sigs/gateway-api-inference-extension kubernetes-sigs/gateway-api-inference-extension Public

   Gateway API Inference Extension

   Go 596 254

3. llm-d-incubation/llm-d-infra llm-d-incubation/llm-d-infra Public

   llm-d helm charts and deployment examples

   Go Template 50 55

4. llm-d-incubation/llm-d-modelservice llm-d-incubation/llm-d-modelservice Public

   helm charts for deploying models with llm-d

   Go Template 28 51

5. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 71.5k 13.8k