Pinned Loading

1. DeepLink-org/DLSlime DeepLink-org/DLSlime Public

   Composable and Embeddable Communication Runtime for Distributed AI Services

   C++ 102 9

2. DeepLink-org/DLEngine DeepLink-org/DLEngine Public

   LLM Inference with Prefill-Decode Disaggregation and Wide Expert Parallelism

   Python 4 1

3. NanoRL NanoRL Public

   Ray-Orchestrated Off-Policy RL for Large Language Models

   Python

4. InternLM/lmdeploy InternLM/lmdeploy Public

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 7.9k 701

5. tropical-project tropical-project Public

   [DAC2025] Tropical: Enhancing SLO Attainment in Disaggregated LLM Serving via SLO-Aware Multiplexing

   Python 1

6. FAIT FAIT Public

   [DAC2024, TensorSSA] A Holistic Functionalization Approach to Optimizing Imperative Tensor Programs in Deep Learning

   C++ 2