High-performance Rust CLI and library achieving 10K+ req/s for LLM APIs. Features weighted load-balancing, HTTP/2 pooling, and real-time statistics.
-
Updated
Nov 29, 2025 - Rust
High-performance Rust CLI and library achieving 10K+ req/s for LLM APIs. Features weighted load-balancing, HTTP/2 pooling, and real-time statistics.
High-performance Rust API with AI, multi-format docs, Gemini integration, security, CLI.
Add a description, image, and links to the tokio-runtime topic page so that developers can more easily learn about it.
To associate your repository with the tokio-runtime topic, visit your repo's landing page and select "manage topics."