Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU
-
Updated
Nov 11, 2024 - Python
Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU
rkllm rust ffi binding
Terraform provider for Turing Pi 2.5 BMC. Use with jfreed-dev/modules/turingpi for cluster deployment.
Terraform modules for Turing Pi clusters. Use with jfreed-dev/turingpi provider.
A fork of exo-explore/exo that adds RKLLM inference engine support for Rockchip RK3588/RK3576 NPU devices.📱💻 🖥️⌚
Based on RKLLM-Gradio and smolLM2-GradioChatbot, runs LLMs on the R3588 NPU using Gradio interface.
Convert HuggingFace models to RKLLM format and upload to HuggingFace.
Add a description, image, and links to the rkllm topic page so that developers can more easily learn about it.
To associate your repository with the rkllm topic, visit your repo's landing page and select "manage topics."