A high-performance inference engine for LLMs, optimized for diverse AI accelerators.
-
Updated
Oct 31, 2025 - C++
#
qwen
Here are 15 public repositories matching this topic...
校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
-
Updated
Oct 28, 2025 - C++
-
Updated
Sep 18, 2025 - C++
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
bloom falcon moe gemma mistral mixture-of-experts model-quantization multi-gpu-inference m2m100 llamacpp llm-inference internlm llama2 qwen baichuan2 mixtral phi-2 deepseek minicpm
-
Updated
Mar 15, 2024 - C++
High-speed and easy-use LLM serving framework for local deployment
-
Updated
Aug 7, 2025 - C++
基于各种LLM的聊天机器人框架，支持多语言，语音唤醒,语音对话,本地执行功能,支持 OpenAI，Grok, Claude，讯飞星火，Stable Diffusion，ChatGLM，通义千问，腾讯混元，360 智脑，百川 AI，火山方舟，Ollama ,Gemini等API
bot framework cpp chatbot gemini whisper grok voice-assistant claude gemini-api live2d-cubism llm chatgpt-api chatgpt-bot whisper-cpp qwen
-
Updated
Oct 12, 2025 - C++
An AI-powered embedded system that captures real-time images, generates descriptive captions using Qwen, and reads them out loud to assist the visually impaired.
-
Updated
May 16, 2025 - C++
On the Releases page, you can download pre-built binaries for arm, armv7l and Raspberry pi. LLM inference in C/C++
-
Updated
Aug 31, 2025 - C++
👁️ Deploy YOLO11 for efficient computer vision on edge devices, optimized for the Horizon X5 RDK with a streamlined C++ codebase.
machine-learning tutorial computer-vision deep-learning image-classification object-detection image-segmentation vlm google-colab zero-shot-detection yolov5 zero-shot-classification yolov8 open-vocabulary-detection open-vocabulary-segmentation automatic-labeling-system qwen paligemma
-
Updated
Nov 2, 2025 - C++
Improve this page
Add a description, image, and links to the qwen topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the qwen topic, visit your repo's landing page and select "manage topics."