llama and other large language models on iOS and MacOS offline using GGML library.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Nexa AI PDF Chatbot using Nexa SDK

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organiz…

C++ implementation of Qwen-LM

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

An interactive AI character with voice input, voice output, and profile image generation—all running locally with Nexa SDK and powered by Llama3 Uncensored Model. Enjoy a private and immersive expe…

Android ChatBot with Octopus v2 - Function Calling Demo

Awesome LLMs on Device: A Comprehensive Survey

Low-bit LLM inference on CPU/NPU with lookup table

Android ChatBot with Octopus v2 - Function Calling Demo

Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

LLM inference in C/C++

AI for all: Build the large graph of the language models

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

Universal LLM Deployment Engine with ML Compilation

Build dynamic, secure APIs with FastAPI: Features DB integration, real-time WebSocket, streaming, and efficient request handling with middleware, powered by Starlette and Pydantic.

Python Concurrency Web Crawler, and Redis

An audio streaming mobile application

A Personalized Twitch Resources Recommendation Engine

A Cloud and React based App Purchase Platform

NFT Price Visualization

Java client library for Google Maps API Web Services