Skip to content

Latest commit

 

History

History
326 lines (296 loc) · 39.1 KB

File metadata and controls

326 lines (296 loc) · 39.1 KB
title Provider Reference
version 3.8.42
lastUpdated 2026-06-30

Provider Reference

Auto-generated from src/shared/constants/providers.ts — do not edit by hand. Regenerate with: npm run gen:provider-reference Last generated: 2026-06-30

Total providers: 236. See category breakdown below.

Categories

  • Free — free tier with API key (configured via dashboard)
  • OAuth — sign-in flow handled by OmniRoute, no API key needed
  • Web cookie — wraps the provider's web app via cookie auth
  • API key — paid provider configured via API key (free credits may apply)
  • Local — runs on the user's machine (Ollama, LM Studio, vLLM, etc.)
  • Search — web search providers
  • Audio — audio-only providers (TTS/STT)
  • Upstream proxy — providers that proxy to other providers
  • Cloud agent — long-running coding agents (Codex Cloud, Devin, Jules)
  • System — OmniRoute-internal providers (loopback, etc.)

Additional tags: image, video, aggregator, enterprise, embed/rerank, self-hosted.

Use the dashboard at /dashboard/providers to enable, configure, and test each provider.


OAuth Providers (20)

ID Alias Name Tags Website Notes
agy agy Antigravity CLI OAuth link Import your Antigravity CLI (agy) login (paste/upload its token file), auto-detect a local CLI login, or sign in with Google. Shares the Antigravity backend (incl. Claude models).
amazon-q aq Amazon Q OAuth link Uses the same AWS Builder ID or imported refresh-token flow as Kiro, but keeps Amazon Q connections separate.
antigravity Antigravity OAuth
claude cc Claude Code OAuth
cline cl Cline OAuth
codebuddy-cn cbcn CodeBuddy CN OAuth link Tencent CodeBuddy CN (copilot.tencent.com). Sign in via the official CLI device-code flow, or paste a direct API key (sent as Authorization: Bearer). Catalog: GLM / Kimi / MiniMax / DeepSeek / Hunyuan.
codex cx OpenAI Codex OAuth
cursor cu Cursor IDE OAuth
devin-cli dv Devin CLI (Official) OAuth link Requires the Devin CLI binary. Run devin auth login to authenticate, or provide your WINDSURF_API_KEY. Install: https://cli.devin.ai
github gh GitHub Copilot OAuth
gitlab-duo gitlab-duo GitLab Duo OAuth link OAuth application with ai_features + read_user scopes. Configure GITLAB_DUO_OAUTH_CLIENT_ID and optionally GITLAB_DUO_OAUTH_CLIENT_SECRET on this OmniRoute instance.
grok-cli gc Grok Build OAuth Paste your ~/.grok/auth.json (or the JWT access token) from the Grok Build CLI; refresh_token is rotated automatically.
kilocode kc Kilo Code OAuth
kimi-coding kmc Kimi Coding OAuth
kiro kr Kiro AI OAuth Free tier: 50 credits/month (~25K–100K tokens). ⚠️ Kiro ToS prohibits third-party proxy/harness use.
qoder if Qoder OAuth
qwen qw Qwen Code OAuth ⚠️ DEPRECATED. Qwen OAuth free tier was discontinued on 2026-04-15. Use 'bailian-coding-plan', 'alibaba', 'alibaba-cn', or 'openrouter' provider with API key instead.
trae tr Trae OAuth link Trae is an AI-native IDE by ByteDance (SOLO remote agent). Authorize via trae.ai in the popup, or sign in at solo.trae.ai and paste the Cloud-IDE-JWT (sent as 'Authorization: Cloud-IDE-JWT ', ~14-day lifetime) as the access token; web_id/biz_user_id/user_unique_id/scope/tenant/region propagate via providerSpecificData. No headless refresh for pasted tokens — re-paste on expiry.
windsurf ws Windsurf (Devin CLI) OAuth link In the Windsurf / VS Code IDE, open the command palette and run Windsurf: Provide Auth Token (or click the Jupyter "Get Windsurf Authentication Token" button), then copy the shown token and paste it here. Note: opening windsurf.com/show-auth-token directly only renders a "Redirecting" page — the IDE must initiate the flow (it adds a ?state=... param) for the token to appear.
zed zd Zed IDE OAuth link Zed stores LLM provider credentials (OpenAI, Anthropic, Google, Mistral, xAI) in the OS keychain. Use the Import button below to discover and import them automatically.

Web Cookie Providers (23)

ID Alias Name Tags Website Notes
adapta-web adp-web Adapta.org (Adapta One Web) Web cookie link Paste your __client cookie value from .clerk.agent.adapta.one (DevTools → Application → Cookies)
blackbox-web bb-web Blackbox Web (Subscription) Web cookie link Paste your __Secure-authjs.session-token value or full cookie header from app.blackbox.ai
chatgpt-web cgpt-web ChatGPT Web (Plus/Pro) Web cookie link Paste your __Secure-next-auth.session-token cookie value from chatgpt.com
claude-web cw Claude Web Web cookie link Paste your session cookie from claude.ai
copilot-m365-web m365copilot Microsoft 365 Copilot (BizChat) Web cookie link Paste the access_token and account-specific Chathub path from the Microsoft 365 Copilot WebSocket URL.
copilot-web copilot Microsoft Copilot Web Web cookie link Paste your access_token from copilot.microsoft.com (or export a .har file from DevTools while logged in)
deepseek-web ds-web DeepSeek Web Web cookie link Paste your userToken from chat.deepseek.com — DevTools → Application → Local Storage → userToken
doubao-web db Doubao Web (ByteDance) Web cookie link Paste your session cookie from doubao.com (DevTools → Application → Cookies)
gemini-business gembiz Gemini Business (Enterprise) Web cookie link From your enterprise account: open business.gemini.google/home/cid/{your-cid}, then copy __Secure-1PSID and __Secure-1PSIDTS cookies from DevTools → Application → Cookies. Paste as a cookie header below.
gemini-web gweb Gemini Web (Free) Web cookie link Paste your __Secure-1PSID cookie value from gemini.google.com. Optionally add __Secure-1PSIDTS separated by semicolon.
grok-web gw Grok Web (Subscription) Web cookie link Paste the full grok.com cookie line from DevTools → Application → Cookies. Include both sso and sso-rw (e.g. sso=...; sso-rw=...) — Grok's anti-bot rejects sso on its own.
huggingchat huggingchat HuggingChat (Free) Web cookie link Paste your hf-chat cookie value from huggingface.co/chat (DevTools → Application → Cookies → hf-chat). Optional — works without auth for basic use.
inner-ai in-ai Inner.ai (Subscription) Web cookie link Paste your token cookie and email separated by a space: open DevTools → Application → Cookies → .innerai.com, copy the token value, then append a space and your Inner.ai login email. Example: eyJhbG... user@example.com
kimi-web kimi-web Kimi Web (Moonshot AI) Web cookie link Paste your session cookie from kimi.moonshot.cn (DevTools → Application → Cookies)
lmarena lma LMArena (Free) Web cookie link Paste the full Cookie header from lmarena.ai (DevTools → Network → request → Cookie). The session is now split across arena-auth-prod-v1.0, .1, … — copy the whole header. Optional — works with free tier for basic comparisons.
muse-spark-web ms-web Muse Spark Web (Meta AI) Web cookie link Paste your ecto_1_sess value or full cookie header from meta.ai
perplexity-web pplx-web Perplexity Web (Pro/Max) Web cookie link Paste your __Secure-next-auth.session-token cookie value from perplexity.ai
poe-web poe Poe Web (Subscription) Web cookie link Paste your p-b cookie value from poe.com (DevTools → Application → Cookies → p-b)
qwen-web qwen-web Qwen Web (Free) Web cookie link Open chat.qwen.ai, log in, then open DevTools → Application → Local Storage → copy the "token" value (or use tongyi_sso_ticket cookie as Bearer token).
t3-web t3chat t3.chat (Pro/Free) Web cookie link Open t3.chat in your browser, log in, then open DevTools → Application → Local Storage → https://t3.chat. Copy the value of 'convex-session-id'. Also open DevTools → Network, copy the Cookie header from any request. Paste both values here. See provider setup docs for a step-by-step guide.
v0-vercel-web v0 v0 Vercel Web (Code Gen) Web cookie link Paste your session cookie from v0.dev (DevTools → Application → Cookies)
venice-web ven Venice Web (Privacy) Web cookie link Paste your session cookie from venice.ai (DevTools → Application → Cookies)
zenmux-free zmf ZenMux Free (Web) Web cookie link Login at zenmux.ai, then export all cookies using EditThisCookie or Cookie-Editor and paste the full Cookie header string here. Refresh every ~30 days.

API Key Providers (paid / paid-with-free-credits) (158)

ID Alias Name Tags Website Notes
360ai 360ai 360 AI API key link Get API key at ai.360.cn
agentrouter agentrouter AgentRouter API key, aggregator link $200 free credits on signup - multi-model routing gateway
ai21 ai21 AI21 Labs API key link $10 trial credits on signup (valid 3 months), no credit card required
aimlapi aiml AI/ML API API key, aggregator link Free tier paused (2026) — AI/ML API is now pay-as-you-go only (min $20 top-up); no recurring free credits.
alibaba ali Alibaba API key link
alibaba-cn ali-cn Alibaba (China) API key link
anthropic anthropic Anthropic API key link
api-airforce af Api.airforce API key link 55 free tier models including Grok-3, Claude 3.7, Qwen3, Kimi-K2, Gemini 2.5 Flash, DeepSeek-V3
arcee-ai arcee Arcee AI API key link Get API key at arcee.ai
azure-ai azure-ai Azure AI Foundry API key, enterprise link Use your Azure AI Foundry key. Base URL can be https://.services.ai.azure.com/openai/v1/ or https://.openai.azure.com/openai/v1/.
azure-openai azure Azure OpenAI API key, enterprise link Use your Azure OpenAI API key. Base URL should be your resource endpoint, for example https://my-resource.openai.azure.com.
baichuan baichuan Baichuan API key link Get API key at platform.baichuan-ai.com
baidu baidu Baidu (ERNIE) API key link Get API key at console.bce.baidu.com
bailian-coding-plan bcp Alibaba Coding Plan API key link
baseten baseten Baseten API key link $30 free trial credits for GPU inference
bazaarlink bzl BazaarLink API key link Use your BazaarLink API key (starts with sk-bl-) in Authorization: Bearer . OpenAI SDK works with base URL https://bazaarlink.ai/api/v1. Models use provider/model-name format.
bedrock bedrock Amazon Bedrock API key, enterprise link Use your Amazon Bedrock API key and configure the AWS region where your models are enabled (for example eu-west-2). OmniRoute calls Bedrock's native Converse API directly.
black-forest-labs bfl Black Forest Labs API key, image link
blackbox bb Blackbox AI API key link Free tier: unlimited basic chat plus Minimax-M2.5, no credit card required
bluesminds bm BluesMinds API key link Free daily pi credits — supports 200+ models including GPT-4o, GPT-4.1, Claude Sonnet 4.5, Gemini 2.0 Flash, DeepSeek V4, Qwen, Kimi K2
byteplus bpm BytePlus ModelArk API key link
bytez bytez Bytez API key link $1 free credits, refreshes every 4 weeks
cablyai cablyai CablyAI API key, aggregator link Bearer API key for the CablyAI OpenAI-compatible gateway.
cerebras cerebras Cerebras API key link Free Trial: 1M tokens/day, 30K TPM, 5 RPM — no credit card.
chutes chutes Chutes.ai API key, aggregator link Bearer API key for the Chutes OpenAI-compatible gateway.
clarifai clarifai Clarifai API key, enterprise link Use your Clarifai PAT or app-specific API key. OmniRoute targets the OpenAI-compatible endpoint at https://api.clarifai.com/v2/ext/openai/v1 and authenticates with Authorization: Key .
cloudflare-ai cf Cloudflare Workers AI API key link Requires API Token AND Account ID (found at dash.cloudflare.com)
codestral codestral Codestral API key link
cohere cohere Cohere API key link Free Trial: 1,000 API calls/month for testing, no credit card required
command-code cmd Command Code API key link Use a Command Code API key. Requests are sent to Command Code's /alpha/generate endpoint.
coze coze Coze API key link Get API key at coze.com/open/api
crof crof CrofAI API key link
databricks databricks Databricks API key, enterprise link
datarobot datarobot DataRobot API key, enterprise link Use your DataRobot API token. Optional Base URL can be the account root (for LLM Gateway) or a deployment URL under /api/v2/deployments/.
deepinfra deepinfra DeepInfra API key link Free signup credits for API testing and model exploration
deepseek ds DeepSeek API key link 5M free tokens on signup - no credit card required
dgrid dgrid DGrid API key link DGrid Free Models Router: 10 requests/minute and 100 requests/day. A $5 lifetime top-up unlocks up to 20 requests/minute and 1,000 requests/day.
dify dify Dify API key link Get API key from your Dify instance.
dit dai DIT.ai API key link Use your dit.ai API key in Authorization: Bearer . Fully OpenAI-compatible — a drop-in replacement, just change the base URL to https://api.dit.ai/v1.
doubao doubao Doubao API key link Get API key at console.volcengine.com
empower empower Empower API key, aggregator link Bearer API key for the Empower OpenAI-compatible endpoint.
factory factory Factory API key link Bearer API key for the Factory OpenAI-compatible gateway.
fal-ai fal Fal.ai API key, image link
featherless-ai featherless Featherless AI API key link Free tier available — no credit card required
fenayai fenayai FenayAI API key, aggregator link Bearer API key for the FenayAI OpenAI-compatible gateway.
firecrawl fc Firecrawl API key link
fireworks fireworks Fireworks AI API key link $1 free starter credits on signup for API testing
freeaiapikey faik FreeAIAPIKey API key link
freemodel-dev fmd FreeModel.dev API key link $300 free credits on signup — no credit card required. Access GPT-5.4 and GPT-5.5 (OpenAI's latest flagship models) through an OpenAI-compatible API.
friendliai friendli FriendliAI API key link Free tier for serverless inference — no credit card required
galadriel galadriel Galadriel API key link ⚠️ DEPRECATED. api.galadriel.ai no longer resolves (sweep 2026-06-19); the inference API appears discontinued.
gemini gemini Gemini (Google AI Studio) API key link Free forever: 1,500 req/day for Gemini 2.5 Flash — no credit card, get key at aistudio.google.com
getgoapi ggo GoAPI API key, aggregator link
gigachat gigachat GigaChat (Sber) API key link
github-models ghm GitHub Models API key link Create a GitHub PAT with 'models: read' scope at github.com/settings/tokens
gitlab gitlab GitLab Duo PAT API key link GitLab personal access token for the public Code Suggestions API. Configure a self-hosted base URL when not using gitlab.com.
gitlawb glb Gitlawb Opengateway (MiMo) API key link Free MiMo (xiaomi/mimo-v2.5) revoked 2026-05 — Opengateway is now a pay-as-you-go credit gateway; no recurring free model.
gitlawb-gmi glb-gmi Gitlawb Opengateway (GMI Cloud) API key link Free Nemotron promo ended 2026-06 — the GMI Cloud route is now pay-as-you-go credit only.
glhf glhf GLHF Chat API key, aggregator link ⚠️ DEPRECATED. glhf.chat shut down (2026); its api.laf.run gateway no longer serves the catalog (sweep 2026-06-19).
glm glm GLM Coding API key link
glm-cn glmcn GLM Coding (China) API key link
glmt glmt GLM Thinking API key link
groq groq Groq API key link Free tier: 30 RPM / 14.4K RPD — no credit card
hackclub hc Hackclub AI API key, aggregator link Sign in with your Hack Club account at ai.hackclub.com.
haiper hp Haiper API key, video link Get API key at haiper.ai/haiper-api
heroku heroku Heroku AI API key, enterprise link
huggingface hf HuggingFace API key link Free Inference API for thousands of models (Whisper, VITS, SDXL…)
hyperbolic hyp Hyperbolic API key link $1-5 trial credits on signup for serverless inference
ideogram ideo Ideogram API key link Get API key at ideogram.ai/docs/api
iflytek iflytek iFlytek Spark API key link Get API key at console.xfyun.cn
inclusionai inclusion InclusionAI API key link ⚠️ DEPRECATED. api.inclusionai.tech no longer resolves (sweep 2026-06-19); the inference API appears discontinued.
inference-net inet Inference.net API key link $25 free credits on signup plus research grants available
jina-ai jina Jina AI API key, embed/rerank link Bearer API key for the Jina AI rerank API.
jina-reader jr Jina Reader API key link
kie kie KIE.AI API key link
kilo-gateway kg Kilo Gateway API key, aggregator link
kimi kimi Kimi API key link
kimi-coding-apikey kmca Kimi Coding (API Key) API key link
kluster kluster Kluster AI API key link ⚠️ DEPRECATED. kluster.ai shut down (2026-06-09); api.kluster.ai no longer resolves (sweep 2026-06-19). Use another OpenAI-compatible provider.
lambda-ai lambda Lambda AI API key link
laozhang lz LaoZhang AI API key, aggregator link
leonardo leo Leonardo AI API key, video link Get API key at leonardo.ai/developer
liquid liquid Liquid AI API key link Get API key at liquid.ai
llamagate llamagate LlamaGate API key link
llm7 llm7 LLM7.io API key link No signup required - 2 req/s, 20 RPM, 100 req/hr free tier
longcat lc LongCat AI API key link Free: one-time 10M-token grant after account signup + KYC verification (LongCat-2.0). One-time only — not a recurring daily/monthly allowance.
maritalk maritalk Maritalk API key link
meta-llama meta Meta Llama API API key link
minimax minimax Minimax Coding API key, video link
minimax-cn minimax-cn Minimax (China) API key link
mistral mistral Mistral API key link Free Experiment tier: rate-limited access to all models, no credit card required
modal mdl Modal API key, enterprise link Use the bearer token that protects your Modal deployment, if enabled. Base URL should point to your OpenAI-compatible Modal app, for example https://--.modal.run/v1.
monsterapi monster MonsterAPI API key link Get API key at monsterapi.ai
moonshot moonshot Moonshot AI API key link
morph morph Morph API key link Free tier: 250K credits/month, $0
nanogpt nanogpt NanoGPT API key link
nebius nebius Nebius AI API key link ~$1 trial credits on signup for API testing
nlpcloud nlpc NLP Cloud API key link Use your NLP Cloud API key in Authorization: Token . OmniRoute targets the chatbot endpoint on https://api.nlpcloud.io/v1/gpu//chatbot by default.
nomic nomic Nomic API key link Get API key at atlas.nomic.ai
nous-research nous Nous Research API key link Use your Nous Portal API key. OmniRoute targets the official OpenAI-compatible inference endpoint at https://inference-api.nousresearch.com/v1.
novita novita Novita AI API key, aggregator link $0.50 trial credits on signup (valid about 1 year)
nscale nscale nScale API key link $5 free credits on signup for inference testing
nvidia nvidia NVIDIA NIM API key link Free dev access: ~40 RPM, 70+ models (Kimi K2.5, GLM 4.7, DeepSeek V3.2...)
oci oci OCI Generative AI API key, enterprise link Use your OCI Generative AI API key or IAM bearer token. Base URL can be https://inference.generativeai..oci.oraclecloud.com/openai/v1/.
ollama-cloud ollamacloud Ollama Cloud API key link
openadapter oad OpenAdapter API key link Use your OpenAdapter API key in Authorization: Bearer sk-cv-. Fully OpenAI-compatible. API base URL: https://api.openadapter.in/v1.
openai openai OpenAI API key link
opencode-go opencode-go OpenCode Go API key link
opencode-zen opencode-zen OpenCode Zen API key link
openrouter openrouter OpenRouter API key, aggregator link Free models at $0/token with :free suffix - 20 RPM / 200 RPD
orcarouter orcarouter OrcaRouter API key link
ovhcloud ovh OVHcloud AI API key link
perplexity pplx Perplexity API key link
piapi pi PiAPI API key, aggregator link
pioneer pn Pioneer AI API key link $75 free usage credits — no credit card required
poe poe Poe API key, aggregator link Bearer API key for the Poe OpenAI-compatible API.
pollinations pol Pollinations AI API key, video link Free keyless tier: openai, openai-fast, openai-large, qwen-coder, mistral, deepseek, grok, gemini-flash-lite-3.1, perplexity-fast, perplexity-reasoning. Premium models (claude, gemini, midijourney) require a Pollinations API key from enter.pollinations.ai.
predibase predibase Predibase API key link ⚠️ DEPRECATED. serving.app.predibase.com no longer resolves (sweep 2026-06-19); the managed serving API appears discontinued.
publicai publicai PublicAI API key link Requires an API key — one-time signup credit, then paid
puter pu Puter AI API key link Get token at puter.com/dashboard → Copy Auth Token
qianfan qianfan Baidu Qianfan API key link
recraft recraft Recraft API key, image link
reka reka Reka API key link Use your Reka API key. OmniRoute supports the OpenAI-compatible base URL https://api.reka.ai/v1 and sends both Authorization and X-Api-Key headers for compatibility.
runwayml runway Runway API key, video link Use your Runway API key in Authorization: Bearer . OmniRoute targets the current Runway API at https://api.dev.runwayml.com/v1 and sends the required X-Runway-Version header automatically.
sambanova samba SambaNova API key link $5 free credits on signup (30-day validity), no credit card required
sap sap SAP Generative AI Hub API key, enterprise link Use your SAP AI Core bearer token. Base URL can be your AI_API_URL root or a deploymentUrl from Generative AI Hub.
scaleway scw Scaleway AI API key link 1M free tokens for new accounts — EU/GDPR compliant (Paris), Qwen3 235B & Llama 70B
sensenova sensenova SenseNova API key link Get API key at platform.sensenova.cn
siliconflow siliconflow SiliconFlow API key link $1 free credits plus permanently free models after identity verification
snowflake snowflake Snowflake Cortex API key, enterprise link
sparkdesk sparkdesk SparkDesk API key link Get API key at console.xfyun.cn
stability-ai stability Stability AI API key, image link
stepfun stepfun StepFun API key link Get API key at platform.stepfun.com
suno suno Suno API key link Paste session cookie from suno.ai (Clerk auth)
synthetic synthetic Synthetic API key, aggregator link
tencent tencent Tencent Hunyuan API key link Get API key at console.cloud.tencent.com
thebai thebai TheB.AI API key, aggregator link Bearer API key for the TheB.AI OpenAI-compatible gateway.
together together Together AI API key, video link $25 signup credits + 3 permanently free models: Llama 3.3 70B, Vision, DeepSeek-R1 distill
tokenrouter trk TokenRouter API key link Use your TokenRouter API key in Authorization: Bearer . Fully OpenAI-compatible. API base URL: https://api.tokenrouter.com/v1.
topaz topaz Topaz API key, image link
udio udio Udio API key link Paste session cookie from udio.com (Supabase auth)
uncloseai unc UncloseAI API key link No auth required. API accepts any non-empty string as key for identification.
upstage upstage Upstage API key link
v0-vercel v0 v0 (Vercel) API key link
venice venice Venice.ai API key link
vercel-ai-gateway vag Vercel AI Gateway API key, aggregator link
vertex vertex Vertex AI API key, enterprise link Provide Service Account JSON or OAuth access_token
vertex-partner vp Vertex AI Partners API key, enterprise link Provide the same Service Account JSON used for Vertex AI partner models.
volcengine volcengine Volcengine API key link
voyage-ai voyage Voyage AI API key, embed/rerank link Bearer API key for Voyage AI embeddings and rerank APIs.
wafer wafer Wafer AI API key link
wandb wandb Weights & Biases Inference API key link
watsonx watsonx IBM watsonx.ai Gateway API key, enterprise link Use your watsonx bearer token. Base URL can be https://.ml.cloud.ibm.com/ml/gateway/v1/ or a self-managed /ml/gateway/v1 endpoint.
xai xai xAI (Grok) API key link
xiaomi-mimo mimo Xiaomi MiMo API key link
yi yi Yi (01.AI) API key link Get API key at platform.lingyiwanwu.com
zai zai Z.AI API key link
zenmux zm ZenMux API key link Use your ZenMux API key in Authorization: Bearer . ZenMux is fully OpenAI-compatible. Base URL: https://zenmux.ai/api/v1.

Local Providers (11)

ID Alias Name Tags Website Notes
comfyui comfyui ComfyUI Local link No API key required. Configure the local ComfyUI base URL (default: http://localhost:8188).
docker-model-runner dmr Docker Model Runner Local, self-hosted link API key optional. Configure the local Docker Model Runner OpenAI-compatible base URL (default: http://localhost:12434/v1).
lemonade lemonade Lemonade Server Local, self-hosted link API key optional. Configure the local Lemonade OpenAI-compatible base URL (default: http://localhost:13305/api/v1).
llama-cpp llamacpp llama.cpp Local, self-hosted link API key optional (use any value, e.g. sk-no-key-required). Configure the llama-server OpenAI-compatible base URL (default: http://127.0.0.1:8080/v1). Note: if Llamafile is also installed, both default to port 8080 — run only one at a time or override the port.
llamafile llamafile Llamafile Local, self-hosted link API key optional. Configure the local Llamafile OpenAI-compatible base URL (default: http://127.0.0.1:8080/v1).
lm-studio lmstudio LM Studio Local, self-hosted link API key optional. Configure the local LM Studio OpenAI-compatible base URL (default: http://localhost:1234/v1).
oobabooga ooba oobabooga Local, self-hosted link API key optional. Configure the local oobabooga OpenAI-compatible base URL (default: http://localhost:5000/v1).
sdwebui sdwebui SD WebUI Local link No API key required. Configure the local WebUI base URL (default: http://localhost:7860).
triton triton NVIDIA Triton Local, self-hosted link API key optional. Configure the Triton OpenAI-compatible base URL (default: http://localhost:8000/v1).
vllm vllm vLLM Local, self-hosted link API key optional. Configure the local vLLM OpenAI-compatible base URL (default: http://localhost:8000/v1).
xinference xinference XInference Local, self-hosted link API key optional. Configure the local XInference OpenAI-compatible base URL (default: http://localhost:9997/v1).

Search Providers (11)

ID Alias Name Tags Website Notes
brave-search brave-search Brave Search Search link Subscription token from Brave Search API dashboard
exa-search exa-search Exa Search Search link API key from dashboard.exa.ai
google-pse-search google-pse Google Programmable Search Search link Requires a Google API key and your Programmable Search Engine ID (cx)
linkup-search linkup Linkup Search Search link Bearer API key from the Linkup dashboard
ollama-search ollama-search Ollama Search Search link Same API key as Ollama Cloud (from ollama.com/settings/api-keys)
perplexity-search pplx-search Perplexity Search Search link Same API key as Perplexity (pplx-...)
searchapi-search searchapi SearchAPI Search link API key from SearchAPI (query param or Bearer auth)
searxng-search searxng SearXNG Search Search link API key is optional. Set your SearXNG base URL. Some instances may require a bearer token for access.
serper-search serper-search Serper Search Search link API key from serper.dev dashboard
tavily-search tavily-search Tavily Search Search link API key from app.tavily.com (format: tvly-...)
youcom-search youcom-search You.com Search Search link X-API-Key from the You.com platform dashboard

Audio-only Providers (7)

ID Alias Name Tags Website Notes
assemblyai aai AssemblyAI Audio link
aws-polly polly AWS Polly Audio link Use AWS Secret Access Key as API key; set providerSpecificData.accessKeyId and optional region.
cartesia cartesia Cartesia Audio link
deepgram dg Deepgram Audio link
elevenlabs el ElevenLabs Audio link
inworld inworld Inworld Audio link
playht playht PlayHT Audio link

Upstream Proxy Providers (2)

ID Alias Name Tags Website Notes
9router nr 9router Upstream proxy link
cliproxyapi cpa CLIProxyAPI Upstream proxy link

Cloud Agent Providers (3)

ID Alias Name Tags Website Notes
codex-cloud codex-cloud Codex Cloud Cloud agent link OpenAI API key with Codex Cloud task access.
devin devin Devin Cloud agent link Devin API key for cloud agent sessions.
jules jules Google Jules Cloud agent link Jules API key for creating and managing cloud coding tasks.

System Providers (1)

ID Alias Name Tags Website Notes
auto auto Auto (Zero-Config) System

Sources of truth

See Also