Deploy open-source LLMs on AWS in minutes — with OpenAI-compatible APIs and a powerful CLI/SDK toolkit.
ecs sagemaker huggingface langchain large-language-model vllm ollama deepseek comfyui-workflow inferentia-2 internlm2 openai-compatible-api qwen2-5 deepseek-v3 deepseek-r1 qwq-32b gemma3 qwen3 higgs-audio gpt-oss
-
Updated
Aug 26, 2025 - Python