-3

I am building a docker container for FastAPI project on DGX Spark2. But I am having hard time to find a right docker image to pull. Tried the following two images:

FROM nvcr.io/nvidia/vllm:25.11-py3

FROM vllm/vllm-openai:v0.12.0

But both images failed with forcefully injected vllm's V1 logic during docker run. Tried vllm-openai:v0.7.2. But it is for AMD64 and vllm-openai:v9.7.2-arm64 does not exist. What is the right vllm docker image for DGX Spark2 which is arm64?

0

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.