Skip to content

Conversation

@jyotirmoy-devops
Copy link

@jyotirmoy-devops jyotirmoy-devops commented Dec 29, 2025

In the Unit 2 code for HuggingFaceInferenceAPIm the below code gives a 404 inference client not found error

llm = HuggingFaceInferenceAPI(model_name="Qwen/Qwen2.5-Coder-32B-Instruct")

In order to fix the issue, we need to add the provider and the token

llm = HuggingFaceInferenceAPI(model_name="Qwen/Qwen2.5-Coder-32B-Instruct", token=userdata.get('HF_TOKEN'), provider="auto")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant