XAI Models Conetx Window Size Appears Or Is Actually Configured Smaller Than Available #187461
Replies: 2 comments 4 replies
-
|
This is usually by design, not a bug.
The UI typically shows the effective context window available through the integration, not the model’s absolute maximum. If you call the model directly via XAI’s API (outside the IDE), you may see the larger context limit. |
Beta Was this translation helpful? Give feedback.
-
|
But that doesnt give users of vscode a method to use a 1M context window model even through APIs --- looks like this is a hard handed restriction. I hope there is a pathway somewhere in Copilot VSCODE or COPILOT CLI to use those larger models 1M context through APIs. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Select Topic Area
General
Copilot Feature Area
VS Code
Body
When i added XAI models through my API key, i oberver that the context windows defined are way less than available from XAI. For example context window for Grok 4.1 Fast Thinking is 1 Million but in the IDE i see it as 120K ... is this by design or a gui bug or actually bug?
Beta Was this translation helpful? Give feedback.
All reactions