Skip to content

fix(tests): update tests to reflect the new default models - #48

Merged
2ynn merged 3 commits into
mainfrom
fix/tests/default-models
Sep 29, 2026
Merged

2ynn merged 3 commits into
mainfrom
fix/tests/default-models

Conversation

@2ynn

@2ynn 2ynn commented Sep 29, 2026

Copy link
Copy Markdown
Contributor

Follow up on 09ca8a2

The CLI's default models were recently updated (for example, generate and agent run now use gemini-3.8-flash, and tts now uses gemini-3.8-flash-tts). This PR updates the contract tests and the harness-comparison evals to expect the new defaults.

Google Team Member and others added 3 commits September 28, 2026 20:27
…mmands

Update default models and `--model` suggestions in the CLI overlays and porcelain commands, and display the default model in the `analyze` and `transcribe` command summaries:
- `generate`: default `gemini-3.8-flash`
- `image`: default `gemini-3.1-flash-image` (suggestions: `gemini-3.1-flash-image`, `gemini-3-pro-image`, `nano-banana-pro-preview`)
- `music`: default `lyria-3.5` (suggestions: `lyria-3.5`, `lyria-3-pro-preview`, `lyria-3-clip-preview`)
- `tts`: default `gemini-3.8-flash-tts`
- `video`: default `gemini-omni-1.1-flash` (suggestions: `gemini-omni-1.1-flash`, `gemini-omni-flash-preview`)
- `analyze`, `transcribe`: default `gemini-3.8-flash` (and include `(gemini-3.8-flash)` in command summaries)

PiperOrigin-RevId: 990006165
Align contract assertions with the new defaults: `gemini-3.8-flash` for
`generate`, `agent run`, and the `models` catalog, and
`gemini-3.8-flash-tts` for `tts`.
The `generate-default-model` scenario asserts the CLI's default text model,
which is now `gemini-3.8-flash`. Align the mock server's fallback model and
models listing, and the README's example invocation.
@2ynn
2ynn requested review from a team and wanlin31 September 29, 2026 17:13

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the default Gemini models across the CLI, SDK, documentation, and tests, transitioning to gemini-3.8-flash as the default text model, alongside updates to the default music, TTS, and video models. Additionally, deprecated Temperature and TopP fields have been added to the SDK's GenerationConfig. Feedback on the changes highlights a missed reference to gemini-3.6-flash in one of the command examples within internal/cli/agent/run.go, which should be updated to maintain consistency.

Comment thread internal/cli/agent/run.go Resolved
@2ynn
2ynn merged commit 58525f7 into main Sep 29, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants