Skip to content

Add vertex evaluator information to docs #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
tagboola merged 239 commits into from
May 2, 2024
Merged

Add vertex evaluator information to docs #1

tagboola merged 239 commits into from
May 2, 2024

Conversation

@tagboola
Copy link
Contributor

@tagboola tagboola commented May 1, 2024

No description provided.

@tagboola tagboola requested review from schnecle and ssbushi May 1, 2024 21:01
@schnecle schnecle requested a review from kevinthecheung May 1, 2024 21:10
@schnecle
Copy link
Contributor

schnecle commented May 1, 2024

Pavel added Kevin, copying that over here.
kevinthecheung
kevinthecheung approved these changes May 1, 2024
View reviewed changes
@pavelgj pavelgj force-pushed the main branch 2 times, most recently from c5838f8 to dca1561 Compare May 1, 2024 23:56
MichaelDoyle and others added 22 commits May 2, 2024 09:23
@MichaelDoyle @tagboola
Fix model routing (#161)
59c599f
@tonybaroneee @tagboola
[UI] Add new span tree + viewer to Flow details page (#164)
a92bdae
@MichaelDoyle @tagboola
Fetch models from API (#174)
8fb9144
@MaesterChestnut @tagboola
Backend errors (#163)
7bf826c 
Display errors in the Prompt Playground component after receiving issues from backend
@tonybaroneee @tagboola
[UI] Cleanup unimplemented pages from navbar (#180)
ca94c45
@tonybaroneee @tagboola
[UI] Increase max-height of flow input/output (#179)
9d90ca0 
Also update styles for running + error statues in output box.
@shrutip90 @tagboola
Move flow runner to Actions page (#176)
ed6ab19
@tonybaroneee @tagboola
[UI] Fix overflow of execution span tree (#183)
95b4c60
@MaesterChestnut @tagboola
Input validation disables prompt run button (#182)
8977bb7 
Input validation for prompt playground
@MichaelDoyle @tagboola
Route playground from flows to action runners page (#191)
9f53dde
@MichaelDoyle @tagboola
Switch temperature to the slider (#195)
c145f96
@MichaelDoyle @tagboola
Show validation errors on the playground (#196)
f3c9593
@tonybaroneee @tagboola
[UI] Revamp flow details page layout (#197)
5976078
@shrutip90 @tagboola
Fix validator issues (#194)
0cd9569
@tonybaroneee @tagboola
[UI] Initial design of span details view (#199)
0a35f00
@shrutip90 @tagboola
Move flow runner to start from action-list instead of action-runner (#…
c7dfaef 
…200)
@MichaelDoyle @tagboola
Add vertex-ai to the model playground (#201)
f99d706 
Also add icons for all known action types
@tonybaroneee @tagboola
[UI] Hide input/output pre if none available (#204)
500a3c7
@tonybaroneee @tagboola
[UI] Add "muted" helper class for secondary text (#206)
d4083e4
@pavelgj @tagboola
Don't send blank stop sequences to the model, vertex gemini model doe…
88e9d35 
…sn't like it (#217)
@MaesterChestnut @tagboola
Provider specific model param restrictions on input (#224)
0cf4621
@MichaelDoyle @tagboola
Use the minfied version of Monaco Editor in the angular app (#242)
515e66d
MichaelDoyle and others added 23 commits May 2, 2024 09:23
@MichaelDoyle @tagboola
Message list component (#84)
b99e447 
Co-authored-by: Chris Chestnut <cchestnut@google.com>
Co-authored-by: Michael Doyle <michaeldoyle@google.com>
@tonybaroneee @tagboola
[UI] Fix view evaluation report button to read correct metdata (#119)
ac92038
@tonybaroneee @tagboola
[UI] Save action sidebar expansion state to localStorage (#120)
590eca7
@shrutip90 @tagboola
[UI]: Move model config params to a separate component (#103)
5d87111
@shrutip90 @tagboola
[UI] Update model runner to use the new model config component (#124)
618d107
@shrutip90 @tagboola
[UI] Pull the new defaults for model config into the new config compo…
f45e656 
…nent (#125)
@tonybaroneee @tagboola
[UI] Add ability to export prompt file from model runner (#115)
08eb2d6
@tonybaroneee @tagboola
[UI] Fix model versions not being loaded on initial render (#131)
c49cbc0 
Fixes google/genkit#130. This is more of a stop-gap fix, going to explore refactoring these components to utilize Angular signals to eliminate this class of error entirely.
@MichaelDoyle @tagboola
Integrate the new MessageList component into the ModelRunner (#114)
e9c2ac3
@tonybaroneee @tagboola
[UI] Refactor model-config to use signals (#133)
5185143
@MichaelDoyle @tagboola
Create placeholder for system prompt and first user message (#144)
2d5730b
@tonybaroneee @tagboola
[UI] Remove oops from model config template (#143)
94c4306
@MichaelDoyle @tagboola
Ensure selected model is set when using left nav (#148)
dbfed9e
@tonybaroneee @tagboola
[UI] Prevent button icons from flex-shrinking (#151)
67df20e
@MichaelDoyle @tagboola
Show large multimedia in a modal (#156)
b6753b4
@MichaelDoyle @tagboola
Enable all image types in model runner (#160)
cf01937
@MichaelDoyle @tagboola
Re-enable gemini vision models (#168)
1a2ea20
@shrutip90 @tagboola
[UI] Remove system prompt for single-turn models (#169)
ef1bfb3
@MichaelDoyle @tagboola
Set a reasonable (but arbitrary) number of media files per message (#…
c464752 
…172)
@tonybaroneee @tagboola
[UI] Remove obsolete MONACO_PATH provider (unused) (#182)
381425b
@tonybaroneee @tagboola
[UI] Sort eval metrics for consistent/comparable viewing (#209)
69416cf 
Fixes #207.
@jba @tagboola
change action latency name (#200)
3261847 
Change the name of the action latency histogram from
"genkit.action.action_latency" to "genkit.action.latency"
to avoid stutter.
@tagboola
Add vertex evaluator information to docs
2a1f31f
@tagboola tagboola force-pushed the ta/vertexai-eval-docs branch from 90c6920 to 2a1f31f Compare May 2, 2024 13:24
@tagboola @kevinthecheung
Address PR comments
a171f0b 
Co-authored-by: Kevin Cheung <kevinthecheung@users.noreply.github.com>
@tagboola tagboola merged commit ca23579 into main May 2, 2024
@tagboola tagboola deleted the ta/vertexai-eval-docs branch May 2, 2024 13:45
@mjchristy mjchristy mentioned this pull request Mar 7, 2025
Closed
tanyasingh1902 referenced this pull request in tanyasingh1902/genkit Mar 26, 2025
@tanyasingh1902
feat(js): create skeleton for pg-cloud-sql and initial code for postg…
cb005ea 
…resIndexer (averikitsch#1)
@pavelgj pavelgj mentioned this pull request Jun 13, 2025
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet