Skip to content

[GSK-3846] Add support to LiteLLM #2069

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 42 commits into from
Nov 21, 2024
Merged

[GSK-3846] Add support to LiteLLM #2069

Changes from 1 commit
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
f61cc21
Created litellm client
kevinmessiaen Nov 5, 2024
e3844ff
Updated documentation
kevinmessiaen Nov 5, 2024
c524217
Added litellm embedding
kevinmessiaen Nov 5, 2024
d6b032f
Code improvement
kevinmessiaen Nov 5, 2024
e31cdfa
Added deprecated warnings
kevinmessiaen Nov 5, 2024
0f5ade7
Fixed typo
kevinmessiaen Nov 5, 2024
3045060
Improved documentation and llm setup
kevinmessiaen Nov 7, 2024
f49a2bc
Added back fastembed as default
kevinmessiaen Nov 7, 2024
1157bda
Removed todo: LiteLLM does not support embeddings for Gemini and Ollama
kevinmessiaen Nov 7, 2024
10e4113
Typo
kevinmessiaen Nov 7, 2024
5fb6a78
Fixed embeddings
kevinmessiaen Nov 7, 2024
f897262
Default model to gpt-4o
kevinmessiaen Nov 7, 2024
2657b19
Code cleanup
kevinmessiaen Nov 7, 2024
b04f126
Code cleanup
kevinmessiaen Nov 7, 2024
4633aa4
Skip LiteLLM tests with pydantic < 2
kevinmessiaen Nov 8, 2024
63ace19
Added test for custom client
kevinmessiaen Nov 8, 2024
1b382ee
Added test for embedding
kevinmessiaen Nov 8, 2024
713f0b0
Fixed tests
kevinmessiaen Nov 8, 2024
deca09a
Merge branch 'main' into feature/litellm
henchaves Nov 14, 2024
e54c414
Merge branch 'main' into feature/litellm
henchaves Nov 14, 2024
dee0e83
Reintroduced old way to set LLM models
kevinmessiaen Nov 15, 2024
7703d51
Reintroduced old way to set LLM models
kevinmessiaen Nov 15, 2024
5349fc2
Reintroduced old clients
kevinmessiaen Nov 15, 2024
6458f97
Merge branch 'main' into feature/litellm
kevinmessiaen Nov 15, 2024
2756e27
Fixed OpenAI embeddings
kevinmessiaen Nov 15, 2024
2b88ed3
Update Setting up the LLM client docs
henchaves Nov 15, 2024
1dc73d9
Update Setting up the LLM client docs pt 2
henchaves Nov 15, 2024
b39731e
Update testset generation docs
henchaves Nov 15, 2024
7eaf007
Update scan llm docs
henchaves Nov 15, 2024
5f51327
Merge branch 'main' into feature/litellm
henchaves Nov 18, 2024
39c4fa9
Removed response_format with ollama models due to issue in litellm
kevinmessiaen Nov 19, 2024
b09d266
Added dumb trim
kevinmessiaen Nov 19, 2024
911d6e5
Fixed output
kevinmessiaen Nov 19, 2024
40bede9
Add _parse_json_output to LiteLLM
henchaves Nov 19, 2024
77e6a4f
Added way to disable structured output
kevinmessiaen Nov 20, 2024
cab45a1
Fix test_litellm_client
henchaves Nov 21, 2024
5f39da1
Merge branch 'main' into feature/litellm
henchaves Nov 21, 2024
78dd03e
Check if format is json before calling _parse_json_output
henchaves Nov 21, 2024
82712c7
Set LITELLM_LOG as error level
henchaves Nov 21, 2024
a61e4b2
Add `disable_structured_output` to bedrock examples
henchaves Nov 21, 2024
3d33028
Format files
henchaves Nov 21, 2024
a571312
Fix sonar issues
henchaves Nov 21, 2024
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into feature/litellm
  • Loading branch information
@henchaves
henchaves authored Nov 18, 2024
commit 5f51327353df737ac3726217864560731c6ab668

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.