-
-
Notifications
You must be signed in to change notification settings - Fork 3.3k
Description
LocalAI version:
v3.8.0 (c0d1d02)
Environment, CPU architecture, OS, and Version:
Linux LAPTOP-ERM8SBMS 6.6.87.2-microsoft-standard-WSL2 #1 SMP PREEMPT_DYNAMIC Thu Jun 5 18:30:46 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Windows 10 Home 22H2
Processor 11th Gen Intel(R) Core(TM) i9-11900H @ 2.50GHz 2.50 GHz
Installed RAM 16.0 GB (15.7 GB usable)
Graphics Card NVIDIA GeForce RTX 3060 Laptop GPU (6 GB), Intel(R) UHD Graphics (128 MB)
System Type 64-bit operating system, x64-based processor
Describe the bug
After installing chatterbox back-end and model.yaml file, and trying to perform tts request, it returns the error:
{"error":{"code":500,"message":"error during TTS: Unexpected err=TypeError("ChatterboxTTS.generate() missing 1 required positional argument: 'language_id'"), type(err)=\u003cclass 'TypeError'\u003e","type":""}}
Have tried to specify language in the model.yaml and through POST arguments as "language", "language_id". Tried adding in the model.yaml file under "parameters" and "tts" stanzas.
To Reproduce
Install chatterbox back-end and model file
go to TTS in web ui, select chatterbox, type Hello world in the input and click send.
Expected behavior
audio file to be produced based on the input text
Logs
NOTE: The error message which is returned by the api does not appear in the logs.
2025-12-20 16:45:28
9:45PM DBG Wait for the service to start up
2025-12-20 16:45:28
9:45PM DBG Options: ContextSize:1024 Seed:798501608 NBatch:512 MMap:true NGPULayers:9999999 Threads:8 FlashAttention:"auto"
2025-12-20 16:45:28
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stdout Initializing libbackend for cuda12-chatterbox
2025-12-20 16:45:28
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stdout Using portable Python
2025-12-20 16:45:30
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr /backends/cuda12-chatterbox/venv/lib/python3.10/site-packages/perth/perth_net/init.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
2025-12-20 16:45:30
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr from pkg_resources import resource_filename
2025-12-20 16:45:32
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr /backends/cuda12-chatterbox/venv/lib/python3.10/site-packages/transformers/utils/hub.py:110: FutureWarning: Using TRANSFORMERS_CACHE is deprecated and will be removed in v5 of Transformers. Use HF_HOME instead.
2025-12-20 16:45:32
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr warnings.warn(
2025-12-20 16:45:35
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr Server started. Listening on: 127.0.0.1:36309
2025-12-20 16:45:36
9:45PM DBG GRPC Service Ready
2025-12-20 16:45:36
9:45PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:0xc000771958} sizeCache:0 unknownFields:[] Model:chatterbox ContextSize:1024 Seed:798501608 NBatch:512 F16Memory:false MLock:false MMap:true VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:9999999 MainGPU: TensorSplit: Threads:8 RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/models/chatterbox PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 ControlNet: Tokenizer: LoraBase: LoraAdapter: LoraScale:0 NoMulMatQ:false DraftModel: AudioPath: Quantization: GPUMemoryUtilization:0 TrustRemoteCode:false EnforceEager:false SwapSpace:0 MaxModelLen:0 TensorParallelSize:0 LoadFormat: DisableLogStatus:false DType: LimitImagePerPrompt:0 LimitVideoPerPrompt:0 LimitAudioPerPrompt:0 MMProj: RopeScaling: YarnExtFactor:0 YarnAttnFactor:0 YarnBetaFast:0 YarnBetaSlow:0 Type: FlashAttention:auto NoKVOffload:false ModelPath://models LoraAdapters:[] LoraScales:[] Options:[] CacheTypeKey: CacheTypeValue: GrammarTriggers:[] Reranking:false Overrides:[]}
2025-12-20 16:45:36
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr CUDA is available
2025-12-20 16:45:36
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr Preparing models, please wait
2025-12-20 16:45:46
9:45PM INF HTTP request method=GET path=/readyz status=200
2025-12-20 16:45:51
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr /backends/cuda12-chatterbox/venv/lib/python3.10/site-packages/diffusers/models/lora.py:393: FutureWarning: LoRACompatibleLinear is deprecated and will be removed in version 1.0.0. Use of LoRACompatibleLinear is deprecated. Please switch to PEFT backend by installing PEFT: pip install peft.
2025-12-20 16:45:51
9:45PM DBG GRPC(chatterbox-127.0.0.1:36309): stderr deprecate("LoRACompatibleLinear", "1.0.0", deprecation_message)
Additional context