I am trying to use Fara-7B hosted in Azure Foundry.
I have also set the credentials in azure_foundry_config.json
{
"model": "Fara-7B",
"base_url": "https://myendpoint.ml.azure.com/",
"api_key": "myapikey"
}
I am using following command:
fara-cli --task "how many pages does wikipedia have" --endpoint_config endpoint_configs/azure_foundry_config.json --headful
I keep receiving following error:
Retrying fara.fara_agent.FaraAgent._make_model_call in 5.0 seconds as it raised APIConnectionError: Connection error..