LiteLLM custom provider throwing an error
I am self-hosting a LiteLLM instance to proxy all my AI stuff. I managed to add it as a custom provider and fetch the models by prefixing the API key with ‘Bearer ‘ because the LiteLLM logs showed it was missing that.
Now that I added it as a provider and select a model to chat with, I run into this error:

In the LiteLLM logs I don’t see any sign of an API call, so it seems to fail somewhere before it hits the endpoint. I’ve tried to add /v1 at the end of it to no effect.
Log in to comment and vote
Comments1
Daniel Nguyen
Apr 24, 2025
I’ve fixed the Bearer issue in the latest build. This particular error means BoltAI wasn’t able to establish a connection to your server. Is it reachable from the Internet, or it’s behind a firewall?