Skip to main content

LiteLLM custom provider throwing an error

I am self-hosting a LiteLLM instance to proxy all my AI stuff. I managed to add it as a custom provider and fetch the models by prefixing the API key with ‘Bearer ‘ because the LiteLLM logs showed it was missing that.

Now that I added it as a provider and select a model to chat with, I run into this error:

In the LiteLLM logs I don’t see any sign of an API call, so it seems to fail somewhere before it hits the endpoint. I’ve tried to add /v1 at the end of it to no effect.

Status: In Progress1 comment

Log in to comment and vote

Comments1

  • Daniel Nguyen

    Team•

    Apr 24, 2025

    I’ve fixed the Bearer issue in the latest build. This particular error means BoltAI wasn’t able to establish a connection to your server. Is it reachable from the Internet, or it’s behind a firewall?