Skip to content

Supported Providers ​

Anthropic (Claude) ​

SettingValue
Base URLhttps://api.anthropic.com
API KeyANTHROPIC_API_KEY
Supported APIsMessages API (/v1/messages)
Modelsclaude-*

OpenAI (GPT) ​

SettingValue
Base URLhttps://api.openai.com
API KeyOPENAI_API_KEY
Supported APIsChat Completions (/v1/chat/completions)
Modelsgpt-*

Passthrough Mode ​

Forward all requests to a single upstream:

yaml
upstream: "https://api.anthropic.com"

Router Mode ​

Auto-detect provider from API key prefix (sk-lli-*) and route by model name:

yaml
router:
  enabled: true
  providers:
    - name: anthropic
      base_url: "https://api.anthropic.com"
      model_glob: "claude-*"
      api_key: "${ANTHROPIC_API_KEY}"

Adding Custom Providers ​

Any OpenAI-compatible API can be added as a provider. Set base_url to the API endpoint and use model_glob to match model names.

Environment Variables ​

Use ${VAR_NAME} syntax in config values to reference environment variables at runtime.

Released under the MIT License.