Skip to content

Supported Providers

Anthropic (Claude)

SettingValue
Base URLhttps://api.anthropic.com
API KeyANTHROPIC_API_KEY
Supported APIsMessages API (/v1/messages)
Modelsclaude-*

OpenAI (GPT)

SettingValue
Base URLhttps://api.openai.com
API KeyOPENAI_API_KEY
Supported APIsChat Completions (/v1/chat/completions)
Modelsgpt-*

Passthrough Mode

Forward all requests to a single upstream:

yaml
upstream: "https://api.anthropic.com"

Router Mode

Auto-detect provider from API key prefix (sk-lli-*) and route by model name:

yaml
router:
  enabled: true
  providers:
    - name: anthropic
      base_url: "https://api.anthropic.com"
      model_glob: "claude-*"
      api_key: "${ANTHROPIC_API_KEY}"

Adding Custom Providers

Any OpenAI-compatible API can be added as a provider. Set base_url to the API endpoint and use model_glob to match model names.

Environment Variables

Use ${VAR_NAME} syntax in config values to reference environment variables at runtime.

Released under the MIT License.