Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Provider matrix

When to read this: Configure LLM backends, auth, or default model capabilities.

Source: crates/chatty-core/src/settings/models/providers_store.rs, crates/chatty-core/src/factories/agent_factory/provider_builder.rs.

Provider types

ProviderDisplay nameAuthRequired configDefault imagesDefault PDFTemperature default
openrouterOpenRouterAPI keyapi_key; optional base_urlyesyesper ModelConfig
ollamaOllamanoneoptional base_url (default http://localhost:11434)nonoalways applied
azure_openaiAzure OpenAIAPI key or Entra IDbase_url (resource endpoint) + credentialsyesnoper ModelConfig

OpenRouter

  • Gateway to 200+ upstream models (Anthropic, OpenAI, Google, Mistral, Meta, …).
  • Persisted ProviderType JSON is open_router (serde snake_case). Legacy values open_ai, open_a_i, anthropic, gemini, mistral deserialize as OpenRouter. The string openrouter is not accepted.
  • configured_providers() requires a non-empty api_key.
  • Rig client: rig_core::providers::openrouter::Client.
  • MCP tools are sanitized for OpenAI-compatible schemas before attachment.

Ollama

  • Local or remote Ollama instance; no API key required.
  • Included in configured_providers() even without api_key.
  • Default capabilities are (false, false); vision/PDF support is detected per model via /api/show (sync_service.rs) and stored in ModelConfig.
  • Rig client: rig_core::providers::ollama::Client.

Azure OpenAI

  • Auth via extra_config.auth_method: api_key (default) or entra_id.
  • configured_providers() requires non-empty base_url and (api_key or Entra ID).
  • Endpoint URLs are normalized (trailing slashes stripped, /openai/deployments/... paths truncated).
  • Per-model api_version in ModelConfig.extra_params; default from AZURE_DEFAULT_API_VERSION.
  • Entra ID tokens are cached in AzureTokenCache when available.
  • Rig client: rig_core::providers::azure::Client.

Model capabilities (ModelConfig)

FieldPurpose
supports_imagesAllow image attachments in chat
supports_pdfAllow PDF attachments
supports_temperatureShow temperature slider; skipped for reasoning models

New models inherit ProviderType::default_capabilities(). Ollama overrides per model after sync.

TUI direct-connect flags (bypass Settings UI)

FlagMaps toNotes
--ollama [URL]Ollama providerAuto-discovers models from /api/tags
--openai-compat-url URLOpenRouter provider typevLLM, llama.cpp, LM Studio, etc.; optional --api-key

See CLI flags for full chatty-tui options.