LLM Provider Reference

Per-provider configuration for all backends supported by kdeps. Backend and API keys go in ~/.kdeps/config.yaml. See LLM Backends for routing, allowlists, and streaming.

Local Backend

Ollama (Default)

Ollama is the default backend for local model serving.

# ~/.kdeps/config.yaml
llm:
  backend: ollama
  # base_url: http://custom-ollama:11434   # optional override

When building Docker images, Ollama is automatically installed when backend: ollama is set. The installOllama workflow flag can force or suppress this:

# workflow.yaml
settings:
  agentSettings:
    installOllama: true  # Force install (default: auto-detect from chat resources)

Cloud Backends

Any API that implements the OpenAI chat completions API works with kdeps.

OpenAI

# ~/.kdeps/config.yaml
llm:
  backend: openai
  openai_api_key: sk-...

Model	Description
gpt-4o	Latest GPT-4 Omni
gpt-4o-mini	Smaller, faster GPT-4
gpt-4-turbo	GPT-4 Turbo
gpt-3.5-turbo	Fast, cost-effective

Anthropic (Claude)

# ~/.kdeps/config.yaml
llm:
  backend: anthropic
  anthropic_api_key: sk-ant-...

Model	Description
claude-sonnet-4-20250514	Latest Claude Sonnet 4
claude-3-5-sonnet-20241022	Claude 3.5 Sonnet
claude-3-opus-20240229	Most capable Claude 3
claude-3-haiku-20240307	Fast, efficient

Google (Gemini)

# ~/.kdeps/config.yaml
llm:
  backend: google
  google_api_key: ...

Model	Description
gemini-1.5-pro	Latest Gemini Pro
gemini-1.5-flash	Fast inference
gemini-pro	Standard Gemini

Mistral

# ~/.kdeps/config.yaml
llm:
  backend: mistral
  mistral_api_key: ...

Model	Description
mistral-large-latest	Most capable
mistral-medium-latest	Balanced
mistral-small-latest	Fast, efficient
open-mistral-7b	Open-source 7B
open-mixtral-8x7b	MoE model

Groq

Ultra-fast inference with Groq hardware.

# ~/.kdeps/config.yaml
llm:
  backend: groq
  groq_api_key: ...

Model	Description
llama-3.1-70b-versatile	Llama 3.1 70B
llama-3.1-8b-instant	Llama 3.1 8B (fastest)
mixtral-8x7b-32768	Mixtral with 32K context
gemma2-9b-it	Google Gemma 2 9B

Together AI

# ~/.kdeps/config.yaml
llm:
  backend: together
  together_api_key: ...

Model	Description
meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo	Llama 3.1 70B
meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo	Llama 3.1 8B
mistralai/Mixtral-8x7B-Instruct-v0.1	Mixtral 8x7B
Qwen/Qwen2-72B-Instruct	Qwen2 72B

Perplexity

Search-augmented LLM responses.

# ~/.kdeps/config.yaml
llm:
  backend: perplexity
  perplexity_api_key: ...

Model	Description
llama-3.1-sonar-large-128k-online	Large with web search
llama-3.1-sonar-small-128k-online	Small with web search
llama-3.1-sonar-large-128k-chat	Large chat only

Cohere

# ~/.kdeps/config.yaml
llm:
  backend: cohere
  cohere_api_key: ...

Model	Description
command-r-plus	Most capable
command-r	Fast and capable
command	Standard
command-light	Fast, efficient

DeepSeek

# ~/.kdeps/config.yaml
llm:
  backend: deepseek
  deepseek_api_key: ...

Model	Description
deepseek-chat	General chat
deepseek-coder	Code generation

Self-Hosted Solutions

kdeps works with any self-hosted solution that implements the OpenAI API: vLLM, Text Generation Inference (TGI), LocalAI, LlamaCpp Server.

# ~/.kdeps/config.yaml
llm:
  backend: openai
  base_url: http://your-vllm-server:8000/v1

Custom Base URL

Override the default API URL via base_url:

# Azure OpenAI
llm:
  backend: openai
  base_url: "https://my-resource.openai.azure.com/openai/deployments/my-deployment"
  openai_api_key: ...

See Also

• LLM Backends - Routing, allowlists, streaming, feature matrix
• LLM Resource - Complete LLM resource documentation