AI Providers

HolmesGPT supports multiple AI providers, giving you flexibility in choosing the best model for your needs and budget.

• Anthropic
• AWS Bedrock
• Azure OpenAI
• Gemini
• Google Vertex AI
• Ollama
• OpenAI
• OpenAI-Compatible
• Using Multiple Providers

Quick Start

Recommended for New Users

OpenAI models provide a good balance of accuracy and speed.

Anthropic models often give better results at the expense of speed.

To get started with an OpenAI model:

1. Get an OpenAI API key
2. Set export OPENAI_API_KEY="your-api-key"
3. Run holmes ask "what pods are failing?" (OpenAI is the default provider)

Choose your provider above to see detailed configuration instructions.

Configuration

Each AI provider requires specific environment variables for authentication. See the Environment Variables Reference for a complete list of all configuration options beyond just API keys.