# holmesgpt | holmesgpt | Knowledge Base | Instagit

SRE Agent - CNCF Sandbox Project

GitHub Stars: 1.9k

Repository: https://github.com/holmesgpt/holmesgpt

---

## Articles

### [HolmesGPT Safeguards for Safe Tool Execution: Defense-in-Depth Architecture](/holmesgpt/holmesgpt/what-safeguards-holmesgpt-safe-tool-execution)

Discover HolmesGPT safeguards for safe tool execution. Learn about its defense-in-depth architecture including validation, filtering, approval workflows, and endpoint restrictions.

- Tags: architecture
- Published: 2026-03-03

### [How to Add a Custom LLM Model to HolmesGPT's Model Registry](/holmesgpt/holmesgpt/how-to-add-custom-llm-model-holmesgpt-model-registry)

Add a custom LLM model to HolmesGPT's model registry by configuring YAML. Integrate any LiteLLM supported endpoint seamlessly without code changes.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Configure PagerDuty or OpsGenie Integration in HolmesGPT](/holmesgpt/holmesgpt/how-to-configure-pagerduty-opsgenie-integration-holmesgpt)

Learn to configure PagerDuty or OpsGenie integration in HolmesGPT using API keys and config files. Streamline your incident management with automatic plugin instantiation.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Use Interactive Mode in HolmesGPT CLI: Complete REPL Guide](/holmesgpt/holmesgpt/how-to-use-interactive-mode-holmesgpt-cli)

Master HolmesGPT interactive mode for seamless infrastructure troubleshooting. Use the `holmes ask` REPL to chat with AI, execute commands, and share outputs directly from your terminal.

- Tags: how-to-guide
- Published: 2026-03-03

### [HolmesGPT Sources vs Toolsets: Understanding the Core Architectural Difference](/holmesgpt/holmesgpt/difference-between-sources-toolsets-holmesgpt)

Explore the core architectural difference in HolmesGPT. Understand how sources ingest alerts and toolsets provide executable commands for LLM investigations.

- Tags: architecture
- Published: 2026-03-03

### [How to Configure Slack Output Destination in HolmesGPT: Complete Setup Guide](/holmesgpt/holmesgpt/how-to-configure-slack-output-destination-holmesgpt)

Learn to configure Slack output in HolmesGPT using CLI flags environment variables or a YAML file. Integrate your workflows seamlessly with this complete setup guide.

- Tags: how-to-guide
- Published: 2026-03-03

### [Configuring Custom Toolsets vs. CLI Experimental Toolsets in HolmesGPT](/holmesgpt/holmesgpt/configuring-custom-toolsets-vs-cli-experimental-toolsets)

Explore HolmesGPT's custom toolsets vs CLI experimental toolsets. Learn to extend capabilities effectively through stable overrides or supplementary CLI options.

- Tags: how-to-guide
- Published: 2026-03-03

### [How the HolmesGPT Prompt Building System Works: Architecture and Implementation](/holmesgpt/holmesgpt/how-prompt-building-system-work-holmesgpt)

Discover how the HolmesGPT prompt building system works. Learn about its two-stage pipeline architecture for configurable system and dynamic user prompts using Jinja2 and runtime enrichment.

- Tags: architecture
- Published: 2026-03-03

### [How to Add a New Data Source (Toolset) to HolmesGPT](/holmesgpt/holmesgpt/how-to-add-new-data-source-toolset-holmesgpt)

Learn to add a new data source toolset to HolmesGPT by creating a YAML definition, registering it, and refreshing the tool cache for seamless integration.

- Tags: how-to-guide
- Published: 2026-03-03

### [When to Use JSON Filter Mixin in Custom Toolsets: A HolmesGPT Guide](/holmesgpt/holmesgpt/when-to-use-json-filter-mixin-custom-toolsets)

Learn when to use the JSON filter mixin in HolmesGPT custom toolsets. Effectively manage large or nested JSON payloads to avoid token limits and streamline your investigations.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Configure max_steps for HolmesGPT Investigations: CLI, Config, and Code Examples](/holmesgpt/holmesgpt/how-to-configure-max_steps-holmesgpt-investigations)

Master HolmesGPT max_steps configuration for investigations. Learn to set limits via CLI, config files, and code examples for efficient tool-calling.

- Tags: how-to-guide
- Published: 2026-03-03

### [How HolmesGPT Manages State During Investigations: Architecture and Implementation](/holmesgpt/holmesgpt/how-holmesgpt-manage-state-investigations)

Discover how HolmesGPT manages investigation state in memory using a single loop within the ToolCallingLLM class. Learn about its architecture and implementation.

- Tags: architecture
- Published: 2026-03-03

### [How to Write Integration Tests for HolmesGPT Toolsets: A Complete Guide](/holmesgpt/holmesgpt/how-to-write-integration-tests-holmesgpt-toolsets)

Learn how to write integration tests for HolmesGPT toolsets with this guide. Use pytest, real credentials, and assert live API responses against JSON schemas for robust testing.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Use MCP Servers with HolmesGPT: Integration Guide and Configuration](/holmesgpt/holmesgpt/how-to-use-mcp-servers-holmesgpt)

Integrate HolmesGPT with MCP servers using HTTP, SSE, or stdio transports. Learn how to dynamically load remote tools via config yaml for enhanced LLM agent runtime.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Debug Failing Tools in HolmesGPT: A Complete Troubleshooting Guide](/holmesgpt/holmesgpt/how-to-debug-failing-tools-holmesgpt)

Debug failing HolmesGPT tools with our complete guide. Use verbose flags, list toolsets, and inspect status files to quickly resolve environment and configuration issues.

- Tags: how-to-guide
- Published: 2026-03-03

### [How HolmesGPT Handles Tool Errors and Retries: A Deep Dive into the Source Code](/holmesgpt/holmesgpt/how-holmesgpt-handle-tool-errors-retries)

Explore HolmesGPT's source code to understand its layered approach for handling tool errors and retries using StructuredToolResult and automatic retry mechanisms.

- Tags: deep-dive
- Published: 2026-03-03

### [How to Configure Kubernetes Toolset Authentication in HolmesGPT](/holmesgpt/holmesgpt/how-to-configure-kubernetes-toolset-authentication-holmesgpt)

Learn to configure Kubernetes toolset authentication in HolmesGPT using kubeconfig files or ServiceAccounts. HolmesGPT ensures secure access with default read-only RBAC.

- Tags: how-to-guide
- Published: 2026-03-03

### [HolmesGPT Toolsets: Complete Guide to Built-In Observability Integrations](/holmesgpt/holmesgpt/what-toolsets-are-available-holmesgpt)

Explore HolmesGPT toolsets, featuring 14 built-in YAML observability integrations for Kubernetes, cloud platforms, and developer tools. Empower your LLM investigations with comprehensive insights.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Add Custom Runbooks to HolmesGPT: Complete Configuration Guide](/holmesgpt/holmesgpt/how-to-add-custom-runbooks-holmesgpt)

Easily add custom runbooks to HolmesGPT. This guide shows you how to create markdown troubleshooting guides and configure your HolmesGPT settings for enhanced automation.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Integrate HolmesGPT with Prometheus AlertManager](/holmesgpt/holmesgpt/how-to-integrate-holmesgpt-prometheus-alertmanager)

Learn to integrate HolmesGPT with Prometheus AlertManager by configuring the Prometheus source plugin. Automate LLM-driven alert investigation and analysis. Get started today.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Configure HolmesGPT with Different LLM Providers (OpenAI, Anthropic, Azure)](/holmesgpt/holmesgpt/how-to-configure-holmesgpt-llm-providers)

Learn to configure HolmesGPT with OpenAI, Anthropic, and Azure LLM providers. Set model, API key, and more via config file, env vars, or CLI.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Customize the Investigation Flow in HolmesGPT: 5 Configuration Methods](/holmesgpt/holmesgpt/how-to-customize-investigation-flow-holmesgpt)

Customize HolmesGPT investigation flow easily. Modify toolsets runbooks prompts output and settings without core code changes. Enhance your threat hunting today.

- Tags: how-to-guide
- Published: 2026-03-03

### [How to Create a Custom Toolset in HolmesGPT: A Complete Developer Guide](/holmesgpt/holmesgpt/how-to-create-custom-toolset-holmesgpt)

Learn how to create a custom toolset in HolmesGPT. This guide explains using YAML definitions and the CLI flag for seamless integration with built-in tools. Enhance your development workflow today.

- Tags: how-to-guide
- Published: 2026-03-03