# aisuite | Andrew Ng | Knowledge Base | Instagit Simple, unified interface to multiple Generative AI providers GitHub Stars: 14.4k Repository: https://github.com/andrewyng/aisuite --- ## Articles ### [Troubleshooting Common Errors in aisuite: Provider Loading and Parameter Validation](/andrewyng/aisuite/troubleshooting-common-errors-aisuite-provider-loading-param-validation) Troubleshoot common aisuite errors like provider loading failures and parameter validation issues. Learn to fix invalid keys, import problems, and configuration gaps for seamless AI integration. - Tags: troubleshooting-guide - Published: 2026-08-04 ### [aisuite Security Best Practices: Using Tool Policies and Approval Workflows](/andrewyng/aisuite/security-best-practices-aisuite-tool-policies-approval-workflows) Discover aisuite security best practices for enforcing allowlists requiring human approval and auditing tool invocations with flexible tool policies and approval workflows. - Tags: best-practices - Published: 2026-08-04 ### [Performance Optimization Techniques in aisuite: Provider Caching and Lazy Initialization](/andrewyng/aisuite/performance-optimization-aisuite-provider-caching-lazy-initialization) Boost aisuite performance with provider caching and lazy initialization. Discover how these techniques optimize runtime and defer instantiation for faster results. - Tags: performance - Published: 2026-08-04 ### [Framework Test Patterns for Testing aisuite Applications: A Complete Guide](/andrewyng/aisuite/framework-test-patterns-testing-aisuite-applications) Discover framework test patterns for aisuite applications. Learn to validate Pydantic models, map ASR parameters, and verify agent tracing with mocked Runner workflows. - Tags: how-to-guide - Published: 2026-08-04 ### [Managing Conversation State and Handling ThreadAlreadyExistsError in aisuite](/andrewyng/aisuite/managing-conversation-state-handling-threadalreadyexists-error) Learn to manage conversation state and handle ThreadAlreadyExistsError in aisuite. Prevent overwrites and resume persisted state using continuation APIs. - Tags: how-to-guide - Published: 2026-08-04 ### [Extracting Thinking or Reasoning Content from LLM Model Responses in aisuite](/andrewyng/aisuite/extract-thinking-reasoning-content-model-responses) Learn how aisuite extracts thinking or reasoning content from LLM responses. It automatically parses thinking tags, storing internal reasoning separately for clear analysis. - Tags: how-to-guide - Published: 2026-08-04 ### [Understanding the Model Identifier Format in aisuite: Parsing 'provider:model' Strings](/andrewyng/aisuite/understanding-model-identifier-format-parsing-provider-model-strings) Learn the aisuite model identifier format provider:model. Understand how aisuite routes requests by splitting the string to load specific LLM provider classes. - Tags: internals - Published: 2026-08-04 ### [How to Handle LLMError and Provider Exceptions in aisuite](/andrewyng/aisuite/error-handling-aisuite-llmerror-asreror-provider-exceptions) Learn to handle LLMError and provider exceptions in aisuite. This guide shows how to unify SDK errors for simplified, robust error management in your AI applications. - Tags: how-to-guide - Published: 2026-08-04 ### [Standardizing Message Formats Across Different LLM Providers in AISuite](/andrewyng/aisuite/standardizing-message-formats-across-llm-providers) Standardize LLM message formats in AISuite with OpenAICompliantMessageConverter. Seamlessly integrate OpenAI, Groq, and Anthropic for consistent API handling. - Tags: architecture - Published: 2026-08-04 ### [Artifact Storage and Management in AISuite Agent Workflows](/andrewyng/aisuite/artifact-storage-management-aisuite-agent-workflows) Learn how AISuite agents manage large data payloads efficiently using artifact storage. Discover how this prevents memory bloat and ensures full data accessibility in your agent workflows. - Tags: internals - Published: 2026-08-04 ### [Parameter Mapping for ASR: Translating Speech-to-Text Parameters Across Providers in aisuite](/andrewyng/aisuite/parameter-mapping-asr-translating-parameters-between-providers) Master ASR parameter mapping with aisuite. Seamlessly translate speech-to-text parameters across OpenAI, Deepgram, and Google using automated renaming and validation. Simplify your ASR integration. - Tags: how-to-guide - Published: 2026-08-04 ### [How to Use the Audio Transcription API in aisuite: client.audio.transcriptions.create](/andrewyng/aisuite/use-audio-transcription-api-client-audio-transcriptions-create) Learn how to use the aisuite client.audio.transcriptions.create method for unified speech-to-text transcription across multiple providers like OpenAI, Deepgram, and Google. - Tags: how-to-guide - Published: 2026-08-04 ### [Understanding Async Implementation in AISuite: achat_completions and Async Tool Execution](/andrewyng/aisuite/understanding-async-implementation-achat-completions-async-tool-execution) Explore async implementation in AISuite. Learn how achat_completions and async tool execution leverage asyncio.to_thread for non-blocking LLM operations across providers. - Tags: internals - Published: 2026-08-04 ### [How to Use State Stores in AISuite: File, In-Memory, and Postgres Implementations](/andrewyng/aisuite/use-state-stores-filestate-store-inmemorystate-store-postgresstate-store) Learn to use AISuite's FileStateStore, InMemoryStateStore, and PostgresStateStore for robust agent state persistence. Ensure seamless agent restarts and concurrent access. - Tags: how-to-guide - Published: 2026-08-04 ### [Implementing Tool Policies in aisuite: RequireApprovalPolicy and Allow/Deny Lists](/andrewyng/aisuite/implement-tool-policies-requireapprovalpolicy-allow-deny-lists) Learn to implement tool policies in aisuite using RequireApprovalPolicy and allow/deny lists. Enforce access control and dynamic approval logic with this pluggable framework. - Tags: how-to-guide - Published: 2026-08-04 ### [How to Integrate MCP (Model Context Protocol) Servers with aisuite](/andrewyng/aisuite/integrate-mcp-servers-with-aisuite) Learn to integrate MCP servers with aisuite. Discover how aisuite exposes external tools to LLMs using MCP for seamless server lifecycle management and configuration. - Tags: how-to-guide - Published: 2026-08-04 ### [Understanding the Tool Execution Loop and the max_turns Parameter in aisuite](/andrewyng/aisuite/understanding-tool-execution-loop-max-turns-parameter) Explore the aisuite tool execution loop and max_turns parameter. Learn how max_turns limits automatic tool calls for efficient chatbot responses. - Tags: deep-dive - Published: 2026-08-04 ### [How to Add a New LLM Provider to aisuite: Provider Naming Convention Guide](/andrewyng/aisuite/add-new-llm-provider-aisuite-naming-convention) Learn how to add a new LLM provider to aisuite. Follow the provider naming convention by creating a Python module and implementing the BaseProvider class. Integrate seamlessly today. - Tags: how-to-guide - Published: 2026-08-04 ### [How aisuite Implements Provider Abstraction and the ProviderFactory Pattern](/andrewyng/aisuite/how-aisuite-implements-provider-abstraction-and-providerfactory-pattern) Discover how aisuite uses provider abstraction and the ProviderFactory pattern for flexible backend integration. Learn about its abstract base class and dynamic instantiation. - Tags: internals - Published: 2026-08-04 ### [How to Troubleshoot Provider-Specific Errors in AISuite](/andrewyng/aisuite/how-troubleshoot-provider-specific-errors-aisuite) Troubleshoot provider specific errors in AISuite by catching ASRError or LLMError and inspecting err.__cause__ for SDK exceptions. Resolve issues fast. - Tags: how-to-guide - Published: 2026-08-03 ### [aisuite Provider Authentication Pattern: API Keys, IAM Roles, and Environment Variables Explained](/andrewyng/aisuite/implementation-pattern-provider-specific-authentication-aisuite) Learn the aisuite provider authentication pattern. Understand how to use API keys, IAM roles, and environment variables for secure access to cloud services. - Tags: architecture - Published: 2026-08-03 ### [How aisuite Handles Provider-Specific Thinking/Reasoning Content Extraction](/andrewyng/aisuite/how-aisuite-handles-provider-specific-thinking-reasoning-content-extraction) Learn how aisuite extracts provider-specific thinking and reasoning content using XML tags, separating it into dedicated fields for cleaner analysis. - Tags: internals - Published: 2026-08-03 ### [How to Migrate from Direct Provider SDK Calls to aisuite's Unified API](/andrewyng/aisuite/how-migrate-direct-provider-sdk-calls-aisuite-unified-api) Effortlessly migrate from direct provider SDK calls to aisuite's unified API. Replace clients, prefix models, and use consistent OpenAI-style parameters for all providers. Simplify your AI integration today. - Tags: migration-guide - Published: 2026-08-03 ### [How aisuite Validates and Maps ASR Parameters: A Deep Dive into the ParamValidator Architecture](/andrewyng/aisuite/how-aisuite-validate-map-asr-parameters) Learn how aisuite validates and maps ASR parameters with its ParamValidator architecture. Discover its OpenAI-style translation, provider whitelists, and flexible handling of unknown parameters. - Tags: deep-dive - Published: 2026-08-03 ### [How Artifact Stores Work in aisuite for Persisting Generated Outputs](/andrewyng/aisuite/how-artifact-stores-work-aisuite-persisting-generated-outputs) Learn how aisuite artifact stores persist generated outputs like command line output or model text. Prevent trace bloat and retrieve data efficiently with this lightweight abstraction. - Tags: internals - Published: 2026-08-03 ### [aisuite Chat vs. Audio APIs: Key Differences and Usage Guide](/andrewyng/aisuite/differences-aisuite-clients-chat-audio-apis) Compare aisuite Chat API for text conversations and tool execution against the Audio API for speech-to-text. Understand key differences and usage guides to choose the right API. - Tags: comparison - Published: 2026-08-03 ### [How aisuite Handles Tool-Call Streaming with Incremental Delta Updates](/andrewyng/aisuite/how-aisuite-handles-tool-call-streaming-incremental-delta-updates) Discover how aisuite streams tool call updates incrementally. It builds full objects from delta pieces for live UI and delayed execution. - Tags: how-to-guide - Published: 2026-08-03 ### [How to Implement Custom Tool Policies with Approval Workflows in AISuite](/andrewyng/aisuite/how-implement-custom-tool-policies-approval-workflows-aisuite) Implement custom tool policies with approval workflows in AISuite using RequireApprovalPolicy and callbacks. Integrate external logic for allow/deny decisions and enhance control over tool execution. - Tags: how-to-guide - Published: 2026-08-03 ### [How aisuite's Async Support Works for Chat Completions and Tool Execution](/andrewyng/aisuite/how-aisuite-async-support-works-chat-completions-tool-execution) Discover how aisuite's async support handles chat completions and tool execution efficiently across provider APIs, tool execution, and completion creation. Learn more. - Tags: internals - Published: 2026-08-03 ### [How to Configure Provider-Specific API Credentials in AISuite](/andrewyng/aisuite/how-configure-provider-specific-api-credentials-aisuite) Easily configure provider specific API credentials in AISuite. Learn to set API keys via environment variables, programmatically, or through the secret store. Maximize efficiency and security. - Tags: how-to-guide - Published: 2026-08-03 ### [Architecture of aisuite's Multi-Provider Chat Completion System: A Deep Dive](/andrewyng/aisuite/architecture-aisuite-multi-provider-chat-completion-system) Explore the architecture of aisuite's multi-provider chat completion system. Discover how a plug-in design enables seamless integration with various LLM providers. - Tags: architecture - Published: 2026-08-03 ### [How aisuite Handles Provider-Specific Message and Response Normalization](/andrewyng/aisuite/how-aisuite-handles-provider-specific-message-response-normalization) Learn how aisuite normalizes provider-specific messages and responses using a unified OpenAI-compatible contract and central message converter. Streamline your LLM integrations. - Tags: internals - Published: 2026-08-03 ### [How aisuite's Built-In Toolkits (files, git, shell) Provide Sandboxed Functionality](/andrewyng/aisuite/how-aisuite-built-in-toolkits-files-git-shell-provide-sandboxed-functionality) Learn how aisuite's built-in toolkits provide sandboxed functionality. Explore restricted file access, read-only git checks, and whitelisted shell commands for secure execution. - Tags: internals - Published: 2026-08-03 ### [How to Control Agent Tool Execution with Tool Policies in aisuite](/andrewyng/aisuite/aisuite-tool-policies-controlling-tool-execution-agents) Learn how to control agent tool execution in aisuite using flexible tool policies. Intercept and approve or deny every tool call with simple checks or structured decisions. - Tags: how-to-guide - Published: 2026-08-03 ### [How Streaming Works Across Different LLM Providers in aisuite](/andrewyng/aisuite/how-streaming-works-across-different-providers-aisuite) Discover how aisuite unifies LLM streaming across providers using a three-layer architecture. Understand the base Provider class, normalized streams, and client facade for seamless integration. - Tags: internals - Published: 2026-08-03 ### [AISuite State Persistence Options: In‑Memory, File‑Based, and PostgreSQL Storage Guide](/andrewyng/aisuite/aisuite-state-persistence-options-inmemory-file-postgres) Explore AISuite state persistence options: In-Memory, File-Based, and PostgreSQL storage. Learn how to save, load, and delete agent run state efficiently with this guide. - Tags: how-to-guide - Published: 2026-08-03 ### [How aisuite Integrates with MCP Servers for Tool Calling: A Complete Technical Guide](/andrewyng/aisuite/how-aisuite-integrates-mcp-servers-tool-calling) Learn how aisuite integrates with MCP servers for tool calling using MCPClient. Discover automatic tool discovery and seamless LLM invocation for your applications. - Tags: how-to-guide - Published: 2026-08-03 ### [How aisuite's Agent and Runner Classes Work Together for Structured Agent Workflows](/andrewyng/aisuite/how-aisuite-agent-runner-classes-work-together-structured-agent-workflows) Understand how aisuite's Agent and Runner classes create structured agent workflows. Learn how configuration objects and execution engines manage LLM calls and conversations. - Tags: internals - Published: 2026-08-03 ### [max_turns in aisuite: Automated Tool Execution vs. Manual Tool Calling Explained](/andrewyng/aisuite/difference-between-max_turns-automated-tool-execution-manual-tool-calling-aisuite) Understand the difference between max_turns automated tool execution and manual tool calling in aisuite. Learn how to control tool execution effectively. - Tags: deep-dive - Published: 2026-08-03 ### [How to Add a Custom LLM Provider to aisuite](/andrewyng/aisuite/how-to-add-custom-llm-provider-aisuite-providerfactory-pattern) Learn to add a custom LLM provider to aisuite by subclassing Provider and implementing chat_completions_create. Follow ProviderFactory naming conventions for seamless integration. - Tags: how-to-guide - Published: 2026-08-03 ### [How aisuite's Unified Chat Completions API Handles Provider-Specific Parameter Mapping](/andrewyng/aisuite/how-aisuite-unified-chat-completions-api-handles-provider-specific-parameter-mapping) Learn how aisuite's unified Chat Completions API maps provider parameters. Discover how it uses provider classes and custom parameters for seamless integration. - Tags: internals - Published: 2026-08-03 ### [How to Build a Multi-Provider Fallback Mechanism for Agents in aisuite](/andrewyng/aisuite/how-to-build-a-multi-provider-fallback-mechanism-for-agents) Build a multi-provider fallback for agents with aisuite. Automatically failover between LLM providers to retry requests until one succeeds. Learn how to implement robust agent failover. - Tags: how-to-guide - Published: 2026-07-30 ### [How Audio.Transcription Enables Speech-to-Text Across Providers in AISuite](/andrewyng/aisuite/how-does-audio-transcription-enable-speech-to-text-across-providers) Discover how Audio.Transcription in AISuite unifies speech-to-text across providers with a single interface. Normalize requests and responses for seamless ASR integration. - Tags: how-to-guide - Published: 2026-07-30 ### [How to Use MCPClient for Reusable MCP Server Connections in aisuite](/andrewyng/aisuite/how-to-use-mcpclient-for-reusable-mcp-server-connections) Master reusable MCP server connections with MCPClient in aisuite. This Python interface maintains persistent connections and caches tool definitions for efficient LLM chat completions. Reduce handshake overhead. - Tags: how-to-guide - Published: 2026-07-30 ### [How to Configure Chat Completion Parameters Provider-Independently in aisuite](/andrewyng/aisuite/how-to-configure-chat-completion-parameters-provider-independently) Learn how to configure chat completion parameters provider-independently using aisuite. Pass standard arguments like temperature and max_tokens to any LLM without code changes. - Tags: how-to-guide - Published: 2026-07-30 ### [How ThreadAlreadyExistsError and StateConflictError Protect Thread Integrity in aisuite](/andrewyng/aisuite/how-do-threadalreadyexistserror-and-stateconflicterror-affect-aisuite) Learn how ThreadAlreadyExistsError and StateConflictError protect aisuite by preventing overwrites and ensuring consistent AI agent execution state through optimistic concurrency control. - Tags: internals - Published: 2026-07-30 ### [How to Handle Provider Authentication with API Keys in aisuite](/andrewyng/aisuite/how-to-handle-provider-authentication-with-api-keys) Learn to handle provider authentication with API keys in aisuite. Discover a three-step resolution chain: explicit config, env vars, and SecretStore for secure key management. - Tags: how-to-guide - Published: 2026-07-30 ### [How Tracing Works in aisuite Agent Execution: Events, Stores, and Viewer](/andrewyng/aisuite/how-does-tracing-work-in-aisuite-agent-execution) Understand aisuite agent execution tracing. Learn how events, stores, and the viewer visualize LLM runs, tool use, and errors in a searchable timeline. - Tags: internals - Published: 2026-07-30 ### [How to Implement Agent State Compaction and Resume in AI Suite](/andrewyng/aisuite/how-to-implement-agent-state-compaction-and-resume) Implement agent state compaction and resume in AI Suite using PostgresStateStore.compact_state() and Engine.resume() for efficient conversation management and full context recovery. - Tags: how-to-guide - Published: 2026-07-30 ### [How the ParameterMapper Handles Provider Configuration Differences in AISuite](/andrewyng/aisuite/how-does-the-parameter_mapper-handle-provider-configuration-differences) Discover how the ParameterMapper in AISuite translates unified TranscriptionOptions into provider-specific payloads for OpenAI Whisper, Deepgram, and Google Speech-to-Text. - Tags: internals - Published: 2026-07-30 ### [How to Implement Custom Tool Policies in aisuite: A Complete Guide](/andrewyng/aisuite/how-to-implement-custom-tool-policies-in-aisuite) Learn to implement custom tool policies in aisuite by creating and passing a custom policy class to Client.run(). This guide offers a complete walkthrough for effective integration. - Tags: how-to-guide - Published: 2026-07-30 ### [How `max_turns` Controls Multi-Turn Agent Conversations in aisuite](/andrewyng/aisuite/how-does-max_turns-control-multi-turn-agent-conversations) Learn how max_turns controls multi-turn agent conversations in aisuite by limiting LLM tool cycles for a final response. Master controlled conversational loops. - Tags: internals - Published: 2026-07-30 ### [How to Configure Artifact Storage for Agent Output in AISuite](/andrewyng/aisuite/how-to-configure-artifact-storage-for-agent-output) Learn how to configure artifact storage for agent output in AISuite using CLI flags or the FileArtifactStore. Customize your agent output location easily. - Tags: how-to-guide - Published: 2026-07-30 ### [How to Implement Streaming Tool Calls with Incremental Delta Processing in aisuite](/andrewyng/aisuite/how-to-implement-streaming-tool-calls-with-incremental-delta-processing) Learn to implement streaming tool calls with incremental delta processing in aisuite. Normalize LLM provider chunks into unified async generators for real-time processing. - Tags: how-to-guide - Published: 2026-07-30 ### [How the Runner Class Executes Agent Workflows in aisuite: A Complete Technical Guide](/andrewyng/aisuite/how-does-the-runner-class-execute-agent-workflows) Understand how the Runner class executes agent workflows in aisuite. Learn about input normalization, model calls, tool interactions, trace events, and state persistence. - Tags: deep-dive - Published: 2026-07-30 ### [How to Create and Register Custom Toolkits with an Agent in AISuite](/andrewyng/aisuite/how-to-create-and-register-custom-toolkits-with-an-agent) Learn to create and register custom toolkits with an Agent in AISuite. Define Python functions, bundle them into a toolkit class, and pass to the agent for enhanced functionality. - Tags: how-to-guide - Published: 2026-07-30 ### [How to Persist Agent State with Different State Stores in Aisuite](/andrewyng/aisuite/how-to-persist-agent-state-with-different-state-stores) Learn to persist agent state in Aisuite using InMemory, File, or Postgres state stores. Easily save conversations to memory, files, or a PostgreSQL database with a unified protocol. - Tags: how-to-guide - Published: 2026-07-30 ### [How to Use Async Chat Completions in aisuite: The Complete Guide](/andrewyng/aisuite/how-to-use-async-chat-completions-in-aisuite) Master async chat completions in aisuite with our complete guide. Learn to use the 'acreate' coroutine for non-blocking AI interactions and efficient I/O. - Tags: how-to-guide - Published: 2026-07-30 ### [How aisuite Handles Streaming Across LLM Providers: Architecture and Implementation](/andrewyng/aisuite/how-does-aisuite-handle-streaming-across-llm-providers) Discover how aisuite streamlines LLM streaming. It unifies responses from providers like OpenAI, Anthropic, and Gemini into a single format for seamless integration. - Tags: architecture - Published: 2026-07-30 ### [How to Implement a Custom LLM Provider Adapter in AI-Suite](/andrewyng/aisuite/how-to-implement-custom-llm-provider-adapter) Learn to implement a custom LLM provider adapter in AI-Suite. Create a Python module and subclass the Provider for seamless API integration. Follow our clear guide. - Tags: how-to-guide - Published: 2026-07-30 ### [How ProviderFactory Dynamically Loads LLM Providers in AISuite](/andrewyng/aisuite/how-does-providerfactory-dynamically-load-llm-providers) Learn how ProviderFactory dynamically loads LLM providers in AISuite using a registry and dynamic imports. Instantiate implementations only when needed for efficient runtime. - Tags: internals - Published: 2026-07-30 ### [How to Implement Audio Transcription with the Audio Class in aisuite](/andrewyng/aisuite/how-to-implement-audio-transcription-audio-class-aisuite) Effortlessly transcribe audio using the aisuite Audio class. Integrate OpenAI, Google, or Deepgram with a single line of code and a provider model string for seamless speech-to-text. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Handle State Conflicts with StateConflictError in aisuite](/andrewyng/aisuite/how-to-handle-state-conflicts-stateconflicterror-aisuite) Learn how to handle StateConflictError in aisuite. Prevent data loss by understanding optimistic concurrency and managing stale revision numbers effectively. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Use Tool Allow/Deny Lists with AllowToolsPolicy in aisuite](/andrewyng/aisuite/how-to-use-tool-allow-deny-lists-allowtoolspolicy-aisuite) Learn how to use tool allow deny lists with AllowToolsPolicy in aisuite. Block unauthorized tool invocations efficiently and control access with this runtime whitelist. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Handle LLMError and Provider-Specific Exceptions in aisuite](/andrewyng/aisuite/how-to-handle-llmerror-provider-specific-exceptions-aisuite) Unified LLMError exception in aisuite simplifies error handling. Catch any LLM failure with one handler and access original SDK exceptions via __cause__ for provider-specific logic. - Tags: how-to-guide - Published: 2026-07-28 ### [How aisuite Converts Messages Between LLM Provider Formats](/andrewyng/aisuite/how-messages-converted-between-llm-provider-formats-aisuite) Learn how aisuite converts messages between LLM provider formats. Discover the Message class and converter objects that normalize chat messages for any API. - Tags: internals - Published: 2026-07-28 ### [How Streaming Works Across Different LLM Providers in aisuite](/andrewyng/aisuite/how-streaming-works-across-different-llm-providers-aisuite) Learn how aisuite unifies LLM streaming across OpenAI, Anthropic, and Gemini providers with a single API. Explore seamless integration and automatic async bridging for consistent results. - Tags: deep-dive - Published: 2026-07-28 ### [How to Configure API Keys for Multiple LLM Providers in aisuite](/andrewyng/aisuite/how-to-configure-api-keys-multiple-llm-providers-aisuite) Learn to configure multi LLM provider API keys in aisuite. Explore the cascading priority system: explicit args, environment variables, and SecretStore for secure, seamless workflows. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Use the Git Toolkit for Version Control in AISuite](/andrewyng/aisuite/how-to-use-git-toolkit-version-control-aisuite) Learn how to use the Git toolkit for version control in AISuite. Explore Git status and diff tools with built-in security features for AI agent integration. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Connect MCP Servers as Tools in aisuite: A Complete Integration Guide](/andrewyng/aisuite/how-to-connect-mcp-servers-as-tools-aisuite) Learn how to connect MCP servers as tools in aisuite using MCPClient and tool_wrapper. Integrate your MCP servers seamlessly into LLM workflows. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Stream Tool Calls with Incremental Deltas in aisuite](/andrewyng/aisuite/how-to-stream-tool-calls-incremental-deltas-aisuite) Learn to stream tool calls with incremental deltas using aisuite. Seamlessly integrate LLM responses from Anthropic, OpenAI, and more into a unified protocol for real-time updates. - Tags: how-to-guide - Published: 2026-07-28 ### [How max_turns Controls Multi-Turn Tool Calling Loops in aisuite](/andrewyng/aisuite/how-max-turns-controls-multi-turn-tool-calling-loops-aisuite) Discover how max_turns controls multi-turn tool calling loops in aisuite by capping LLM to tool interaction cycles, ensuring timely loop termination and final response delivery. - Tags: internals - Published: 2026-07-28 ### [How to Use the agent_tool Decorator to Define Agent Functions in aisuite](/andrewyng/aisuite/how-to-use-agent-tool-decorator-define-agent-functions-aisuite) Learn how to use the agent_tool decorator in aisuite to turn any Agent into a callable tool. Effortlessly handle execution and context for parent agents. - Tags: how-to-guide - Published: 2026-07-28 ### [How FileArtifactStore Manages Artifact Storage in aisuite](/andrewyng/aisuite/how-artifact-storage-works-fileartifactstore-aisuite) Learn how FileArtifactStore in aisuite manages artifact storage on disk with dedicated subdirectories, metadata.json, and efficient ArtifactRef objects. - Tags: internals - Published: 2026-07-28 ### [How to Use PostgresStateStore for Persistent Agent State in aisuite](/andrewyng/aisuite/how-to-use-postgresstatestore-persistent-agent-state-aisuite) Learn to use PostgresStateStore for persistent agent state in aisuite. Connect to PostgreSQL, initialize tables, and pass the instance to your Agent for reliable state management. - Tags: how-to-guide - Published: 2026-07-28 ### [How RequireApprovalPolicy Controls Tool Execution in aisuite: A Complete Guide](/andrewyng/aisuite/how-requireapprovalpolicy-works-tool-execution-aisuite) Learn how RequireApprovalPolicy controls tool execution in aisuite. This guide explains its role in human-in-the-loop approval and automated policy enforcement before function runs. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Implement Custom Tool Policies in aisuite: A Developer’s Guide](/andrewyng/aisuite/how-to-implement-custom-tool-policies-aisuite) Learn how to implement custom tool policies in aisuite. This guide shows developers how to control LLM tool invocations with JSON policy rules for runtime enforcement. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Persist and Resume Agent Runs Using State Stores in aisuite](/andrewyng/aisuite/how-to-persist-resume-agent-runs-state-stores-aisuite) Learn how to persist and resume agent runs using state stores in aisuite. aisuite's StateStore protocol saves conversation state, enabling seamless thread resumption without context loss. - Tags: how-to-guide - Published: 2026-07-28 ### [How to Implement chat_completions_create for a New LLM Provider in AISuite](/andrewyng/aisuite/how-to-implement-chat-completions-create-new-provider) Learn how to implement chat_completions_create for new LLM providers in AISuite by extending Python and TypeScript interfaces. Integrate seamlessly with our SDK. Get started now. - Tags: how-to-guide - Published: 2026-07-28 ### [How Does the ProviderFactory Dynamically Load Providers in aisuite?](/andrewyng/aisuite/how-providerfactory-dynamically-loads-providers-aisuite) Discover how aisuite's ProviderFactory dynamically loads providers using importlib and naming conventions. Achieve plug-and-play extensibility effortlessly. - Tags: internals - Published: 2026-07-28 ### [How to Add a Custom LLM Provider to aisuite: A Complete Step-by-Step Guide](/andrewyng/aisuite/how-to-add-custom-llm-provider-to-aisuite) Learn to add a custom LLM provider to aisuite with this step-by-step guide. Integrate your own LLM by creating a Python module following specific naming conventions for seamless discovery. - Tags: how-to-guide - Published: 2026-07-28 ### [How aisuite Handles Intermediate Messages During Tool-Calling Conversations](/andrewyng/aisuite/aisuite-intermediate-messages-tool-calling) Learn how aisuite efficiently manages intermediate messages in tool calling conversations. Discover its unique approach to tracking raw outputs and utterances for robust dialogue handling. - Tags: internals - Published: 2026-07-27 ### [How to Implement Thread Continuation Across Processes Using aisuite's PostgresStateStore](/andrewyng/aisuite/aisuite-postgres-state-store-thread-continuation-processes) Learn how to implement thread continuation across processes with aisuite's PostgresStateStore. Persist agent thread state in PostgreSQL and resume conversations with exactly-once semantics. - Tags: how-to-guide - Published: 2026-07-27 ### [Limitations of Combining Streaming with max_turns in AISuite: Why They Are Mutually Exclusive](/andrewyng/aisuite/aisuite-streaming-max-turns-limitations) Discover why AISuite's streaming and max_turns parameters are mutually exclusive. Understand the limitations and avoid ValueErrors in your AI development. - Tags: deep-dive - Published: 2026-07-27 ### [How to Build a Multi-Provider Fallback Mechanism Using aisuite](/andrewyng/aisuite/build-multi-provider-fallback-aisuite) Learn to build a multi-provider fallback mechanism with aisuite. Implement a custom FallbackProvider to automatically switch to the next available LLM backend on error. - Tags: tutorial - Published: 2026-07-27 ### [How AISuite Manages Provider-Specific Parameters Through Parameter Mapping](/andrewyng/aisuite/aisuite-provider-specific-parameters-mapping) Learn how AISuite uses parameter mapping to normalize disparate ASR provider API requirements. Understand its unified schema and central mapper for seamless integration. - Tags: how-to-guide - Published: 2026-07-27 ### [FileArtifactStore vs InMemoryArtifactStore in aisuite: Storage Backend Comparison](/andrewyng/aisuite/aisuite-file-vs-inmemory-artifact-store) Compare FileArtifactStore and InMemoryArtifactStore in aisuite. Learn how disk persistence differs from in RAM speed for your storage needs. - Tags: comparison - Published: 2026-07-27 ### [How to Implement Approval Workflows for Sensitive Tool Calls in aisuite](/andrewyng/aisuite/implement-approval-workflows-sensitive-tool-calls-aisuite) Implement approval workflows for sensitive tool calls in aisuite using tool metadata flags and an ApprovalController. Ensure secure and controlled execution with a human-in-the-loop process. - Tags: how-to-guide - Published: 2026-07-27 ### [Security Implications of Using aisuite with Files, Git, and Shell Toolkits](/andrewyng/aisuite/aisuite-security-toolkits-files-git-shell) Explore aisuite security implications. Learn how it safeguards files, Git, and shell toolkits with defense-in-depth, risk categorization, and explicit approval for high-risk operations. - Tags: security - Published: 2026-07-27 ### [How aisuite Generates Tool Schemas from Python Functions: From Signatures to JSON Schema](/andrewyng/aisuite/aisuite-tool-schema-generation-python-functions) Discover how aisuite generates tool schemas from Python functions, transforming signatures and docstrings into JSON Schema for LLM integration. - Tags: how-to-guide - Published: 2026-07-27 ### [Tracing and Observability Features in aisuite: A Complete Technical Guide](/andrewyng/aisuite/aisuite-tracing-observability-features) Explore aisuite's comprehensive tracing and observability features. Understand every LLM run step, model, and tool interaction with a searchable web UI. Your technical guide awaits. - Tags: deep-dive - Published: 2026-07-27 ### [How to Add a Custom LLM Provider to aisuite Using the Adapter Pattern](/andrewyng/aisuite/add-custom-provider-aisuite-adapter-pattern) Easily add a custom LLM provider to aisuite by creating a Python module and subclassing the abstract Provider. Learn to implement chat_completions_create and use MessageConverter for seamless integration. - Tags: how-to-guide - Published: 2026-07-27 ### [AllowToolsPolicy vs DenyAllToolPolicy in aisuite: Whitelist vs Block-All Tool Security](/andrewyng/aisuite/aisuite-allowtools-vs-denyalltool-policy) Understand the core difference between AllowToolsPolicy and DenyAllToolPolicy in aisuite. Learn how to whitelist specific tools or block all tool requests for robust security. - Tags: security-comparison - Published: 2026-07-27 ### [How to Implement Tool Calling with max_turns for Multi-Turn Conversations in aisuite](/andrewyng/aisuite/aisuite-tool-calling-max-turns-multi-turn) Learn to implement tool calling with max_turns for multi-turn conversations in aisuite. Limit tool invocations using a custom ToolPolicy and RunContext. - Tags: how-to-guide - Published: 2026-07-27 ### [How aisuite Handles Message Format Conversion Between Diverse LLM Providers](/andrewyng/aisuite/aisuite-message-format-conversion-providers) Learn how aisuite simplifies LLM message format conversion. It unifies formats using an internal Message model and provider-specific converters for seamless integration. - Tags: how-to-guide - Published: 2026-07-27 ### [How to Persist and Resume Agent Runs in aisuite Using State Stores](/andrewyng/aisuite/persist-resume-agent-runs-aisuite-state-stores) Learn to persist and resume agent runs in aisuite using state stores. Save and load conversation state with Runner.run_sync and Runner.continue_sync for uninterrupted execution. - Tags: how-to-guide - Published: 2026-07-27 ### [aisuite Chat Completions API vs Agents API: Core Differences and When to Use Each](/andrewyng/aisuite/aisuite-chat-completions-vs-agents-api) Understand the core differences between aisuite Chat Completions API and Agents API. Learn where stateless wrappers meet persistent orchestration for stateful AI applications. - Tags: deep-dive - Published: 2026-07-27 ### [aisuite Async vs Sync Clients: Key Differences and When to Use Each](/andrewyng/aisuite/aisuite-async-vs-sync-clients) Explore aisuite's async vs sync clients. Understand their differences and discover when to use each to optimize your applications. Learn how aisuite ensures consistent behavior. - Tags: deep-dive - Published: 2026-07-27 ### [How to Configure MCP Servers with aisuite: A Complete Guide to Model Context Protocol Tool Calling](/andrewyng/aisuite/configure-mcp-servers-aisuite) Configure MCP servers with aisuite easily. Learn how to pass a Python dictionary to start server processes and expose tools to your LLM for seamless integration. - Tags: how-to-guide - Published: 2026-07-27 ### [How Streaming Works in aisuite Across Different LLM Providers: A Code-Level Breakdown](/andrewyng/aisuite/aisuite-streaming-across-providers) Explore the code-level breakdown of LLM streaming in aisuite. Learn how it unifies provider streams into a standard ChatCompletionChunk object for seamless integration. - Tags: devops - Published: 2026-07-27 ### [AISuite State Store Architecture: InMemory, File, and Postgres Implementation Guide](/andrewyng/aisuite/aisuite-state-store-architecture-inmemory-file-postgres) Explore AISuite's flexible State Store architecture. Learn about InMemory, File, and Postgres implementations for efficient agent run persistence and easy backend switching. - Tags: architecture - Published: 2026-07-27 ### [How to Implement Custom Tool Policies for Agent Tool Execution Control in aisuite](/andrewyng/aisuite/implement-custom-tool-policies-agent-execution-control) Learn to control agent tool execution in aisuite with custom Tool Policies. Implement the evaluate method to decide which tool calls to execute, deny, or approve. - Tags: how-to-guide - Published: 2026-07-27 ### [How aisuite's Provider Factory Pattern Works for Adding New LLM Providers](/andrewyng/aisuite/how-aisuite-provider-factory-pattern-add-llm-providers) Learn how aisuite's provider factory pattern simplifies adding new LLM providers. Discover centralized instantiation and automatic request routing enabling seamless integration. - Tags: internals - Published: 2026-07-27 ### [How to Use PostgresStateStore for Scalable Agent State in aisuite](/andrewyng/aisuite/how-to-use-postgresstatestore-for-scalable-state-in-aisuite) Learn how to leverage PostgresStateStore for scalable agent state in aisuite. Achieve transactional persistence and optimistic concurrency control for high-throughput agent threads. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Use FileStateStore for Persistent State in aisuite](/andrewyng/aisuite/how-to-use-filestorestore-for-persistent-state-in-aisuite) Learn how to leverage FileStateStore in aisuite to maintain persistent agent state across sessions. Easily save and load your agent's progress with this straightforward guide. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Restrict Shell Commands in the aisuite Shell Toolkit](/andrewyng/aisuite/how-to-restrict-shell-commands-in-aisuite-shell-toolkit) Learn to restrict shell commands in the aisuite Shell Toolkit using allowed_commands, allow_all, and allow_shell parameters. Secure your system by whitelisting binaries and blocking dangerous operators. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Use the Shell Toolkit in AISuite for Safe Command Execution](/andrewyng/aisuite/how-to-use-the-shell-toolkit-in-aisuite) Safely execute OS commands with the AISuite shell toolkit. Learn how to leverage whitelisting and restrictions for secure command execution. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Use the Git Toolkit in aisuite: A Complete Guide for AI Agents](/andrewyng/aisuite/how-to-use-the-git-toolkit-in-aisuite) Learn to use the Git Toolkit in aisuite with this guide. Enable AI agents to inspect Git status and view code changes using read-only operations. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Use the File Toolkit in aisuite: A Complete Guide to Filesystem Tools](/andrewyng/aisuite/how-to-use-the-file-toolkit-in-aisuite) Master the aisuite file toolkit for filesystem operations. Learn to read, list, search, and modify files efficiently with this comprehensive guide. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Use Built-In Toolkits in AISuite: Shell, Git, and File Operations](/andrewyng/aisuite/how-to-use-built-in-toolkits-in-aisuite) Learn how to use built-in toolkits in AISuite including Shell Git and File operations. Integrate system capabilities into your agents for enhanced functionality. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Build Autonomous Agents with the aisuite Agents API](/andrewyng/aisuite/how-to-build-autonomous-agents-with-aisuite-agents-api) Learn to build autonomous agents using the aisuite Agents API. Instantiating the Agent dataclass with models, instructions, and tools enables powerful agent creation. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Get Tool Invocation Requests from an aisuite Response](/andrewyng/aisuite/how-to-get-tool-invocation-requests-from-aisuite-response) Learn how to get tool invocation requests from an aisuite response. Extract tool call names and arguments or use max_turns for automatic resolution. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Handle Tool Calls with aisuite: A Complete Guide to Tool Registration and Execution](/andrewyng/aisuite/how-to-handle-tool-calls-with-aisuite) Learn to handle tool calls with aisuite. This guide covers registering Python functions as LLM tools, exporting specs, and executing calls with validation and tracing. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Format Messages for aisuite Chat Completions API](/andrewyng/aisuite/how-to-format-messages-for-aisuite-chat-completions-api) Learn how to format messages for the aisuite Chat Completions API. Understand the role, content, and tool call fields for effective API integration and efficient communication. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Switch LLM Providers in aisuite: A Complete Guide](/andrewyng/aisuite/how-to-switch-llm-providers-in-aisuite) Easily switch LLM providers in aisuite by updating the model identifier and client configuration. Follow this guide for a seamless transition. - Tags: how-to-guide - Published: 2026-06-16 ### [How to Implement Custom Artifact Stores for Agent Outputs in aisuite](/andrewyng/aisuite/how-to-implement-custom-artifact-stores-for-agent-outputs) Learn how to implement custom artifact stores for agent outputs in aisuite. Create artifact store classes to manage large outputs, improving LLM context efficiency. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Handle Streaming Transcription Responses in aisuite](/andrewyng/aisuite/handling-streaming-transcription-responses) Learn to handle streaming transcription responses in aisuite. Process partial transcripts from OpenAI, Google, or Deepgram with a unified async generator. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Use ToolPolicyContext for Policy Decisions in AISuite](/andrewyng/aisuite/utilizing-tool-policy-context-for-policy-decisions) Safely manage tool policy decisions in AISuite. Learn how ToolPolicyContext exposes tool details to allow or deny operations, ensuring robust agent behavior. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Convert MCP Config Dicts to Callable Tools in aisuite](/andrewyng/aisuite/how-to-convert-mcp-config-dicts-to-callable-tools) Learn how to convert MCP config dicts to callable tools in aisuite using a validation-client-wrapper pipeline. Easily integrate with the aisuite chat completion API. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Implement Thread-Safe Provider Initialization in aisuite](/andrewyng/aisuite/implementing-thread-safe-provider-initialization) Learn how to implement thread-safe provider initialization in aisuite. Prevent race conditions with double-checked locking and RLock for robust LLM provider creation. - Tags: how-to-guide - Published: 2026-06-15 ### [Provider Discovery and Loading Mechanism in aisuite's ProviderFactory](/andrewyng/aisuite/provider-discovery-and-loading-mechanism-in-providerfactory) Explore aisuite's ProviderFactory for dynamic LLM provider discovery and loading. Learn how it uses importlib and naming conventions to easily add new providers without code changes. - Tags: internals - Published: 2026-06-15 ### [How to Use intermediate_messages for Conversation Continuity in aisuite](/andrewyng/aisuite/how-to-use-intermediate-messages-for-conversation-continuity) Learn how to use intermediate_messages in aisuite to maintain conversation continuity. Automatically accumulate message history and prepend it to subsequent requests for seamless multi-turn tool execution. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Configure the Runner for Agent Execution in AISuite: A Complete Guide](/andrewyng/aisuite/configuring-the-runner-for-agent-execution) Master AISuite agent execution by configuring the Runner. Learn how to set max turns, state store, and tool policy for robust multi-turn tool loops and persistent conversations. - Tags: how-to-guide - Published: 2026-06-15 ### [Troubleshooting Tool Execution Errors and Timeouts in aisuite: A Complete Guide](/andrewyng/aisuite/troubleshooting-tool-execution-errors-and-timeouts) Troubleshoot aisuite tool execution errors and timeouts. Learn how MCPToolWrapper MCPClient and LocalExecutor handle errors for efficient problem solving. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Use the Audio Transcription API Across Different Providers in aisuite](/andrewyng/aisuite/how-to-use-audio-transcription-api-across-providers) Transcribe audio using the aisuite API with OpenAI, Deepgram, or Google. Integrate seamlessly with automatic parameter translation and consistent results. - Tags: how-to-guide - Published: 2026-06-15 ### [Implementing Allow and Deny Tool Policies in aisuite: A Complete Security Guide](/andrewyng/aisuite/implementing-allow-deny-tool-policies) Master aisuite tool policies: Securely control LLM function access with allow/deny lists and approval workflows. A comprehensive guide for robust AI security. - Tags: how-to-guide - Published: 2026-06-15 ### [How aisuite Extracts Thinking and Reasoning Content from LLM Responses](/andrewyng/aisuite/how-aisuite-handles-thinking-reasoning-content-extraction) Discover how aisuite extracts thinking and reasoning content from LLM responses by parsing structured tags, isolating chain-of-thought into a dedicated field for clear analysis. - Tags: how-to-guide - Published: 2026-06-15 ### [Using Artifact Stores to Save Agent Outputs with aisuite: A Complete Guide](/andrewyng/aisuite/using-artifact-stores-to-save-agent-outputs) Learn how to save large agent outputs with aisuite using artifact stores. This guide shows you how to configure InMemoryArtifactStore or FileArtifactStore for efficient data management. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Implement Custom State Stores in aisuite: Extending Beyond Built-In Options](/andrewyng/aisuite/how-to-implement-custom-state-stores-beyond-built-in-options) Learn to implement custom state stores in aisuite. Create a StateStore class with save load and delete methods for persistent agent conversations. Extend beyond built-in options. - Tags: how-to-guide - Published: 2026-06-15 ### [Handling Provider-Specific Parameters with extra_param_mode in aisuite](/andrewyng/aisuite/handling-provider-specific-parameters-with-extra-param-mode) Master extra_param_mode in aisuite to expertly manage provider-specific transcription parameters. Learn strict, warn, and permissive modes for better control and error handling. - Tags: how-to-guide - Published: 2026-06-15 ### [Using aisuite Agents API Toolkits: Files, Git, and Shell Integration](/andrewyng/aisuite/using-toolkits-files-git-shell-with-aisuite-agents-api) Learn to integrate files, git, and shell toolkits with the aisuite Agents API for real-world LLM operations. Explore the power of schema-validated tools. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Implement Custom Trace Sinks for Observability in aisuite](/andrewyng/aisuite/how-to-implement-custom-trace-sinks-for-observability) Learn to implement custom trace sinks in aisuite. Capture agent runs, model calls, and tool invocations by registering your own emit method with ai.tracing.configure and enhance your observability. - Tags: how-to-guide - Published: 2026-06-15 ### [Understanding the max_turns Parameter for Automatic Tool Execution in aisuite](/andrewyng/aisuite/understanding-max-turns-parameter-for-automatic-tool-execution) Learn how the max_turns parameter in aisuite automates tool execution. Understand its iterative loop for LLM calls and tool handling to reach your specified limits. - Tags: deep-dive - Published: 2026-06-15 ### [How to Configure Multiple Provider API Keys in the aisuite Client](/andrewyng/aisuite/how-to-configure-multiple-provider-api-keys-in-aisuite-client) Effortlessly configure multiple provider API keys in the aisuite Client. Learn how to map provider names to API keys for seamless service initialization. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Add a New Provider to AISuite Using the Provider Interface](/andrewyng/aisuite/steps-to-add-new-provider-to-aisuite-using-provider-interface) Learn how to add a new provider to AISuite by subclassing the Provider base class implementing chat_completion_create and registering it in the ProviderFactory._registry. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Persist and Resume Agent State with State Stores in aisuite](/andrewyng/aisuite/how-to-persist-and-resume-agent-state-with-state-stores) Learn to persist and resume agent state in aisuite using State Stores. Easily save and load conversation history to continue agent execution seamlessly. - Tags: how-to-guide - Published: 2026-06-15 ### [How to Use MCP (Model Context Protocol) Servers with aisuite](/andrewyng/aisuite/guide-to-using-mcp-model-context-protocol-servers-with-aisuite) Learn how to integrate MCP servers with aisuite to extend LLM capabilities. This guide covers using MCPClient for standardized JSON-RPC protocols to enhance your AI applications. - Tags: how-to-guide - Published: 2026-06-15 ### [How aisuite Handles Parameter Mapping Across Different LLM Providers](/andrewyng/aisuite/how-aisuite-handles-parameter-mapping-across-different-llm-providers) Discover how aisuite simplifies LLM integration by mapping parameters across providers like OpenAI, Deepgram, and Google Speech-to-Text with its ParameterMapper. Streamline your development. - Tags: internals - Published: 2026-06-15 ### [How to Implement Custom Tool Policies in aisuite for Approval Workflows](/andrewyng/aisuite/how-to-implement-custom-tool-policies-in-aisuite-for-approval-workflows) Learn to implement custom tool policies in aisuite for approval workflows. Control tool execution with custom logic before LLM provider execution. Enhance your LLM applications today. - Tags: how-to-guide - Published: 2026-06-15