freellmapi

OpenAI-compatible proxy that stacks the free tiers of 16 LLM providers (~1.7B tokens/month) behind one /v1 endpoint — plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

339 articles 11.5k View on GitHub ↗
339 articles
How FreeLLMAPI Handles Vision Input for Multimodal LLMs: A Deep Dive into the Routing Pipeline

Discover how FreeLLMAPI processes vision input for multimodal LLMs. Learn about the routing pipeline, image payload detection, and model validation for seamless integration.

deep-dive
Sep 4, 2026
What Is the Fusion Model in FreeLLMAPI? A Deep Dive into Multi-Model Synthesis

Explore the Fusion model in FreeLLMAPI, a powerful virtual model synthesizing outputs from multiple LLMs into one coherent response. Learn how it works.

deep-dive
Sep 4, 2026
How to Use FreeLLMAPI with Ollama Clients: Complete Integration Guide

Integrate FreeLLMAPI with Ollama clients effortlessly. This guide shows how to connect any Ollama-compatible client to FreeLLMAPI for smart provider fallback and native endpoint access.

how-to-guide
Sep 4, 2026
FreeLLMAPI Anthropic Messages API Support: Complete Implementation Guide

Explore the FreeLLMAPI Anthropic Messages API implementation guide. Discover full support for completions, token counting, and tool use. Integrate seamlessly with our dedicated handler.

how-to-guide
Sep 4, 2026
How to Use Custom Provider Chains with FreeLLMAPI

Learn how to use custom provider chains with FreeLLMAPI by leveraging named fallback profiles. Discover the auto:<chain-name> syntax for flexible model integration.

how-to-guide
Sep 4, 2026
How FreeLLMAPI Routing Strategies Work: A Complete Guide to Model Selection

Explore FreeLLMAPI routing strategies. Learn how balanced, priority, and other methods use weight vectors on reliability, speed, and intelligence scores to select the best LLM for your request.

deep-dive
Sep 4, 2026
How FreeLLMAPI Calculates Reliability, Speed, and Capability Scores for Model Routing

FreeLLMAPI calculates reliability speed and capability scores for model routing using Bayesian methods throughput and intelligence weights Discover how these scores optimize your LLM routing

deep-dive
Sep 4, 2026
FreeLLMAPI SQLite Database Schema: Key Tables and Structure Explained

Explore the FreeLLMAPI SQLite database schema, detailing key tables for models, auth, and observability. Understand its organized structure defined in TypeScript migrations.

api-reference
Sep 4, 2026
How FreeLLMAPI Syncs Its Model Catalog: Cryptographic Verification and Three-Phase Architecture

Discover how FreeLLMAPI syncs its model catalog using cryptographic verification and a robust three-phase architecture for reliable updates. Learn more.

architecture
Sep 4, 2026
How FreeLLMAPI Handles Provider Quota Exhaustion: Architecture and Implementation

Learn how FreeLLMAPI prevents service disruption by extracting quota signals, persisting them, and routing traffic away from exhausted keys using a headroom-based algorithm.

architecture
Sep 4, 2026
How Provider API Keys Are Encrypted and Stored in FreeLLMAPI

Discover how FreeLLMAPI encrypts provider API keys using AES-256-GCM. Learn about secure storage methods in the SQLite database and master key protection.

internals
Sep 4, 2026
How the Health Service in FreeLLMAPI Monitors Provider Status: Architecture and Implementation

Discover how the FreeLLMAPI Health Service monitors LLM provider status. Learn about its architecture and implementation of scheduled health passes for automatic validation and key disabling.

architecture
Sep 4, 2026
…

Have a question about this repo?

These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:

Share the following with your agent to get started:
curl -s "https://instagit.com/install.md"
Works with
Claude Codex Cursor VS Code OpenClaw Any MCP Client

Maintain an open-source project? Get it listed too →