ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

46 articles 5.2k View on GitHub ↗
46 articles
How to Use ODS with NVIDIA GPUs: Automatic Detection and Configuration Guide

Learn how to use ODS with NVIDIA GPUs. ODS automatically detects and configures Docker GPU passthrough for seamless integration. Get started today.

how-to-guide
Sep 2, 2026
How to Use ODS with AMD GPUs: Automated ROCm Setup and Configuration Guide

Easily use ODS with AMD GPUs. Our guide automates ROCm setup and configuration, simplifying GPU device node management for Docker containers. Get started now!

how-to-guide
Sep 2, 2026
What Models Are Available for Each ODS Tier? Complete LLM Hardware Mapping

Discover which LLM models map to each ODS tier from cloud APIs to local GGUF. Find the perfect quantized LLM for your hardware setup and explore the official tier mappings.

api-reference
Sep 2, 2026
How ODS Maps Hardware Capabilities to Deployment Tiers: A Technical Deep Dive

Learn how ODS maps hardware capabilities to deployment tiers with its two-step pipeline. Discover how GPU analysis sets environment variables for LLM model selection and context limits.

deep-dive
Sep 2, 2026
How ODS Performs GPU Detection on Linux and macOS: A Deep Dive into the Source Code

Discover how ODS performs GPU detection on Linux and macOS by examining Bash scripts, sysfs, and sysctl data. Learn about the source code and fallback mechanisms for hardware detection.

deep-dive
Sep 2, 2026
How ODS Handles Errors and Interrupts During Installation: A Complete Technical Guide

Learn how ODS handles errors and interrupts during installation. Discover its robust error handling with strict Bash settings, custom traps, and phase-aware cleanup for deterministic failure states.

how-to-guide
Sep 2, 2026
How ODS Installation Phases Are Executed: Sequential Orchestration in Osmantic/ODS

Discover how ODS installation phases are executed sequentially. Learn about the orchestration process in Osmantic/ODS and ensure successful deployments.

internals
Sep 2, 2026
Understanding the File Header Convention in ODS Installer Modules

Learn the ODS installer module file header convention. Discover the three-section format Purpose, Expects, and Provides for clear script intent, environment variables, and exported outputs.

how-to-guide
Sep 2, 2026
How the ODS Installer Library (installers/lib) Works: Architecture and Deep Dive

Explore the ODS installer library architecture and deep dive into how installers/lib handles hardware detection, tier-to-model mapping, and package abstraction for intelligent deployments.

architecture
Sep 2, 2026
Understanding the ODS Installer Directory Structure: A Complete Guide

Explore the ODS installer directory structure. Learn about the core orchestrator, reusable libraries, and sequential installation phases in this comprehensive guide.

how-to-guide
Sep 2, 2026
How to Configure ODS for Cloud APIs and Local LLM Servers

Configure ODS to use cloud APIs or local LLM servers by setting ODS_MODE and LLM_BACKEND in your .env file. Rerun the installer to update your Docker Compose stack.

how-to-guide
Sep 1, 2026
Understanding the ODS Service Communication Flow: A Complete Architecture Guide

Discover the ODS service communication flow. Learn how ODS routes traffic through localhost containers for seamless UI, LLM, and service interaction within its Docker Compose architecture.

architecture
Sep 1, 2026

Have a question about this repo?

These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:

Share the following with your agent to get started:
curl -s "https://instagit.com/install.md"
Works with
Claude Codex Cursor VS Code OpenClaw Any MCP Client

Maintain an open-source project? Get it listed too →