colibri
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
Set up your Colibri development environment on macOS quickly. Install dependencies, clone the JustVugg/colibri repo, and compile for CPU and Metal GPU in minutes.
Versioning Strategies for Colibri: A Layered Approach to Multi-Component CompatibilityDiscover Colibri's versioning strategies for multi-component compatibility. Explore layered approaches to ensure backward compatibility across C engine, Python CLI, and model containers.
How to Handle Asynchronous Tasks in Colibri: Streaming Completions and CancellationLearn to manage asynchronous tasks in Colibri by implementing streaming completions and cancellation. Discover how Colibri uses Server-Sent Events and AbortController for efficient handling.
What Kind of Background Jobs Does Colibri Support?Discover Colibri's background job support including Windows Job Objects for process management and a Background I/O Loader Pool for efficient MoE shard loading during inference.
How to Monitor Colibri Performance: Real-Time Telemetry and Metrics GuideMonitor Colibri performance with real-time telemetry and metrics. Learn how to track latency, throughput, and GPU utilization using its API and server logs.
CI/CD Pipeline for Colibri: Complete Guide to Automated Builds and Multi-Platform TestingExplore the Colibri CI CD pipeline Automate builds and multi-platform testing across Linux macOS Windows and ARM64 for every push or pull request.
Best Practices for Developing with Colibri: A Complete Guide to ContributingMaster Colibri development with best practices. Preserve CPU path, use dev branch, and run make check for stable contributions. Your complete guide to collaborating on the JustVugg/colibri repo.
How to Integrate Colibri with Other Services: OpenAI-Compatible API GuideEasily integrate Colibri with other services using its OpenAI-compatible API. Connect any OpenAI client by redirecting the base URL to your Colibri instance for seamless integration.
Security Considerations for Colibri Development: Hardening the HTTP API and Desktop UILearn essential Colibri development security considerations including API hardening, authentication, host validation, CORS, and rate limiting to protect against attacks.
How to Debug Colibri Applications: Engine, CLI, and UI TechniquesDebug Colibri applications using environment variables for the C inference engine, stderr monitoring via the CLI, and React Profiling for per-turn timings. Enhance your debugging workflow.
Logging Mechanisms in Colibri: A Deep Dive into Python Standard Library ImplementationExplore Colibri's logging mechanisms, leveraging Python's standard logging module and custom wrappers. Understand how Colibri captures diagnostic data and progress.
How to Handle Configuration in Colibri: A Complete Guide to Model JSON SetupMaster Colibri configuration with our complete guide to model JSON setup. Learn to handle mandatory and optional config files for secure, efficient model loading.
Have a question about this repo?
These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:
curl -s "https://instagit.com/install.md" 
Maintain an open-source project? Get it listed too →