marin

Open-source framework for the research and development of foundation models.

112 articles 2.5k View on GitHub ↗
112 articles
How to Perform Text Deduplication with Marin-dupekit: 3 Methods Explained

Learn to perform text deduplication with Marin-dupekit. Discover three distributed modes Exact Paragraph Exact Document and Fuzzy Document for petabyte-scale corpora using the Zephyr execution engine.

how-to-guide
Sep 10, 2026
What Is the Marin‑Ducky Service? A DuckDB‑Powered SQL Dashboard for Cloud Storage

Explore the Marin-Ducky service a DuckDB-powered SQL dashboard for querying data in Google Cloud Storage and other object stores. Run ad-hoc SQL queries easily.

getting-started
Sep 10, 2026
How to Deploy Models with Marin-Deploy: A Complete Guide to ML Model Serving

Deploy ML models effortlessly with Marin-Deploy. This guide shows how to use its command-line interface for seamless deployment to Kubernetes and cloud platforms.

how-to-guide
Sep 10, 2026
What Is the Purpose of Marin-core? A Deep Dive into the Foundation of the Marin Ecosystem

Discover the purpose of Marin-core, the foundational data layer for the Marin ecosystem. It standardizes data for question-answer examples and conversation logs, ensuring smooth data flow across pipelines.

deep-dive
Sep 10, 2026
How Marin Ensures Training Mixture Reproducibility: A Two‑Phase Pipeline

Marin ensures training mixture reproducibility with a two phase pipeline. Discover how it guarantees identical logical mixtures for consistent results.

internals
Sep 10, 2026
Where to Find Delphi Checkpoints on Hugging Face: A Complete Guide

Easily find Delphi checkpoints on Hugging Face. Discover specific model identifiers in the Marin repository for your NLP projects.

how-to-guide
Sep 10, 2026
Delphi: Marin’s Open Scaling Suite for Systematic LLM Training

Discover Delphi, Marin's open scaling suite for systematic LLM training. Automate reproducible pipelines from 3×10¹⁸ to 10²³ FLOPs with a learned scaling law.

deep-dive
Sep 10, 2026
How Marin Handles Text Deduplication: Exact, Paragraph, and Fuzzy Matching Explained

Discover how Marin handles text deduplication with exact paragraph, exact document, and fuzzy matching. Learn about its powerful Zephyr engine and MinHash algorithms.

deep-dive
Sep 10, 2026
How Marin Curates Raw Source Data

Learn how Marin curates raw source data through a deterministic download transform normalize pipeline. Ensure reproducibility and traceability with Datakit and StepSpec.

how-to-guide
Sep 10, 2026
Haliax for Named Array Programming in JAX: A Complete Guide

Discover Haliax for named array programming in JAX. Replace positional dimensions with named axes to eliminate shape mismatch bugs and write self-documenting code.

deep-dive
Sep 10, 2026
How Marin-Fray Provides a Distributed Execution Substrate

Marin-Fray provides a distributed execution substrate by unifying Iris job orchestration. Learn how it translates specifications, supports actor hosting, coscheduling, and dynamic discovery.

architecture
Sep 10, 2026
Marin-Zephyr Pipeline Stages: A Complete Guide to the 8 Core Stage Types

Explore the 8 core Marin-Zephyr pipeline stages: MAP, FILTER, FLATMAP, REDUCE, GROUP_BY, SORTED_MERGE_JOIN, WRITE, and CUSTOM. Understand how ZephyrCoordinator orchestrates these steps.

how-to-guide
Sep 10, 2026
…

Have a question about this repo?

These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:

Share the following with your agent to get started:
curl -s "https://instagit.com/install.md"
Works with
Claude Codex Cursor VS Code OpenClaw Any MCP Client

Maintain an open-source project? Get it listed too →