needle
14MB foundation model for tiny devices; phones, wearables, smart home, and robots.
Discover Needle training hardware requirements. Learn how to enable GPU and Apple Silicon support by installing optional JAX dependencies for accelerated training.
Needle Finetune Command-Line Options: Complete Guide to LoRA TrainingMaster needle finetune for LoRA training. Explore 15+ command-line options for model selection, hyperparameters, LoRA architecture, data, and quantization. Optimize your training today.
How to Synthesize Training Data for Needle Fine‑Tuning Using the `generate-data` CLI CommandLearn how to synthesize training data for Needle fine-tuning with the needle generate-data CLI command. Easily create JSON-L records for your workflows via OpenRouter API.
How to Fine-Tune Needle with LoRA Using JSONL Data FormatLearn to fine-tune Needle with LoRA using JSONL data. Follow simple steps to prepare your data and train a low-rank adapter efficiently. Get started now!
Needle System Facts: How to Control Agent Behavior with Custom DirectivesLearn how Needle system facts control LLM agent behavior. Understand how to use custom directives to shape output, enforce rules, and manage confidence gating for better results.
How to Persist Tool Embeddings for Fast Reloads with Large Tool Catalogues in NeedleSpeed up tool embedding reloads in Needle with large catalogues. Persist embeddings to disk for instant loading and faster inference. Learn how with Cactus Compute.
Confidence Scores for Fine-Tuned Weights in Needle: Calibration Note ExplainedLearn why Needle disables confidence scores for fine-tuned weights. Understand the calibration note and its impact on LoRA models. Get clear insights for your ML projects.
How Needle 2 Generates Confidence Scores and How to Use Them in Your ApplicationsDiscover how Needle 2 generates confidence scores using a ConfidenceHead on hidden states. Learn to integrate this score into your applications for response correctness estimates.
How to Define Tools Using Manual JSON Schema for the Needle AgentLearn to define custom JSON schemas for the Needle agent by assigning a JSON schema to function._needle_tool. Control validation, enums, and descriptions for your tools.
How to Apply Per-Argument Constraints to Tool Parameters Using `needle.Field`Learn to apply per-argument constraints to tool parameters with needle.Field and typing.Annotated. Inject JSON-Schema validation rules directly into your tool's parameter schema for robust input handling.
How to Define a Tool Using the Decorator Pattern in NeedleLearn how to define a tool using the decorator pattern in Needle. Effortlessly convert Python functions into LLM-callable tools with automatic JSON schema generation.
How to Reset the Conversation Context of a Needle Agent: A Complete GuideReset Needle agent conversation context with agent.reset(). Clear the sliding window and start fresh conversations in cactus-compute/needle. Full guide included.
Have a question about this repo?
These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:
curl -s "https://instagit.com/install.md" 
Maintain an open-source project? Get it listed too →