poly_data
Polymarket Data Retriever that fetches, processes, and structures Polymarket data including markets, order events and trades.
Learn to load and analyze trade data with Poly Data. This Python pipeline processes Polymarket events into normalized CSVs for quantitative analysis using Polars.
How Poly Data Retries on Network Failures: A Deep Dive into the Resilience StrategyDiscover how Poly Data ensures resilience against network failures. Learn about its multi-layered retry strategies for HTTP and GraphQL errors.
Where Missing Markets Are Stored in Poly Data: Complete File Location GuideLocate missing markets in Poly Data. Find and manage `missing_markets.csv` with our guide to Poly Data file locations and essential utility functions.
How Poly Data Handles Missing Markets: A Complete Technical GuideLearn how Poly Data handles missing markets using a supplemental CSV and Python functions to automatically detect, fetch, and persist market data for comprehensive analysis.
How Price Is Calculated in Poly Data Trades: A Deep Dive into the Live-Trade ProcessorDiscover how Poly Data calculates trade prices by dividing USDC-filled amounts by non-USDC token amounts. Learn the live-trade processor's logic for ratio direction.
How Trade Direction Is Determined in Poly Data: A Code‑Level AnalysisDiscover how Poly Data determines trade direction. Understand which side holds USDC to identify buyers and sellers with this code-level analysis.
How Poly Data Identifies USDC in Trades: A Technical Deep DiveLearn how Poly Data identifies USDC in trades by treating asset ID 0 as USDC and using Polars conditional expressions for accurate labeling.
How Asset IDs Are Mapped to Markets in Poly DataDiscover how Poly Data maps asset IDs to markets using token identifiers in CSV files and a long lookup table for efficient market data retrieval. Learn the process now.
How Poly Data Achieves Idempotent Data Collection: CSV Offsets and Cursor StateDiscover how Poly Data ensures idempotent data collection using CSV offsets and cursor state. Learn about offset based resumption and JSON cursor files for reliable event streaming and deduplication.
How Poly Data Ensures Pipeline Resumability: A Technical Deep DivePoly Data ensures pipeline resumability by detecting last written records using line counts, cursor files, and timestamps. Restart your process seamlessly from the exact point of failure.
How Are Amounts Normalized in Poly Data Trades: A Complete Technical GuideLearn how Poly Data normalizes trade amounts by dividing raw on-chain integer values by 10⁶ in update_utils/process_live.py converting them to human-readable decimals.
Fields in processed/trades.csv: Complete Schema Reference for Polymarket Trade DataUnderstand the complete schema reference for processed/trades.csv in the poly_data repository. Explore market ID, addresses, trade flags, price, token amounts, and transaction hash.
Have a question about this repo?
These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:
curl -s "https://instagit.com/install.md" Maintain an open-source project? Get it listed too →