sia
SIA is a Self Improving AI framework to autonomously improve the performance of any AI system (Model / Agent) on a benchmark task.
Discover how SIA's context.md tracks agent generation history, performance metrics, and code improvement rationale. Learn about the ContextManager class.
How to Use the SIA Web Dashboard to Visualize Run ResultsLearn to visualize SIA run results using the interactive web dashboard. Track agent evolution and explore historical data effortlessly. Start the dashboard with 'sia web'.
How to Create Custom Tasks in SIA: Required Directory Structure GuideLearn to create custom tasks in SIA by following the required directory structure. Organize your files with data public, data private, and reference subdirectories, plus task.md and optional evaluate.py.
How to Write and Integrate Custom evaluate.py Scripts for Task Evaluation in SIALearn to write and integrate custom evaluate.py scripts for task evaluation in SIA. Compute metrics and output results.json for seamless integration before exiting with status 0.
Have a question about this repo?
These articles cover the highlights, but your codebase questions are specific. Give your agent direct access to the source. Share this with your agent to get started:
curl -s "https://instagit.com/install.md" Maintain an open-source project? Get it listed too →