FreeAgent SDK v0.2

2 is a Python software development kit designed to facilitate the creation of local AI agents that interact with models hosted on Ollama, vLLM, and OpenAI-compatible servers. The SDK provides foundational components for building agent workflows, emphasizing efficient handling of multi-turn conversations, streaming responses, and tool integration. It is intended for developers seeking a streamlined, tested framework for agent development on local models.

Key features of FreeAgent SDK include token-by-token streaming with semantic events, allowing agents to process and emit responses in real time. The SDK supports multi-turn conversations by default, with pluggable strategies such as sliding window, token window, and unlimited history for context management. Memory functionality is enabled out of the box, using Markdown files for persistent storage, and includes daily logs and session persistence across process restarts. md files, with bundled defaults and the ability to override or add user-defined skills. The platform also provides an auto-tuning mechanism that queries model endpoints to optimize parameters per model, with the option to disable this feature.

The SDK offers a command-line interface for interacting with agents, including commands for one-shot queries, interactive chat sessions, model listing, version display, and tracing of agent runs. Its tracing API exposes detailed logs of model calls, tool invocations, retries, and validation events with relative timestamps, supporting debugging and transparency in agent behavior. FreeAgent SDK is compatible with multiple providers, including Ollama, vLLM, and OpenAI-compatible backends such as LM Studio, LocalAI, and TGI. A provider protocol allows for the addition of new backends with minimal code changes. The SDK also supports integration with MCP servers via standard input/output or HTTP, with automatic tool schema conversion and description truncation for small models.

Installation is available via pip, and the SDK is released under the MIT license. It is structured as a single-dependency package (using httpx), with extensive unit tests and measured performance overhead. FreeAgent SDK positions itself as a practical, minimal layer for agent development, focusing on reliability and developer control rather than imposing complex frameworks.