Overview

Synth makes building and maintaining state-of-the-art AI agents and software simpler by logging what your agent is doing, identifying where it’s coming up short, and updating your agent to avoid those failures.

To use the platform, you’ll need to log your agent’s data via our SDK. Presently, we have a few simple decorators and support for OpenAI and Anthropic clients to make integration straightforward.

Quick Start

Check out our Craftax Demo for a complete example of:

  1. Installing and configuring the SDK
  2. Building an AI agent with automatic tracing
  3. Collecting execution data and metrics
  4. Analyzing agent performance with Synth

The demo shows how to evaluate an LLM agent playing a Minecraft-inspired game, demonstrating key SDK features and best practices. You can also run the code in Colab Here