Synth AI OSS

Tools to run evals, trace LLM calls, and fine‑tune open models using a simple Python/CLI toolkit.

Install

pip install synth-ai

Try it quickly

  • Check your balance (prod backend):
uvx —from synth-ai synth-ai balance —api-key $SYNTH_API_KEY
- Start local services (tracing DB + env service):
```bash
uvx --from synth-ai synth-ai serve --force

What you can do

  • Run model comparisons and export datasets
  • Generate traces, filter them, and run supervised fine‑tuning
  • Inspect every LLM/tool call with structured tracing

API

  • HTTP endpoints (inference, files, SFT, models, balance):

Contribute

Open source under MIT. PRs welcome for docs, environments, and tools.