Sure, Langsmith is awesome.

But have you considered these open source alternatives?

They are free, self-hostable and community-driven.

Check by yourself: Langfuse  Langfuse ,  Latitude LLM .

  1. So is Langfuse Langfuse

    Open source LLM engineering platform

    ★ 17.2K AI LLM Monitoring Observability License: MIT Expat

    Langfuse is an open source LLM engineering platform. It helps teams collaboratively develop, monitor, evaluate, and debug AI applications. Langfuse can be self-hosted in minutes and is battle-tested.

    preview

  2. So is Latitude LLM

    Open-source prompt engineering platform to build, evaluate, and refine AI prompts

    ★ 3.4K AI LLM License: LGPL-3.0

    Latitude is an open-source platform for AI prompt engineering, deployment, and evaluation. It helps teams build, test, and maintain reliable AI applications by providing a complete lifecycle management system for prompts.

    The Open-Source Prompt Engineering Platform for building, evaluating, and refining AI prompts with comprehensive tooling.

    Latitude Screenshot