Open source alternatives to LangSmith

One project on starwire does the same job. Ranked by how much of what LangSmith does each one covers, read from its README and website. Ties go to the most active.

What LangSmith does

Tracing for LLM and agent callscore
Evaluations and datasetscore
Prompt playground and management
Monitoring dashboards
Human feedback and annotation
LangChain integration

Each dot in the table is one job, in this order. Square dots are core jobs and count double. Full means yes, half means partly. "See the evidence" under a project shows the line behind each one. Coverage is what a project documents, not how well it works or how hard it is to move to. How we score this

Project	Covers	Stars	Commits, 12 weeks	Last release	Closed vs opened	Setup	License
future-agiSelf-hostable platform for tracing, evaluating and guarding LLM and agent apps	Replaces it75%	2.3k+22	4,408	11 days ago	68%	Hosted, free plan	Apache-2.0
Covers all 2 core jobs. Partly: Prompt playground and management; LangChain integration. Not shown: Human feedback and annotation.See the evidence Tracing for LLM and agent callscoreYesOpenTelemetry-native traces. Evaluations and datasetscoreYesTracing · Evals · Simulations · Datasets Prompt playground and managementPartlyevery prompt, every trace is inspectable Monitoring dashboardsYesTracing Dashboards Alerting Command Center Human feedback and annotationNot shownNeither the README nor the website mentions it. LangChain integrationPartly50+ framework instrumentors.

Vital signs from GitHub, checked weekly. How we read these · How setup is read

All repos

Sort

Form Platform Works with Theme License Setup Language

New repos every two days, stars refreshed daily. Visits are counted without cookies, and the numbers are public. How it works Data RSS Newsletter