Langfuse is an open-source LLM engineering platform that provides observability, tracing, evaluations, a prompt management system, a playground, and metrics to debug and improve LLM apps. It works with any model or framework by exporting all data and automatically running evaluations against new incoming traces. Moreover, cost, latency, and quality dashboards are offered by Langfuse, where versioning and deployment of prompts are also allowed. In addition to this, the GET API is opened along with CSV and JSON exports for downstream use cases.
