Langtrace is an open-source observability tool that collects and analyze traces in order to help you improve your LLM apps. Langtrace has two components:
SDK: The SDK is a lightweight library that can be installed and imported into your project in order to collect traces. The traces are open telemetry based and can be exported to Langtrace or any other observability stack (Grafana, Datadog, Honeycomb etc) without having to use a Langtrace API key.
GitHub: Python SDKTypescript SDKtrace-attributes
Langtrace Dashboard: The dashboard is a web-based interface where you can view and analyze your traces.
GitHub: Langtrace
OpenTelemetry: The traces generated by
Langtrace are based on the OpenTelemetry standard. This means that you can use
Langtrace with your existing observability stack (No Langtrace API key
required.), or export the traces to Langtrace.
Langtrace optimizes for the following 3 pillars of observability for your LLM apps:
A span represents a single unit of work or operation in your application. For LLM apps, this typically corresponds to an API call or a specific step in your language model pipeline.
If you’re just getting started or want to self-host, our Self-Hosted option is perfect. For small teams or projects using our managed service, the Starter plan is ideal. As your usage grows, the Growth plan offers more flexibility and features. Large enterprises with specific needs should consider our Scale plan.
For the Growth plan, you’ll be charged for additional spans above the 50K limit. For other plans, please contact our sales team [email protected] to discuss options.
Please contact our sales team to discuss trial options for our paid features.To discuss specific requirements or to learn more about our Enterprise offerings, please contact us at [email protected].
What is Langtrace?
Langtrace is an open-source observability tool that helps you collect and analyze traces to improve your LLM apps.
How do I get started with Langtrace?
To get started with Langtrace, you need to signup and generate an API key. Then, install and import the SDK into your project to start shipping traces to Langtrace.
What are the benefits of using Langtrace?
Langtrace helps you with the following:
Monitor your LLM usage - token and costs, latency and success rate.
Evaluate the responses of the LLM to measure the accuracy of your LLM apps.
Create and manage datasets and prompt sets for your LLM apps.
What languages does Langtrace support?
Langtrace currently supports Python and Typescript. We are adding support for more languages.