Sending Traces
Tracing is a fundamental feature in LLM application development, enabling developers to gain deep insights into their apps’ performance and behavior. By capturing detailed information such as input and output tokens, response times, model parameters, and user feedback, tracing allows you to optimize your LLM applications effectively. This guide will walk you through the process of sending traces from your application to Langtrace Cloud, helping you leverage this powerful tool for analysis and improvement.
Step 1: Set Up Langtrace Cloud
To begin sending traces, you’ll need to set up your Langtrace Cloud account:
- Sign up by going to this link.
- After signing up, create a new Project. Projects are containers for storing traces and metrics generated by your application. If you have only one application, creating 1 project will suffice.
- Generate an API key. This key will be used to authenticate your application with Langtrace Cloud.
You may also create new projects and generate API keys for each of them later.
Step 2: Install and Initialize the SDK
To start sending traces, you need to install the Langtrace SDK and initialize it with your API key. Follow these steps:
Replace <LANGTRACE_API_KEY>
with the API key you generated in Step 1.
Make sure to initialize Langtrace before importing any LLM modules to ensure all interactions are properly traced.
Step 3: Create and Send Traces
Once the SDK is initialized, Langtrace will automatically capture traces from supported LLM integrations.
Example: Sending Traces from an OpenAI Application
Here’s an example of how to send traces from an LLM application using the OpenAI API. This example demonstrates how to use the Langtrace SDK to send traces from an OpenAI completion request.
Make Sure to pip or npm install the required packages before running the code.
Run the code snippet as shown below:
After setting up Langtrace and running your application, your traces will be automatically sent to Langtrace Cloud, where you can view and analyze them on the dashboard.
Next Steps
Now that you’ve set up Langtrace and are sending traces, you can:
-
View Your Traces: Log in to your Langtrace Cloud account to view and analyze the traces you’ve sent.
-
Customize Your Tracing: Explore adding custom attributes or spans to capture more specific data about your LLM operations.
-
Integrate with Your Workflow: Consider how you can use the insights from your traces to optimize your LLM applications.
-
Explore Advanced Features: Check out our other guides to learn about features like:
Remember, the more you use Langtrace, the more insights you’ll gain into your LLM applications’ performance and behavior.
Troubleshooting Common Issues
If you encounter problems while setting up or using Langtrace, here are solutions to some common issues:
If you’re still experiencing issues after trying these solutions, please contact our support team.