Using Langtrace to monitor your Azure-OpenAI LLM is quick and easy. Follow these steps:

Setup

  1. Install the Langtrace and Azure-OpenAI SDKs.

Note: You’ll need API keys from Langtrace and AZURE-OPENAI SERVICE. Sign up for Langtrace and/or Azure if you haven’t done so already.

Python
# Install the SDK
pip install -U langtrace-python-sdk openai
  1. Setup environment variables:
Shell
export LANGTRACE_API_KEY=YOUR_LANGTRACE_API_KEY
export AZURE_OPENAI_ENDPOINT=YOUR_AZURE_OPENAI_ENDPOINT
export AZURE_OPENAI_API_KEY=YOUR_AZURE_OPENAI_API_KEY
export AZURE_API_VERSION=YOUR_API_VERSION
export AZURE_DEPLOYMENT_NAME=YOUR_DEPLOYMENT_NAME

Usage

Generate a simple output with your deployment’s model:

You can now view your traces on the Langtrace dashboard.

Want to see more supported methods? Checkout the sample code in the Langtrace Azure-OpenAI Python Example repository.