Using Langtrace to monitor your Arch apps is quick and easy. Follow these steps:

​
Setup

  1. Install and run Arch by following the steps outlined in their docs.

  2. Install the Langtrace SDK.

Note: You’ll need an API key from Langtrace. Sign up for Langtrace if you haven’t done so already.

Python
# Install the SDK
pip install -U langtrace-python-sdk openai
  1. Setup environment variables:
Shell
export LANGTRACE_API_KEY=YOUR_LANGTRACE_API_KEY

​
Usage

Generate a simple output with your deployment’s model:

import os
from langtrace_python_sdk import langtrace # Must precede any llm module imports
langtrace.init(api_key = os.environ['LANGTRACE_API_KEY'])

from openai import OpenAI
## NOTE that Arch is openai client compatible which is why we will use the OPEN AI client


# Generate a simple output
messages = [
  {
      "role": "system",
      "content": (
          "You are an artificial intelligence assistant and you need to "
          "engage in a helpful, detailed, polite conversation with a user."
      ),
  },
  {
      "role": "user",
      "content": (
          "Count to 100, with a comma between each number and no newlines. "
          "E.g., 1, 2, 3, ..."
      ),
  },
]

## NOTE that Arch should be running on either port 10000 or 12000
client = OpenAI(api_key=os.environ['OPENAI_API_KEY'], base_url="http://127.0.0.1:12000/v1")

response = client.chat.completions.create(
  model="gpt-4",
  messages=messages,
)

You can now view your traces on the Langtrace dashboard:

​
Additional Resources

AnthropicAzure-OpenAI