Skip to content

[BOT ISSUE] Missing instrumentation for Azure OpenAI Java SDK #68

@braintrust-bot

Description

@braintrust-bot

Summary

The Braintrust Java SDK does not instrument the Azure OpenAI Java SDK (com.azure:azure-ai-openai). This is Microsoft's official SDK for accessing OpenAI models deployed on Azure, with chat completions, embeddings, and streaming execution surfaces. Braintrust lists Azure AI Foundry as a supported cloud provider, but the Java SDK has no instrumentation for Azure OpenAI calls.

The existing OpenAI instrumentation (openai_2_8_0) wraps the com.openai:openai-java SDK's HTTP client, which does not intercept calls made through com.azure:azure-ai-openai — the Azure SDK uses its own com.azure.core HTTP pipeline, completely separate from the OpenAI Java SDK's client.

What is missing

The com.azure:azure-ai-openai module provides these execution surfaces, none of which are instrumented:

API Description
getChatCompletions Synchronous chat completions
getChatCompletionsStream Streaming chat completions with ChatCompletions chunks
getEmbeddings Embedding generation
getCompletions Legacy text completions

The SDK is available on Maven Central at version 1.0.0-beta.16 and is actively maintained as part of the Azure SDK for Java.

There is no reference to com.azure, azure-ai-openai, or AzureOpenAi anywhere in this repository — no instrumentation module, no tests, no examples, no dependencies.

Braintrust docs status

Upstream sources

Local files inspected

  • settings.gradle — lists all instrumentation modules; no Azure module present
  • braintrust-sdk/instrumentation/ — contains openai_2_8_0, anthropic_2_2_0, genai_1_18_0, langchain_1_8_0, springai_1_0_0; no Azure directory
  • Full-repo grep for com.azure, azure-ai-openai, AzureOpenAi — zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions