-
Notifications
You must be signed in to change notification settings - Fork 2
[BOT ISSUE] Missing instrumentation for Azure OpenAI Java SDK #68
Description
Summary
The Braintrust Java SDK does not instrument the Azure OpenAI Java SDK (com.azure:azure-ai-openai). This is Microsoft's official SDK for accessing OpenAI models deployed on Azure, with chat completions, embeddings, and streaming execution surfaces. Braintrust lists Azure AI Foundry as a supported cloud provider, but the Java SDK has no instrumentation for Azure OpenAI calls.
The existing OpenAI instrumentation (openai_2_8_0) wraps the com.openai:openai-java SDK's HTTP client, which does not intercept calls made through com.azure:azure-ai-openai — the Azure SDK uses its own com.azure.core HTTP pipeline, completely separate from the OpenAI Java SDK's client.
What is missing
The com.azure:azure-ai-openai module provides these execution surfaces, none of which are instrumented:
| API | Description |
|---|---|
getChatCompletions |
Synchronous chat completions |
getChatCompletionsStream |
Streaming chat completions with ChatCompletions chunks |
getEmbeddings |
Embedding generation |
getCompletions |
Legacy text completions |
The SDK is available on Maven Central at version 1.0.0-beta.16 and is actively maintained as part of the Azure SDK for Java.
There is no reference to com.azure, azure-ai-openai, or AzureOpenAi anywhere in this repository — no instrumentation module, no tests, no examples, no dependencies.
Braintrust docs status
- Azure AI Foundry is listed as a supported cloud provider at https://www.braintrust.dev/docs/integrations/ai-providers
- The Azure-specific docs page covers configuration but does not reference Java SDK instrumentation: not_found for Java SDK support
Upstream sources
- Azure OpenAI Java SDK README: https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/openai/azure-ai-openai/README.md
- Azure OpenAI Java API reference: https://learn.microsoft.com/en-us/java/api/com.azure.ai.openai?view=azure-java-preview
- Maven Central: https://mvnrepository.com/artifact/com.azure/azure-ai-openai (actively released, v1.0.0-beta.16)
- Azure OpenAI client library docs: https://learn.microsoft.com/en-us/java/api/overview/azure/ai-openai-readme?view=azure-java-preview
Local files inspected
settings.gradle— lists all instrumentation modules; no Azure module presentbraintrust-sdk/instrumentation/— containsopenai_2_8_0,anthropic_2_2_0,genai_1_18_0,langchain_1_8_0,springai_1_0_0; no Azure directory- Full-repo grep for
com.azure,azure-ai-openai,AzureOpenAi— zero matches