-
Notifications
You must be signed in to change notification settings - Fork 2
[BOT ISSUE] Missing instrumentation for Amazon Bedrock Runtime Java SDK #67
Description
Summary
The Braintrust Java SDK does not instrument the Amazon Bedrock Runtime Java SDK (software.amazon.awssdk:bedrockruntime). This is a widely used official AWS SDK (currently at v2.42.x) with rich execution-oriented APIs for generative AI, including chat/completions, streaming, and embeddings. Braintrust lists AWS Bedrock as a supported cloud provider, but the Java SDK has no auto-instrumentation or manual wrapper for Bedrock calls.
What is missing
The software.amazon.awssdk:bedrockruntime module provides these execution surfaces, none of which are instrumented:
| API | Description |
|---|---|
Converse |
Unified synchronous chat/completions API across all Bedrock foundation models |
ConverseStream |
Streaming version of Converse with real-time chunk processing |
InvokeModel |
Lower-level synchronous model invocation (supports completions, embeddings via Titan Embed, image generation) |
InvokeModelWithResponseStream |
Streaming version of InvokeModel |
The Converse API is AWS's recommended high-level interface and provides a consistent request/response schema across all Bedrock models (Claude, Llama, Titan, Nova, Mistral, etc.), making it well-suited for generic instrumentation.
There is no reference to bedrock, BedrockRuntime, or software.amazon.awssdk anywhere in this repository — no instrumentation module, no tests, no examples, no dependencies.
Braintrust docs status
- AWS Bedrock is listed as a supported cloud provider at https://www.braintrust.dev/docs/integrations/ai-providers
- The Bedrock-specific docs page covers configuration and authentication but does not reference Java SDK instrumentation: not_found for Java SDK support
Upstream sources
- AWS Bedrock Runtime Java SDK API docs: https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/services/bedrockruntime/BedrockRuntimeClient.html
- AWS Bedrock Runtime Java code examples: https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/java_bedrock-runtime_code_examples.html
- Maven Central: https://central.sonatype.com/artifact/software.amazon.awssdk/bedrockruntime (actively released, v2.42.x)
- Converse API reference: https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html
Local files inspected
settings.gradle— lists all instrumentation modules; no Bedrock module presentbraintrust-sdk/instrumentation/— containsopenai_2_8_0,anthropic_2_2_0,genai_1_18_0,langchain_1_8_0,springai_1_0_0; no Bedrock directory- Full-repo grep for
bedrock,BedrockRuntime,awssdk— zero matches