Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion server/services/s2s/aws.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -256,5 +256,5 @@ async def get_weather(function_name, tool_call_id, args, llm, context, result_ca
- **Endpointing sensitivity**: Only supported with Nova 2 Sonic. Controls how quickly the model decides the user has stopped speaking -- `"HIGH"` causes the model to respond most quickly.
- **Transcription frames**: User speech transcription frames are always emitted upstream. Assistant text transcripts are delivered in real-time using speculative text events, providing text synchronized with audio output for responsive client UIs.
- **Connection resilience**: If a connection error occurs while the service wants to stay connected, it automatically resets the conversation and reconnects.
- **System instruction and tools precedence**: Instructions and tools provided in the LLM context take precedence over those provided at initialization time.
- **System instruction precedence**: The `system_instruction` from service settings takes precedence over an initial system message in the LLM context. A warning is logged when both are set. Tools provided in the LLM context take precedence over those provided at initialization time.
- **Audio format**: Uses LPCM (Linear PCM) audio format for both input and output. Input defaults to 16kHz and output defaults to 24kHz.
2 changes: 1 addition & 1 deletion server/services/s2s/gemini-live.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -286,7 +286,7 @@ llm = GeminiLiveLLMService(
## Notes

- **Model support**: The service supports both Gemini 2.5 and Gemini 3.x models. The service automatically detects and handles model-specific behavior.
- **System instruction precedence**: If a system instruction is provided both at init time and in the LLM context, the context-provided value takes precedence.
- **System instruction precedence**: The `system_instruction` from service settings takes precedence over an initial system message in the LLM context. A warning is logged when both are set.
- **Tools precedence**: Similarly, tools provided in the context override tools provided at init time.
- **Transcription aggregation**: Gemini Live sends user transcriptions in small chunks. The service aggregates them into complete sentences using end-of-sentence detection with a 0.5-second timeout fallback.
- **Session resumption**: The service automatically handles session resumption on reconnection using session resumption handles.
Expand Down
1 change: 1 addition & 0 deletions server/services/s2s/grok.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -254,6 +254,7 @@ await task.queue_frame(
- **Audio before setup**: Audio is not sent to Grok until the conversation setup is complete, preventing sample rate mismatches.
- **Available voices**: Ara (default), Rex, Sal, Eve, and Leo.
- **G.711 support**: PCMU and PCMA formats are supported at a fixed 8000 Hz rate, useful for telephony integrations.
- **System instruction precedence**: The `system_instruction` from service settings takes precedence over an initial system message in the LLM context. A warning is logged when both are set.

## Event Handlers

Expand Down
1 change: 1 addition & 0 deletions server/services/s2s/openai.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -301,6 +301,7 @@ await task.queue_frame(
- **Audio output format**: The service outputs 24kHz PCM audio by default.
- **Video support**: Video frames can be sent to the model for multimodal input. Control the detail level with `video_frame_detail` and pause/resume with `set_video_input_paused()`.
- **Transcription frames**: User speech transcription frames are always emitted upstream when input audio transcription is configured.
- **System instruction precedence**: The `system_instruction` from service settings takes precedence over an initial system message in the LLM context. A warning is logged when both are set.

## Event Handlers

Expand Down
Loading