Skip to content

streaming and multi-base-URL support#616

Merged
harshmaru7 merged 4 commits intomainfrom
POC/inference
Mar 20, 2026
Merged

streaming and multi-base-URL support#616
harshmaru7 merged 4 commits intomainfrom
POC/inference

Conversation

@SSharma-10
Copy link
Contributor

Added multi-base-URL routing and SSE streaming support for inference endpoints

@harshmaru7 harshmaru7 merged commit 3c11806 into main Mar 20, 2026
6 checks passed
@harshmaru7 harshmaru7 deleted the POC/inference branch March 20, 2026 13:33
@SSharma-10 SSharma-10 mentioned this pull request Mar 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants