Does it support AWS bedrock as inference?

[baryhuang]

If not I think I can offer some help. I would need that in my production. Thanks!

Very appreciate your work and keep this opensourced.

[SecretiveShell]

I have not tested this, but it should be possible if they support openai clients.

[arulrajnet]

Bedrock don't expose in OpenAI format by default.

We can achieve this via Bedrock Access Gateway https://github.com/aws-samples/bedrock-access-gateway or LiteLLM.