I want to use an API instead of Local LLM

[QueryPlanner]

Any idea how?

[gabriel-lody]

That defeats the purpose of this specific application. There are tons of apps and webpages around that use LLM APIs. One of the few in the World that is capable of using a model locally on an Apple mobile is this one. So, it's possible to include API access, but the main feature is running locally. That's even in the description of the app.

[bartaxyz]

@gabriel-lody
I don't think it defeats the purpose. For example, right now I'm self-hosting a more powerful model on my Mac, and I'd like to connect to it from my phone (when available). Only to fallback to a less powerful local model when I don't have connection available.

This is probably the main thing preventing me from using this day to day.

[gabriel-lody]

@bartaxyz

Use Enchanted:

https://github.com/gluonfield/enchanted