gguf models

[DjagbleyEmmanuel]

Does it support gguf models on hugging face?

[turboderp]

It doesn't, no. It's specifically a frontend for ExLlamaV2, which works with EXL2, GPTQ and unquantized models.

[DjagbleyEmmanuel]

okay thanks!