Skip to content

GPT2 Local Model isn't working #1

@chrisanc

Description

@chrisanc

Bug #1

When using the query command, I found the LLM is giving an error for the KV Caché (it isn't properly set). I need to set the cache to improve exponencially the model performance on every device, no matter the hardware.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions