Skip to content

jcoitino/webllm

Repository files navigation

web-llm

A simple testing app to evaluate browser local LLM for basic AI operations like fast translations or fast LLM router.

About

A basic WebLLM test for fast and simple AI inference browser locally accelerated by WebGPU (ie: LLM Router tasks). Use: - Lit - igniteui-webcomponents - MobX - @mlc-ai/web-llm

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors