Skip to content

sozercan/k8s-distributed-inference

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
configs
configs
 
 
scripts
scripts
 
 
.env-sample
.env-sample
 
 
.gitignore
.gitignore
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 
deploy-local-ai.md
deploy-local-ai.md
 
 
provision-host.md
provision-host.md
 
 

Repository files navigation

About

🦄 Distributed Inference on Kubernetes with DRA and MIG

Topics

kubernetes inference nvidia dra llm dynamic-resource-allocation multi-instance-gpu

Resources

Readme

License

MIT license
Activity

Stars

3 stars

Watchers

1 watching

Forks

5 forks
Report repository

Releases

No releases published

Packages

 
 
 

Contributors

Languages