Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
deploy-llama-2-13b-chat-inferentia-2-lmi.ipynb		deploy-llama-2-13b-chat-inferentia-2-lmi.ipynb
deploy-tinyllama-inferentia-2-lmi.ipynb		deploy-tinyllama-inferentia-2-lmi.ipynb

Repository files navigation

inferentia-deployments

About

Deploy Large Models on AWS Inferentia (Inf2) instances.

aws lmi inf2 large-model llm inferentia large-language-model large-model-inference aws-inferentia inferentia-2

Report repository

Releases

No releases published

Packages

Contributors

Languages

Jupyter Notebook 100.0%