(Re)-implementation of "Prompt Lookup Decoding" by Apoorv Saxena, with extended ideas from LLMA Decoding.
-
Updated
Aug 20, 2024 - Jupyter Notebook
#
prompt-lookup-decoding
Here are 2 public repositories matching this topic...
Speculative Decoding on Bandwidth-Bound Hardware
-
Updated
Apr 20, 2026 - Jupyter Notebook
Improve this page
Add a description, image, and links to the prompt-lookup-decoding topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the prompt-lookup-decoding topic, visit your repo's landing page and select "manage topics."