Transformer from scratch, basically rewrited from Andrej Karpathy's lecture code.
GPTFrame is the framework of decoder only transformer, trained on little shakespeare data, can generate to some extent shakespeare style texts.
ReproduceGPT2 is going to implement training method for efficiency that will complexify the model thus empower it to have teeth and to reproduce GPT2.
crabshellman/DigGPT
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|