🚨 Refactor a bit add_tokens logic: fix bytelevel decode of added tokens + less memory deserialization 🚨#1995
Merged
ArthurZucker merged 51 commits intomainfrom Apr 10, 2026
Merged
🚨 Refactor a bit add_tokens logic: fix bytelevel decode of added tokens + less memory deserialization 🚨#1995ArthurZucker merged 51 commits intomainfrom
ArthurZucker merged 51 commits intomainfrom
Commits
Commits on Mar 27, 2026
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Mar 30, 2026
- authored
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Apr 8, 2026
- authored
- authored
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Apr 10, 2026
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- authored
- committed
- committed
- committed
- committed
- authored
- committed
- authored