Loss curve anomalies

[zhangch-ss]

Thank you for sharing your work. May I ask why the loss of the validation dataset has been rising? this doesn't look normal.

[rongtongxueya]

Can you run his cloab demo? Why I run a lot of errors, the most obvious error is"ImportError: Using the Trainer with PyTorch requires accelerate>=0.20.1: Please run pip install transformers[torch] or `pip install accelerate "I tried everything, but nothing worked