Issue: OOM During Online Training with 14B Teacher + 7B Student

[uygnef]

Out-of-memory (OOM) errors occur when running online distillation training with a 14B-parameter teacher model and a 7B-parameter student model.
Could anyone provide guidance on the correct multi-node parallel configuration