File descriptions:

Muon optimizer.py is acquired from the paper Muon is Scalable by Moonshot AI The training pipeline is the main working space, where all the config and hyperparameters are chosen and main experiments are run.