Configs for training VIT architecture

[ki3nd]

Could you provide configs for training CLIP VIT-B/16 architecture

[John-Ge]

Training with ViT-B should use AdamW as the optimizer. You could try some different lr settings.