When rotating your player in VR, the rotation is based on the CharacterController's center, rather than the HMD's center. 
When rotating your player in VR, the rotation is based on the CharacterController's center, rather than the HMD's center.