Backport wildcard SSH config changes

[f0ssel]

Basically reimplement #521 in the new branch

[matifali]

@f0ssel @bcpeinhardt would you help add more details on the issue? Why do we need a reimplementation? Is it to add a toggle to optionally opt out from the wildcard-based SSH config?
Thanks