test_runner: support test order randomization #5000

Job	Run time
Build slim tarball	2m 3s
x86_64-darwin: with shared libraries	39m 21s
aarch64-darwin: with shared libraries	24m 57s
aarch64-linux: with shared libraries	22m 8s
x86_64-linux: with shared libraries	26m 49s
	1h 55m 18s

Provide feedback