Remove pytest from CI.yml #79

Job	Run time
macos (macos-15-intel, x86_64)	1m 45s
macos (macos-latest, aarch64)	1m 8s
windows (windows-latest, x86, x86)	2m 55s
sdist	12s
windows (windows-11-arm, aarch64, arm64)	2m 1s
linux (ubuntu-22.04, x86_64)	2m 7s
windows (windows-latest, x64, x64)	3m 26s
linux (ubuntu-22.04, x86)	3m 43s
linux (ubuntu-22.04, armv7)	2m 35s
linux (ubuntu-22.04, ppc64le)	2m 28s
linux (ubuntu-22.04, s390x)	2m 31s
linux (ubuntu-22.04, aarch64)	2m 30s
musllinux (ubuntu-22.04, armv7)	2m 22s
musllinux (ubuntu-22.04, aarch64)	2m 24s
musllinux (ubuntu-22.04, x86_64)	2m 21s
musllinux (ubuntu-22.04, x86)	2m 27s
Release	3m 11s
	40m 6s

Provide feedback