fix: remove flaky test from compat tests #6003

Job	Run time
ubuntu-latest.amd64.py3.8.sdist-bundle	50s
manylinux.amd64.py3.6.build	4m 3s
manylinux.aarch64.py${{ matrix.config.version }}.build	0s
manylinux.amd64.py3.7.build	4m 6s
macos.amd64.py3.6.build	6m 54s
windows-2019.amd64.py3.6.build	13m 6s
manylinux.amd64.py3.8.build	4m 3s
macos.amd64.py3.7.build	8m 5s
windows-2019.amd64.py3.7.build	17m 49s
manylinux.amd64.py3.9.build	4m 8s
macos.amd64.py3.8.build	9m 18s
windows-2019.amd64.py3.8.build	6m 11s
macos.amd64.py3.9.build	8m 15s
manylinux.amd64.py3.10.build	4m 14s
windows-2019.amd64.py3.9.build	6m 37s
macos.amd64.py3.10.build	12m 33s
windows-2019.amd64.py3.10.build	18m 1s
manylinux.aarch64.py${{ matrix.config.version }}.test	0s
ubuntu-latest.amd64.py3.8.sdist-build-test	4m 56s
manylinux.amd64.py3.6.test	3m 7s
manylinux.amd64.py3.7.test	3m 2s
manylinux.amd64.py3.8.test	2m 30s
manylinux.amd64.py3.9.test	2m 45s
manylinux.amd64.py3.10.test	2m 36s
macos.amd64.py3.6.test	3m 12s
macos.amd64.py3.7.test	3m 29s
macos.amd64.py3.8.test	5m 51s
macos.amd64.py3.9.test	6m 13s
macos.amd64.py3.10.test	7m 37s
windows-2019.amd64.py3.6.test	7m 53s
windows-2019.amd64.py3.7.test	7m 3s
windows-2019.amd64.py3.8.test	6m 55s
windows-2019.amd64.py3.9.test	7m 16s
windows-2019.amd64.py3.10.test	6m 49s
	3h 29m 27s

Provide feedback