fix: remove flaky test from compat tests #6002

Job	Run time
ubuntu-latest.amd64.py3.8.sdist-bundle	46s
macos.amd64.py3.6.build	6m 56s
windows-2019.amd64.py3.6.build	6m 41s
manylinux.amd64.py3.6.build	4m 3s
macos.amd64.py3.7.build	6m 8s
windows-2019.amd64.py3.7.build	6m 42s
manylinux.aarch64.py${{ matrix.config.version }}.build	0s
manylinux.amd64.py3.7.build	4m 3s
windows-2019.amd64.py3.8.build	6m 42s
macos.amd64.py3.8.build	6m 30s
manylinux.amd64.py3.8.build	4m 17s
windows-2019.amd64.py3.9.build	6m 21s
manylinux.amd64.py3.9.build	4m 10s
windows-2019.amd64.py3.10.build	5m 43s
manylinux.amd64.py3.10.build	4m 2s
macos.amd64.py3.9.build	6m 14s
macos.amd64.py3.10.build	6m 58s
manylinux.aarch64.py${{ matrix.config.version }}.test	0s
ubuntu-latest.amd64.py3.8.sdist-build-test	5m 5s
manylinux.amd64.py3.6.test	2m 18s
manylinux.amd64.py3.7.test	2m 17s
manylinux.amd64.py3.8.test	2m 19s
manylinux.amd64.py3.9.test	2m 18s
manylinux.amd64.py3.10.test	2m 19s
${{ matrix.os }}.amd64.py${{ matrix.version }}.test	1s
macos.amd64.py${{ matrix.version }}.test	1s
	1h 42m 54s

Provide feedback