fix(perf): back out commit 808b951c5a9eb5dd25adbd46a5887525d0a0913d

[samueltardieu]

This backs out comit 808b951 "Remove optimization which gives worst benchmark results", as it severely degrades performances as shown in
#639.

[codspeed-hq]

CodSpeed Performance Report

Merging #640 will improve performances by 26.7%

_{Comparing push-xvwtywvozruq (1eb4c50) with main (fe5efe8)}

Summary

⚡ 12 improvements
✅ 24 untouched benchmarks

Benchmarks breakdown

	Benchmark	main	push-xvwtywvozruq	Change
⚡	corner_to_corner_bfs	1.4 ms	1.2 ms	+21.79%
⚡	corner_to_corner_dijkstra	1.8 ms	1.5 ms	+16.33%
⚡	no_path_astar	2 ms	1.7 ms	+18.68%
⚡	no_path_bfs	1.3 ms	1.1 ms	+26.7%
⚡	no_path_dfs	1.3 ms	1.1 ms	+26.69%
⚡	no_path_dijkstra	1.6 ms	1.4 ms	+17.86%
⚡	no_path_fringe	1.9 ms	1.6 ms	+19.56%
⚡	Compare kuhn_munkres with different input sizes[128]	2.9 ms	2.4 ms	+21.74%
⚡	Compare kuhn_munkres with different input sizes[256]	19 ms	15.6 ms	+21.25%
⚡	Compare kuhn_munkres with different input sizes[32]	86.6 µs	72.8 µs	+19.05%
⚡	Compare kuhn_munkres with different input sizes[512]	575.1 ms	489.9 ms	+17.38%
⚡	Compare kuhn_munkres with different input sizes[64]	448.3 µs	364.5 µs	+22.99%