Flaky test ScaledScanControllerTest.fuzzer failed by driverIdx < numRunningDrivers_ (3 vs. 3)

[jinchengchenghh]

Bug description

Failed in CI
https://github.com/facebookincubator/velox/actions/runs/12463952328/job/34787210884?pr=11936

[ RUN      ] ScaledScanControllerTest.fuzzer
E20241223 10:12:54.952503 125863 Exceptions.h:66] Line: /__w/velox/velox/velox/exec/ScaledScanController.cpp:79, Function:updateAndTryScale, Expression: driverIdx < numRunningDrivers_ (3 vs. 3), Source: RUNTIME, ErrorCode: INVALID_STATE
E20241223 10:12:54.952811 125863 ExceptionTracer.cpp:217] terminate() called, exception stack follows
E20241223 10:12:54.952852 125863 ExceptionTracer.cpp:219] Exception type: facebook::velox::VeloxRuntimeError (9 frames)
    @ 0000000000c073eb _ZZN12_GLOBAL__N_111InitializerC4EvENKUlPvPSt9type_infoPPFvS1_EE_clES1_S3_S6_
                       /build/deps-download/folly/folly/debugging/exception_tracer/ExceptionStackTraceLib.cpp:79
    @ 0000000000c0741b _ZZN12_GLOBAL__N_111InitializerC4EvENUlPvPSt9type_infoPPFvS1_EE_4_FUNES1_S3_S6_
                       /build/deps-download/folly/folly/debugging/exception_tracer/ExceptionStackTraceLib.cpp:79
    @ 0000000000c0b02a __cxa_throw
                       /build/deps-download/folly/folly/debugging/exception_tracer/ExceptionTracerLib.cpp:74
    @ 0000000004226518 _ZN8facebook5velox6detail14veloxCheckFailINS0_17VeloxRuntimeErrorERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEEEvRKNS1_18VeloxCheckFailArgsET0_
    @ 0000000008c1ff8d _ZN8facebook5velox4exec20ScaledScanController17updateAndTryScaleEjm
    @ 0000000000de21d1 _ZZN8facebook5velox4exec4test36ScaledScanControllerTest_fuzzer_Test8TestBodyEvENKUlvE_clEv
    @ 00000000000dbad4 (unknown)
    @ 000000000008a092 start_thread
    @ 000000000010e414 clone

E20241223 10:12:54.979553 125863 ExceptionTracer.cpp:221] exception stack complete
terminate called after throwing an instance of 'facebook::velox::VeloxRuntimeError'
  what():  Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Reason: (3 vs. 3)
Retriable: False
Expression: driverIdx < numRunningDrivers_
Function: updateAndTryScale
File: /__w/velox/velox/velox/exec/ScaledScanController.cpp
Line: 79
Stack trace:
# 0  _ZN8facebook5velox7process10StackTraceC1Ei
# 1  _ZN8facebook5velox14VeloxExceptionC1EPKcmS3_St17basic_string_viewIcSt11char_traitsIcEES7_S7_S7_bNS1_4TypeES7_
# 2  _ZN8facebook5velox6detail14veloxCheckFailINS0_17VeloxRuntimeErrorERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEEEvRKNS1_18VeloxCheckFailArgsET0_
# 3  _ZN8facebook5velox4exec20ScaledScanController17updateAndTryScaleEjm
# 4  _ZZN8facebook5velox4exec4test36ScaledScanControllerTest_fuzzer_Test8TestBodyEvENKUlvE_clEv
# 5  0x00000000000dbad4
# 6  start_thread
# 7  clone

*** Aborted at 1734948775 (Unix time, try 'date -d @1734948775') ***
*** Signal 6 (SIGABRT) (0x1251c) received by PID 75036 (pthread TID 0x7ff80ac50640) (linux TID 125863) (maybe from PID 75036, UID 0) (code: -6), stack trace: ***
(error retrieving stack trace)
Fatal signal handler. ThreadDebugInfo object not found.

System information

/

Relevant logs

No response

[jinchengchenghh]

@xiaoxmeng Could you help take a look? Thanks!