[VL] RSS(Resident Set Size) memory of spark executor keep rising

[wForget]

Backend

VL (Velox)

Bug description

When I was analyzing spark executor being killed due to exceeding yarn memory limit, I found that rss memory of spark executor keeps rising even if spill occurs.

OffHeapExecutionMemory and currently in use have both decreased, but ProcessTreeJVMRSSMemory keeps rising.

Spark version

Spark-3.5.x

Spark configurations

No response

System information

No response

Relevant logs

No response

[FelixYBW]

You may run the same query 50 times and check if RSS keep growing. If yes then it's a new mem leak.