[HUDI-5291] Fixing NPE in MOR column stats accounting

[alexeykudinkin]

Change Logs

This is addressing NPE while handling column stats w/in the HoodieAppendHandle

Impact

Low

Risk level (write none, low medium or high below)

Low

Documentation Update

N/A

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[codope]

Thanks for covering the scenario. I don't see any change in source code (only test has changed). So, is it alrady handled?

[codope]

LGTM. Thanks for taking care of this issue. We can land once the CI is green.

[hudi-bot]

CI report:

• cdbda3c Azure: FAILURE

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[codope]

testMetadataColumnStatsIndex is flaky in my local setup as well. Once in a while, valueCount does not match. @alexeykudinkin Can you please look into the failure?

[alexeykudinkin]

@codope yeah, it seems like it flakes every once and a while but it occurs very infrequently locally for me. Are you able to repro it consistently?

[alexeykudinkin]

@codope i'm going to merge this one and follow-up on flakiness separately. My hunch is that it might be related to test isolation not being watertight.

https://issues.apache.org/jira/browse/HUDI-5354

CI is green:

https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=13428&view=results

[codope]

yeah, it seems like it flakes every once and a while but it occurs very infrequently locally for me. Are you able to repro it consistently?

No, I can't reproduce consistently. But, every 1/20 times it does fail. I will look into this if you haven't already started. I would like to add whenever it fails it's for MOR table.

https://issues.apache.org/jira/browse/HUDI-5371