[HUDI-5822] Fix FileId not found exception when FileId is passed to HoodieMergeHa...

[voonhous]

...ndle

Applying the fix from #5185 will fix write issues for MOR tables, but will cause write issues for COW tables.

More information on how to reproduce the COW error in this jira issue:
https://issues.apache.org/jira/browse/HUDI-5822

This addresses the issue raised here: #5782

NOTE

HEADSUP for future cherrypickers, for this fix to work, HUDI-5862 has to be picked first.

i.e. HUDI-5822 relies on HUDI-5862

Change Logs

1. Complement the change of getLatestFileSlices -> getAllFileGroups in [HUDI-3758] Fix duplicate fileId error in MOR table type with flink bucket hash Index  #5185

Impact

1. Allow jobs to recover properly
2. Ensure that the correct fileSlices are being read

Risk level (write none, low medium or high below)

None

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change

• The config description must be updated if new configs are added or the default value of the configs are changed
• Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
  ticket number here and follow the instruction to make
  changes to the website.

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[voonhous]

@danny0405
Re-created the PR as #7997 is unable to trigger CI.

[hudi-bot]

CI report:

• 6aa7bc9 Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[danny0405]

+1

[voonhous]

HEADSUP for future cherrypickers, for this fix to work, HUDI-5862 has to be picked first.

i.e. HUDI-5822 relies on HUDI-5862