Skip to content

Commit

Permalink
reverting FS based listing for full cleaning in clean Planner
Browse files Browse the repository at this point in the history
  • Loading branch information
nsivabalan committed Apr 5, 2023
1 parent 192ee43 commit e0515dc
Showing 1 changed file with 1 addition and 9 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -212,15 +212,7 @@ private List<String> getPartitionPathsForIncrementalCleaning(HoodieCleanMetadata
*/
private List<String> getPartitionPathsForFullCleaning() {
// Go to brute force mode of scanning all partitions
try {
// Because the partition of BaseTableMetadata has been deleted,
// all partition information can only be obtained from FileSystemBackedTableMetadata.
FileSystemBackedTableMetadata fsBackedTableMetadata = new FileSystemBackedTableMetadata(context,
context.getHadoopConf(), config.getBasePath(), config.shouldAssumeDatePartitioning());
return fsBackedTableMetadata.getAllPartitionPaths();
} catch (IOException e) {
return Collections.emptyList();
}
return FSUtils.getAllPartitionPaths(context, config.getMetadataConfig(), config.getBasePath());
}

/**
Expand Down

0 comments on commit e0515dc

Please sign in to comment.