Skip to content

Commit

Permalink
pandas: concat instead of append
Browse files Browse the repository at this point in the history
  • Loading branch information
geritwagner committed Sep 16, 2024
1 parent d1dff9e commit 5a77fbc
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion bib_dedupe/dedupe_benchmark.py
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,9 @@ def __load_data(self) -> None:
part1_df = pd.read_csv(str(part1_path))
self.records_df = part1_df
part2_df = pd.read_csv(str(part2_path))
self.records_df = self.records_df.append(part2_df, ignore_index=True)
self.records_df = pd.concat(
[self.records_df, part2_df], ignore_index=True
)

true_merged_ids_df = pd.read_csv(str(self.merged_record_ids_path))
self.true_merged_ids = true_merged_ids_df["merged_ids"].str.split(";").tolist()
Expand Down

0 comments on commit 5a77fbc

Please sign in to comment.