Skip to content
This repository has been archived by the owner on Jun 28, 2024. It is now read-only.

Commit

Permalink
Added calculation notes for partitions ratios
Browse files Browse the repository at this point in the history
  • Loading branch information
noaahh committed Jun 6, 2024
1 parent 84bb577 commit d7b15a2
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions src/prep_datasets.py
Original file line number Diff line number Diff line change
Expand Up @@ -79,6 +79,9 @@ def parse_fractions_string(fractions_str):
return [float(frac) for frac in fractions_str.split(",")]


# len(dataset) = 3'600'000
# 1 / 1440 * len(dataset) = 2500
# 1 / 10 * 1 / 1440 * len(dataset) = 250
@app.command()
def prepare_dataset(
dev_set_fraction: float = typer.Option(1 / 1440,
Expand Down

0 comments on commit d7b15a2

Please sign in to comment.