Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
albertz committed Nov 29, 2023
1 parent 1906043 commit 33cb487
Showing 1 changed file with 2 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -47,13 +47,14 @@ def sis_run_with_prefix(prefix_name: Optional[str] = None):
train_exp("from-scratch-train", config, gpu_mem=11)

train_exp(
"v6-11gb-bs15k-accgrad4-mgpu2",
"v6-11gb-f32-bs15k-accgrad4-mgpu2",
config_24gb_v6,
config_updates={
"batch_size": 15_000 * _batch_size_factor,
"accum_grad_multiple_step": 4,
"torch_distributed": {}, # multi-GPU
},
config_deletes=["torch_amp"], # f32
gpu_mem=11,
num_processes=2, # multi-GPU
)
Expand Down

0 comments on commit 33cb487

Please sign in to comment.