Skip to content

Commit

Permalink
[ZeRO-3] Rename confusing log message (#1932)
Browse files Browse the repository at this point in the history
  • Loading branch information
jeffra authored May 2, 2022
1 parent 89e37ef commit a8d26d6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion deepspeed/runtime/zero/stage3.py
Original file line number Diff line number Diff line change
Expand Up @@ -271,7 +271,7 @@ def __init__(self,

if dist.get_rank() == 0:
logger.info(f"Reduce bucket size {reduce_bucket_size}")
logger.info(f"Allgather bucket size {prefetch_bucket_size}")
logger.info(f"Prefetch bucket size {prefetch_bucket_size}")
# The fused optimizer does all the work. We need this layer for two reason:
# 1. maintain same user API from apex.fp16_utils
# 2. keep common stuff here in case we need to add ne552w fused optimizer later
Expand Down

0 comments on commit a8d26d6

Please sign in to comment.