[QUESTION] Limit Number of Saved Checkpoints

[GuokunWang]

Hi,

I'm wondering if Megatron-LM supports keeping only the latest N checkpoints. When using a small save_interval for frequent checkpointing, the storage occupied by checkpoints grows rapidly. It would be very helpful if there was a parameter similar to save_total_limit in the Transformers library, which would allow us to constrain the maximum number of checkpoints saved. This would effectively reduce storage consumption.

Thanks!