self.global_step understanding

[ajinkyaambatwar]

I had a doubt about the keyword self.global_step
Does it represent the total number of batches seen so far or total number of samples seen so far.
For eg. If I have batch size of 32 and each epoch has 200 batches(total of 6400 samples). After 2 epochs, what should be the value of self.global_step?

Now I intend to use this concept for scheduling my LR using LambdaLR. I intend to update it after 20000(decay_step) steps. So is my lr_lbmd inside configure_optimizer right? Or should I just use
int(self.global_step/self.hparams["optimizer.decay_step])?

def lr_lbmd(_):
            return max(
                self.hparams["optimizer.lr_decay"]
                ** (
                    int(
                        self.global_step
                        * self.hparams["batch_size"]
                        / self.hparams["optimizer.decay_step"]
                    )
                ),
                lr_clip / self.hparams["optimizer.lr"],
            )

[awaelchli]

self.global_step represents the current index of training batch across all epochs. If you are using multi-gpu, important detail: it represents only the counting for one gpu, not all batches combined for all gpus!

global step is incremented after each training step is fully processed and optimizer has stepped and logger has logged.

For eg. If I have batch size of 32 and each epoch has 200 batches(total of 6400 samples). After 2 epochs, what should be the value of self.global_step

It will be 200 * 2 and it means batches 0 to (200 * 2 - 1) have been processed (total 400) and the next batch will be the index 400.

[awaelchli]

If you set interval="step" in the scheduler dict returned from the configure_optimizers() hook, it will call your lr_scheduler.step() function every global step.

[sevmag]

How does the global step behave for the validation period. I'm trying to log train_loss_step and val_loss_step with the WandbLogger . I tried to plot them on the same graph with global_step on the x-axis but for some reason the val_loss_step extends to far greater global_step values. I'm using log_every_n_steps=1 and val_check_interval=0.1 in the lightning Trainer. I have the suspicion that there is a different global_step used. For testing purposes I used 100 datasamples loaded with a batchsize 10.