Exclude torch.compile time from metrics computation

[zxd1997066]

When using torch.compile in accelerator.prepare_model, compilation time is being included while computing statistics. And this may result in incorrect performance metrics calculations. This PR measures time after the torch.compile called in accelerate to exclude the compilation time.

[amyeroberts]

cc @muellerzr @SunMarc

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[SunMarc]

Thanks for the PR @zxd1997066 ! I think it would be better if we can do similar to what we did with f"{metric_key_prefix}_jit_compilation_time".

        if f"{metric_key_prefix}_jit_compilation_time" in output.metrics:
            start_time += output.metrics[f"{metric_key_prefix}_jit_compilation_time"]

[zxd1997066]

Thanks for the PR @zxd1997066 ! I think it would be better if we can do similar to what we did with f"{metric_key_prefix}_jit_compilation_time".

        if f"{metric_key_prefix}_jit_compilation_time" in output.metrics:
            start_time += output.metrics[f"{metric_key_prefix}_jit_compilation_time"]

Hi @SunMarc , thanks for the review, I will take a look at it.

[SunMarc]

This is a lot better @zxd1997066 , thanks for iterating ! Could you fix the quality issue by typing make style ?

[zxd1997066]

This is a lot better @zxd1997066 , thanks for iterating ! Could you fix the quality issue by typing make style ?

Fixed the quality issue, thanks!

[zxd1997066]

Hi @SunMarc , could you please help merge this PR if all good? I do not have access. Thanks!

[SunMarc]

Hey @zxd1997066, I've pinged @amyeroberts for a final review !

[LysandreJik]

Thanks for your PR!