LOSS is "NAN"

[17771618951]

Hello, thanks for the author's works. I hava preprocessed the data, and this is my project dir:

I trained the JTA dataset using a single TeslaV100 GPU for 2 days, however, in the last 10~15 epoches, the loss turn to "NAN" . I wonder if the author faced this problem and how to sovle it?

[yanggao2000]

Hi, thanks for reaching out.
The data directory looks okay. Regarding the loss issue, actually we haven't faced the issue before. Maybe could you double-check if you changed anywhere or followed all the provided instructions? Thanks.