Error when training model

[jm02058]

I am trying to train the model (currently using provided example 'python bin/train_model.py -c configs/train_tsdiff/train_uber_tlc.yaml'), but am struggling to fix the following error:

File "/.../src/uncond_ts_diff/arch/s4.py", line 967, in forward
k = torch.fft.irfft(k_f, n=discrete_L) # (B+1, C, H, L)
RuntimeError: cuFFT error: CUFFT_INTERNAL_ERROR

Any guidance on how I might have caused this would be much appreciated, I am not very experienced in this area. Thank you.
I have also provided a screenshot of the last output (I am running the model on WSL).

[abdulfatir]

@jm02058 Is this relevant? pytorch/pytorch#88038

[jm02058]

@jm02058 Is this relevant? pytorch/pytorch#88038

Yes, I'll have another look.
Thank you.