High validation loss for depth prediction

[namsan96]

Hi, thanks for sharing your codebase for great work!

I'm trying to reproduce HULC++'s evaluation results in CALVIN.
I found that the validation loss of depth prediction increases very highly compared to the training's one in affordance model training, as shown in the figure below.
It'd be very helpful if you can confirm whether this is an expected behavior, or if I'm missing something while following your instructions.

I actually encountered very suspicious error during the final stage of processing validation data.
The error occurred in this line as add_norm_values tries to indexing data['training'] which appears to be reasonably missing while processing validation data.
Would this error have affected data sanity?

Thanks!

[HuiHuiSun]

Hi, thanks for sharing your codebase for great work!

I'm trying to reproduce HULC++'s evaluation results in CALVIN. I found that the validation loss of depth prediction increases very highly compared to the training's one in affordance model training, as shown in the figure below. It'd be very helpful if you can confirm whether this is an expected behavior, or if I'm missing something while following your instructions.

I actually encountered very suspicious error during the final stage of processing validation data. The error occurred in this line as add_norm_values tries to indexing data['training'] which appears to be reasonably missing while processing validation data. Would this error have affected data sanity?

Thanks!

Hi, have you reproduced the results in the paper?