You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Today I realised that the encoder weights aren't being frozen after phase 1 of training in the DiscreteEncoder module (used by discrete.gin config) and gradients are still being backpropogated through the encoder in phase 2 of training as well. I was wondering if this was intentional and if so why? I'm a bit confused by this since according to the original RAVE article, the encoder is supposed to be 'frozen' during phase 2 of training. Thanks in advance!
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Today I realised that the encoder weights aren't being frozen after phase 1 of training in the DiscreteEncoder module (used by discrete.gin config) and gradients are still being backpropogated through the encoder in phase 2 of training as well. I was wondering if this was intentional and if so why? I'm a bit confused by this since according to the original RAVE article, the encoder is supposed to be 'frozen' during phase 2 of training. Thanks in advance!
Beta Was this translation helpful? Give feedback.
All reactions