Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
albertz committed Dec 7, 2023
1 parent 900ca35 commit 18c5e8d
Showing 1 changed file with 0 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -388,7 +388,6 @@ def __init__(
forget_bias=0.0, # the code above already adds it during conversion
)

self.weight_feedback = rf.Linear(att_num_heads, enc_key_total_dim, with_bias=False)
self.s_transformed = rf.Linear(self.s.out_dim, enc_key_total_dim, with_bias=False)
self.energy = rf.Linear(enc_key_total_dim, att_num_heads, with_bias=False)
self.readout_in = rf.Linear(
Expand Down

0 comments on commit 18c5e8d

Please sign in to comment.