You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed that the authors have drawn nn.SiLU() in the model structure. However, I found that no nn.SiLU() plays a role in the model. line 109 of srmamba.py self.act = nn.SiLU() commented out doesn't report an error. lines 200-232 of srmamba.py, including mamba_inner_fn_no_out_proj, don't use nn. SiLU(). As I understand it, nn.SiLU() in Vision Mamba is done via Block encapsulation. So can I assume that this is a model structure drawing error in MambaMIL?
The text was updated successfully, but these errors were encountered:
YuqiZhang-Buaa
changed the title
About nn.SiLU()
About nn.SiLU(), is the model structure drawn incorrectly?
Jul 17, 2024
I noticed that the authors have drawn nn.SiLU() in the model structure. However, I found that no nn.SiLU() plays a role in the model. line 109 of srmamba.py self.act = nn.SiLU() commented out doesn't report an error. lines 200-232 of srmamba.py, including mamba_inner_fn_no_out_proj, don't use nn. SiLU(). As I understand it, nn.SiLU() in Vision Mamba is done via Block encapsulation. So can I assume that this is a model structure drawing error in MambaMIL?
The text was updated successfully, but these errors were encountered: