These two links seem not work in https://crfm.stanford.edu/heim/latest/

[zhimin-z]

[JosselinSomervilleRoberts]

Works for me. What is it redirecting you to?

[zhimin-z]

Paper: https://arxiv.org/abs/2211.09110
GItHub: https://github.com/stanford-crfm/helm
Are these expected?
That does make sense when HEIM is not a subset of HELM.

[zhimin-z]

Works for me. What is it redirecting you to?

If this holds, then #2029 (comment) makes more sense:
So eventually HELM will include HEIM, right? Because I cannot raise any issues regarding HEIM in its repo, which is very weird. @JosselinSomervilleRoberts

[yifanmai]

These two links are currently working, and go to the HEIM paper and this repository respectively.

The code for HEIM has been merged as part of #1939.

[zhimin-z]

These two links are currently working, and go to the HEIM paper and this repository respectively.

The code for HEIM has been merged as part of #1939.

It seems the first one still not working, would you like to do a quick check?
It will direct me to https://arxiv.org/abs/2211.09110, is that expected?
@yifanmai

[yifanmai]

Thanks for catching; it should go to the HEIM paper instead. I will update the link.

[yifanmai]

I have fixed the link. Thanks again for finding this.