The policy-based version of Mortal has been open-sourced

[Nitasurin]

https://github.com/Nitasurin/Mortal-Policy
Its complete original implementation based on MortalV2 has been used in certain scenarios since 2022

[Equim-chan]

Excellent work!

Policy-based methods were what I started with at the very beginning (pre-v1). I experimented with various common methods and practices and spent a lot of time (several months) tuning it. However, they all failed to outperform the baseline. In the end, surprisingly and somewhat unreasonably, simple value-based methods turned out to be effective, so I went on building Mortal with value-based methods.

[Nitasurin]

Could you clarify which baseline you're referring to? Is it Akochan? According to my tests, this repository shows improvements over the baseline model I previously submitted to mjai.app

[Equim-chan]

The baseline was a supervised learning model.