WR: Add Gymnasium Wrapper

[rizkydiprasetya]

Description

close #429

Background

Checklists:

• Read the CONTRIBUTION guide (required).
• Update the history on the source code (required).

[rizkydiprasetya]

@detlefarend @steveyuwono

[steveyuwono]

Hi @rizkydiprasetya , everything looks good and the howto works fine as well. Maybe just need to update the RTD in the following sections:

• Sec 6.7. 3rd Party Support
• A1 - Example Pool --> MLPro-RL --> Wrappers
• A2 - API Reference --> Wrappers

[detlefarend]

Looks good! As Steve already mentioned, it's just the rtd update to be done.

One question: it seems that gymnasium is compatible to openai gym and provides access to the same environments. Can we remove openai gym and follow gymnasium?

[rizkydiprasetya]

Looks good! As Steve already mentioned, it's just the rtd update to be done.

One question: it seems that gymnasium is compatible to openai gym and provides access to the same environments. Can we remove openai gym and follow gymnasium?

We could, but I would rather to separate them. As Open AI Gym is no longer updated and we use it only because of the dependencies of SB3. So, I would keep it there until SB3 updates their Gym to Gymnasium. And as Gymnasium is still continuously updating, it is easier to maintain the wrapper if we have separate file.

[detlefarend]

Looks good! As Steve already mentioned, it's just the rtd update to be done.

One question: it seems that gymnasium is compatible to openai gym and provides access to the same environments. Can we remove openai gym and follow gymnasium?

We could, but I would rather to separate them. As Open AI Gym is no longer updated and we use it only because of the dependencies of SB3. So, I would keep it there until SB3 updates their Gym to Gymnasium. And as Gymnasium is still continuously updating, it is easier to maintain the wrapper if we have separate file.

That makes sense.