Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Discrete action space implementation based on BaseRLAviary #204

Open
Konjak2e8 opened this issue Apr 18, 2024 · 1 comment
Open

Discrete action space implementation based on BaseRLAviary #204

Konjak2e8 opened this issue Apr 18, 2024 · 1 comment
Labels
question Further information is requested

Comments

@Konjak2e8
Copy link

I'm trying to customize a multi-drone RL environment with a discrete action space - specifically, drones can only fly in some certain directions in a fixed velocity - and I failed to find the way to define a discrete action space, nor can I find an example in the doc on branch master.
Is there any solution to build a discrete action space based on BaseRLAviary?

@JacopoPan
Copy link
Member

Hi @Konjak2e8

for your use case, I would build on top of VelocityAviary, where the input is a 4 dimensional vector (a reference direction + a reference magnitude speed) and look into Farama's docs to replace the Box (n-array/tensor) input for a Discrete one https://gymnasium.farama.org/api/spaces/

@JacopoPan JacopoPan added the question Further information is requested label Apr 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants