Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement reinforcement learning #8

Open
Diapolo10 opened this issue Apr 4, 2022 · 0 comments
Open

Implement reinforcement learning #8

Diapolo10 opened this issue Apr 4, 2022 · 0 comments
Assignees
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@Diapolo10
Copy link
Owner

The heart of the project; actually implementing the neural network that drives the car.

This will first require deciding which library will be used for the neural network. The current candidates are PyTorch and Tensorflow, the former likely being a better fit, but the end result could go either way.

Next, we need to implement the neural network's feedback functions. Namely, what actions to reward and what to punish. The NN could be rewarded for completing consecutive laps, giving more for each loop the faster it completes it, though due to the complexity of the track we may need to add "checkpoints" along the map that give a small reward each. On the opposite end we obviously punish the neural network hard for crashing into the walls, and we may have to punish it for idling.

The input nodes should likely be:

  • Vision lasers' intersection points (~12 in total)
  • Vehicle x-axis velocity
  • Vehicle y-axis velocity
  • Vehicle angle

The output nodes should be:

  • Left arrow (turn left)
  • Right arrow (turn right)
  • Up arrow (forward)
  • Down arrow (brake/backward)

All of this is subject to change as we make further progress. All feedback is welcome.

@Diapolo10 Diapolo10 added enhancement New feature or request help wanted Extra attention is needed labels Apr 4, 2022
@Diapolo10 Diapolo10 self-assigned this Apr 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant