This project allows the Air Traffic Control (ATC) component of Flight Simulator 2020 to be controlled using voice.
The steps to achieve this are:
- When the user presses a push to talk button, a screenshot is taken of the ATC window.
- This is processed with optical character recgonition to create a list of possible commands
- The user's speech is processed with a speech model which has been trained on a list of domain specific language
- Possible commands are compared to the users speech, with the closest match being inputted into the flight simualtor.