because knowing sign language is pretty handy
Signsense is a dactyl translator app developed by two high school students as a (school) project. The app currently supports only one language for translation (Russian Dactyl), but we have plans of adding support for English dactyl and ASL for both languages as well. This app is still very much just a proof-of-concept project and was recently again taken under development.
Currently theres a goal of rewriting the whole app in order to optimise load times, improve detection, add support for ASL, enable simultanious detection with multiple models and just overall improve the app.
Current features:
- 4 menus (Main menu, camera translator, information and settings)
- Live dactyl detection and translation from rear and front cameras
- Information menu with proper guide and credits
- Settings menu to configure detection, translation and app itself
- 2 app themes (Light and Dark)
- 2 interface languages (English and Russian)
- 1 translation language (Only Russian for now)
Upcoming features:
- English dactyl support
- Russian and English sign language support
- When using camera translator, make sure to stand about 1 meter from the signer for proper hand tracking and have the signer's hands visible within the frame, or else the app will not be able to properly track their hands.
- In case of situations with low light levels, use the flashlight function (press lighting icon to toggle).
- After aiming the camera at the signer, the app will immediately track their hands.
- Once the sign will be recognised, it will be shown in the "letter" window and will be added to the queue of "translated word" window.
- Once the app recognises a break between signs, it will mark the word as completed, clear the "translated word" window and add the word to the bottom of the screen, which shows all recently translated words.
- Upon closing the translator this list will be cleared.
Notice: The app was tested on Android versions 8, 9, 10, 11 and 12, minimum supported version is Android 8.
- Download the APK file from here or from releases
- Open and install the apk file
- Done! The app is now installed on your phone
If your browser is blocking you from downloading the APK file on mobile: enable download from unknown sources feature in settings
The app might still crash and have several bugs as this release was a bit rushed because of our project presentation. Make sure to submit all bugs to issues, I will try to fix them as soon as possible. Any other feature requests can also be submited there.