This project aims to develop a sign language detection system using computer vision and machine learning techniques. The system is designed to interpret hand gestures captured through a webcam in real-time and classify them into corresponding sign language gestures.
- Real-time hand detection and tracking using webcam input.
- Classification of detected hand gestures into predefined sign language categories.
- User-friendly interface for collecting training data through webcam feed.
- Support for customization and extension with additional sign language categories.
- Clone the repository to your local machine:
git clone git@github.com:Priyanshuparth/HandSpeak-Visual-Gesture-Interpreter.git
- Install the required dependencies:
pip install -r requirements.txt
- Download the pre-trained model and label files (if available) and place them in the appropriate directories.
Run the main Python script to start the sign language detection system:
python main.py
Follow the on-screen instructions to interact with the system:
- Use webcam input to capture hand gestures in real-time.
- Press specific keys to exit the screen press
q
- To collect the images press
s
To collect training data for the sign language detection model, follow these steps:
- Run the data collection script:
python data_collection.py
- Follow the instructions to capture and save hand gesture images using the webcam.
Contributions to this project are welcome! If you have ideas for improvements or new features, please submit a pull request or open an issue on GitHub.
This project is licensed under the MIT License.
- The hand detection and tracking functionalities in this project are powered by the cvzone library.
![Image_1710092547 575559](https://private-user-images.githubusercontent.com/73892924/311537229-b00444c1-d07f-4c00-a540-70f41a3cb71f.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcyMjktYjAwNDQ0YzEtZDA3Zi00YzAwLWE1NDAtNzBmNDFhM2NiNzFmLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVhYTYxNjZjNDZmYzE1NTBlMjg4ZWQzMGQwMjMwNmZiYjdkZWUwZDA5MDVjY2QwY2FkMDIyOTBhNzQ4MDU5OWEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.onEPscrQuvpb1ZDZV6ZlvuLvi-7cMk4yag-9YBcRMR0)
![Image_1710092138 3236485](https://private-user-images.githubusercontent.com/73892924/311537255-738a3111-2423-422e-a634-34cf97863328.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcyNTUtNzM4YTMxMTEtMjQyMy00MjJlLWE2MzQtMzRjZjk3ODYzMzI4LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTk1NjNmYjQ3ZmM2MTA2NTY0NTZkY2EzYzk3M2Y2ZjBlZDE1YjQyZjY4YWZlMzVhZDkyZDA0ZmQ1ZDYwNjM1ZDYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.tMOpLCLEipjxRqPHxeRlC3pQsLkLTAgjioVhNOYzRBc)
![Image_1710092848 569423](https://private-user-images.githubusercontent.com/73892924/311537282-abe9ca6b-b1d8-446d-bd69-2ce4553a9c68.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcyODItYWJlOWNhNmItYjFkOC00NDZkLWJkNjktMmNlNDU1M2E5YzY4LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTY4OTJkYTQyNDUzYTljOWE1YzhmZmIwYWU0MWY2YjU3YjdmYjkwZTQ2ODA0ZjE0M2ViMWI1YTM4YjNkZDQzNTEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0._ZmNBbBTok2VDA49KWGEC1ywATwxu-s13BRwQ-hrsBc)
![Image_1710091462 9211955](https://private-user-images.githubusercontent.com/73892924/311537306-ad533438-4962-4af6-ab8c-a6dd357868fa.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzczMDYtYWQ1MzM0MzgtNDk2Mi00YWY2LWFiOGMtYTZkZDM1Nzg2OGZhLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA4MmE2ZTY0YmM5NmYxMzY0Yzg3Y2U4ODYwYjIwMGJkNjQwYTZkYmEzOGE0NjBjMjU5MDQwNDNlYzRmZDIyZGYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.04-K5Sw_K8MnP7p6mBRVML_6lmrKxvSCy-uZzPeHEOM)
![Image_1710093560 7241387](https://private-user-images.githubusercontent.com/73892924/311537347-a7d1997a-5508-422f-a915-0bd15b49fe87.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzczNDctYTdkMTk5N2EtNTUwOC00MjJmLWE5MTUtMGJkMTViNDlmZTg3LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTdmYmNlOTZmMjJlYjRkMWI5MTgzYzNiNTIyYWFmZDFiOTFjNmEzZjVlNjE0MWU1YjkxMmViZmM0Yzg1MTgwOGUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Dko2vR0pTIqbbv1FRUxvBLVnXLpyChH6mz1DDzI1ggg)
![Image_1710093215 559252](https://private-user-images.githubusercontent.com/73892924/311537378-4f516f2d-4329-434a-ae6f-463ac3713195.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzczNzgtNGY1MTZmMmQtNDMyOS00MzRhLWFlNmYtNDYzYWMzNzEzMTk1LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTE1YWY1Mzk5Y2Q5MTBjMzc0Y2YwODYxZGEwYmFmMDRhNzAxODcyNGUwNzA4MzBhMGYwYThiYzgxZDU4M2RmYTMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Vbzw7oY5rUO7fzJcjJowWRVVFSb07YllJ2Y1ITWRyf0)
![Image_1710090729 4090722](https://private-user-images.githubusercontent.com/73892924/311537401-a5d8b077-121e-476a-9655-c4f2e2af941a.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1Mzc0MDEtYTVkOGIwNzctMTIxZS00NzZhLTk2NTUtYzRmMmUyYWY5NDFhLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTg0NDU5MTczZDU3YjM0NzRiNGY1MzRjNjA1YzhkYmQ4NjNjNzFlODI4ZGQzZGIyNDgwYjA4ODEwMWExYTMwYzEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Bog490v99jJiUR1d3q-BadOfRgVIfnFFUjEmTfUu7QE)
![Image_1710093656 7833636](https://private-user-images.githubusercontent.com/73892924/311537048-a28613f3-3d0e-491d-9535-11f023b680e1.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjMyNzYzMTksIm5iZiI6MTcyMzI3NjAxOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcwNDgtYTI4NjEzZjMtM2QwZS00OTFkLTk1MzUtMTFmMDIzYjY4MGUxLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEwVDA3NDY1OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTg2OTRjMTA1YzU5ZDY5Yjc1NTc4MmI3MWRmOTJiZDJjYTU0YjExNzdkMmYwZTFhYjhkMmE4ZTNmYjkzMDlkMDEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.WvSeT-KuDkFcmzr2zYZhK6UEvtEQuMr8sNpOk49wg0c)