The VisSE project ("Visualizando la SignoEscritura", "Visualizing SignWriting") aims to develop tools that ease the use and understanding of SignWriting in the digital world. SignWriting is a system for visually transcribing sign languages into a 2D page, i.e. a writing system for sign languages.
This repository collects the different software results of the project, along with instructions for their use.
- Quevedo: a python tool for the annotation of images with complex semantics, dataset organization, neural network training and expert system building.
- VisSE Corpus: a corpus of handwritten SignWriting annotations of Spanish Sign Language, in Quevedo dataset format, with trained neural networks and recognition pipelines. While we finish its annotation, it is not publicly available, but partial packaged releases will be made available in this repository.
- VisSE App: a progressive web application for the explanation of handwritten SignWriting instances. It identifies the different components of the trascription, and gives a textual explanation of their meaning as well as a 3D model of the hands involved.
The expert system that makes the project possible is described in the following article:
- Automatic SignWriting Recognition, Antonio F. G. Sevilla, Alberto Díaz Esteban, and José María Lahoz-Bengoechea. Preprint version
Use the setup.sh script to deploy the project.
This repository is a meta repository.
Clone it with meta git clone or use meta git update to get the different
dependencies in this directory.
The project "Visualizando la SignoEscritura" (Visualizing SignWriting), reference number PR2014_19/01, was developed in the Faculty of Computer Science of Universidad Complutense de Madrid and funded by Indra and Fundación Universia in the IV call for funding aid for research projects with application to the development of accessible technologies.
We want to acknowledge the collaboration of the signing community, especially the Spanish Sign Language teachers at Idiomas Complutense and Fundación CNSE.
The code in this repository is licensed under the Open Software License version 3.0.