NMFs-CSL Dataset
Introduction
This NMFs-CSL dataset explicitly emphasizes the importance of the non-manual features in sign language. It contains 1,067 Chinese sign words (610 confusing words (0~609), 457 normal words (610~1066)). It is collected with portable cameras on the mobile phones. The sign videos are recorded with 30fps. Each instance in the dataset contains RGB videos.
Download (*Important )
This NMFs-CSL dataset contains 1,067 Chinese sign words. It is released to universities and research institutes for research purpose only. To request the access right to the data resources, please follow the instructions below:
- Download the NMFs-CSL Dataset Release Agreement;
- Read it carefully;
- Complete it appropriately. Note that the agreement should be signed by a full-time staff member (that is, the student is not acceptable).
- Please scan the signed agreement and send it to (ustc_vslrg At 126.com) and CC to Prof. Zhou (zhwg At ustc.edu.cn) and the full-time staff member who sign the agreement.
Notation
If you use this NMFs-CSL dataset in your research, please cite the following papers:
- Hezhen Hu, Wengang Zhou, Junfu Pu, and Houqiang Li, "Global-Local Enhancement Network for NMF-Aware Sign Language Recognition," ACM Trans. Multimedia Comput. Commun. Appl. (TOMM), 2021.
- Hezhen Hu, Wengang Zhou, Junfu Pu, and Houqiang Li, "Hand-Model-Aware Sign Language Recognition," AAAI Conference on Artificial Intelligence (AAAI), 2021.
- Hezhen Hu, Weichao Zhao, Wengang Zhou, and Houqiang Li, "SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding," IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), 2023.
- Hezhen Hu, Weichao Zhao, Wengang Zhou, Yuechen Wang, Houqiang Li, "SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition," International Conference on Computer Vision (ICCV), 2021.
Contact
If you have any questions about the dataset and our papers, please feel free to contact us:
- Houqiang Li, Professor, USTC, lihq AT ustc.edu.cn
- Wengang Zhou, Professor, USTC, zhwg AT ustc.edu.cn
- Weichao Zhao, Ph.D Student, USTC, saruka AT mail.ustc.edu.cn