Visual Sign Language Research Group
Visual Sign Language Research Group
People
Highlights
Publications
Datasets
1
BEST: BERT Pre-Training for Sign Language Recognition with Coupling Tokenization
In this work, we are dedicated to leveraging the BERT pre-training success and modeling the domain-specific statistics to fertilize the …
Weichao Zhao
,
Hezhen Hu
,
Wengang Zhou
,
Jiaxin Shi
,
Houqiang Li
PDF
Cite
Hand-Object Interaction Image Generation
In this work, we are dedicated to a new task, i.e., hand-object interaction image generation, which aims to conditionally generate the …
Hezhen Hu
,
Weilun Wang
,
Wengang Zhou
,
Houqiang Li
PDF
Cite
Code
Project
SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition
Hand gesture serves as a critical role in sign language. Current deep-learning-based sign language recognition (SLR) methods may suffer …
Hezhen Hu
,
Weichao Zhao
,
Wengang Zhou
,
Yuechen Wang
,
Houqiang Li
PDF
Cite
Improving sign language translation with monolingual data by sign back-translation
Despite existing pioneering works on sign language translation (SLT), there is a non-trivial obstacle, i.e., the limited quantity of …
Hao Zhou
,
Wengang Zhou
,
Weizhen Qi
,
Junfu Pu
,
Houqiang Li
PDF
Cite
Model-Aware Gesture-to-Gesture Translation
Hand gesture-to-gesture translation is a significant and interesting problem, which serves as a key role in many applications, such as …
Hezhen Hu
,
Weilun Wang
,
Wengang Zhou
,
Weichao Zhao
,
Houqiang Li
PDF
Cite
Hand-Model-Aware Sign Language Recognition
Hand gestures play a dominant role in the expression of sign language. Current deep-learning based video sign language recognition …
Hezhen Hu
,
Wengang Zhou
,
Houqiang Li
PDF
Cite
Boosting continuous sign language recognition via cross modality augmentation
Continuous sign language recognition (SLR) deals with unaligned video-text pair and uses the word error rate (WER), i.e., edit …
Junfu Pu
,
Wengang Zhou
,
Hezhen Hu
,
Houqiang Li
PDF
Cite
Continuous sign language recognition via reinforcement learning
In this paper, we propose an approach to apply the Transformer with reinforcement learning (RL) for continuous sign language …
Zhihai Zhang
,
Junfu Pu
,
Liansheng Zhuang
,
Wengang Zhou
,
Houqiang Li
PDF
Cite
Deep grammatical multi-classifier for continuous sign language recognition
In this paper, we propose a novel deep architecture with multiple classifiers for continuous sign language recognition. Representing …
Chengcheng Wei
,
Wengang Zhou
,
Junfu Pu
,
Houqiang Li
PDF
Cite
Dynamic pseudo label decoding for continuous sign language recognition
Continuous sign language recognition is a weakly supervised problem to translate video sequence to sign gloss sequence, where temporal …
Hao Zhou
,
Wengang Zhou
,
Houqiang Li
PDF
Cite
»
Cite
×