KEYPOINT DETECTOR RETRAINING TECHNIQUES FOR THE COMMUNICATION SYSTEM OF SIGN LANGUAGE SPEAKERS

Authors : Guram CHAGANAVA, David KAKULİA

Pages : 74-86

Doi:10.18038/estubtda.822295

View : 27 | Download : 9

Publication Date : 2020-11-27

Article Type : Research Paper

Abstract :The study described in this article examines the approaches of retraining of the deep learning model for hand palm keypoint detection in images. This is one of the studies conducted to create an innovative communication system for sign language speakers. The target of the given study is to find an optimal technique of retraining for increasing the degree of the keypoint detector generalization. So, it must be able to accurately detect keypoints in images it has not seen during training. It will make the communication system usable in real-life conditions. In the article, there are reviewed three approaches of retraining: Retraining in series, retraining using ‘united’ dataset and retraining using mixed datasets. Experiments were conducted to test the effectiveness of each of them. The paper presents the results of the experiments and a relatively optimal method selected among them.
Keywords : Sign language, Communication system, Keypoint detection, Retraining

ORIGINAL ARTICLE URL