This work thoroughly analyzes the HamNoSys labels provided by various maintainers of open sign language corpora in five sign languages, in order to examine the challenges encountered in labeling video data and investigate the consistency and objectivity of Ham noSys-based labels for the purpose of training machine learning models.