Sign language learners with a spoken language background face the challenge of acquiring a second language in a different modality. In the course of this endeavor, one of the modality-specific ...phenomena they encounter is the use of classifier predicates, also known as depicting signs. Classifier predicates contain a meaningful hand configuration that refers to an entity, denoting a salient characteristic of this entity (Zwitserlood, 2003). The use of a classifier predicate allows the signer to indicate the location, motion and orientation of a referent. If two classifier predicates are used simultaneously, the signer can represent the spatial arrangement of both referents (Schembri, Jones and Burnham, 2001). This visual representation is new for learners with a spoken language background. Since there is a paucity of literature on second language (L2) sign language acquisition, there is no empirical evidence on the developmental stages that L2 learners go through in acquiring the devices to produce such visual representations. In this study, we followed 14 novel learners of Sign Language of the Netherlands (NGT) over a period of two years. The learners were asked to produce sign language descriptions of prompts containing various objects (e.g. cars, bicycles, trucks, human beings and animals) that could be depicted by a classifier predicate. Analyses show that after a year of instruction, the majority of learners are capable of producing scene descriptions featuring two classifier predicates to denote the spatial layout of the objects. The first classifier predicates appear in the data at an early stage, suggesting that the strategy of denoting an object with a meaningful handshape representing the object is not difficult to learn. Furthermore, the data show that learners initially struggle with the orientation of objects and handshape selection. This study is the first to systematically elicit classifier predicates from novel learners for an extended period of time. The results have important implications for the field of sign language pedagogy and teaching.
In this book, an Australian Aboriginal sign language used by Indigenous people in the North East Arnhem Land (Northern Territory) is described on the level of spatial grammar. Topics discussed range ...from properties of individual signs to structure of interrogative and negative sentences. The main interest is the manifestation of signing space - the articulatory space surrounding the signers - for grammatical purposes in Yolngu Sign Language.
The performance of existing sign language recognition approaches is typically limited by the scale of training data. To address this issue, we propose a mutual enhancement network (MEN) for joint ...sign language recognition and education. First, a sign language recognition system built upon a spatial-temporal network is proposed to recognize the semantic category of a given sign language video. Besides, a sign language education system is developed to detect the failure modes of learners and further guide them to sign correctly. Our theoretical contribution lies in formulating the above two systems as an estimation-maximization (EM) framework, which can progressively boost each other. The recognition system could become more robust and accurate with more training data collected by the education system, while the education system could guide the learners to sign more precisely, benefiting from the hand shape analysis module of the recognition system. Experimental results on three large-scale sign language recognition datasets validate the superiority of the proposed framework.
AI technologies can play an important role in breaking down the communication barriers of deaf or hearing-impaired people with other communities, contributing significantly to their social inclusion. ...Recent advances in both sensing technologies and AI algorithms have paved the way for the development of various applications aiming at fulfilling the needs of deaf and hearing-impaired communities. To this end, this survey aims to provide a comprehensive review of state-of-the-art methods in sign language capturing, recognition, translation and representation, pinpointing their advantages and limitations. In addition, the survey presents a number of applications, while it discusses the main challenges in the field of sign language technologies. Future research direction are also proposed in order to assist prospective researchers towards further advancing the field.
This study investigates head nods in natural dyadic German Sign Language (DGS) interaction, with the aim of finding whether head nods serving different functions vary in their phonetic ...characteristics. Earlier research on spoken and sign language interaction has revealed that head nods vary in the form of the movement. However, most claims about the phonetic properties of head nods have been based on manual annotation without reference to naturalistic text types and the head nods produced by the addressee have been largely ignored. There is a lack of detailed information about the phonetic properties of the addressee's head nods and their interaction with manual cues in DGS as well as in other sign languages, and the existence of a form-function relationship of head nods remains uncertain. We hypothesize that head nods functioning in the context of affirmation differ from those signaling feedback in their form and the co-occurrence with manual items. To test the hypothesis, we apply OpenPose, a computer vision toolkit, to extract head nod measurements from video recordings and examine head nods in terms of their duration, amplitude and velocity. We describe the basic phonetic properties of head nods in DGS and their interaction with manual items in naturalistic corpus data. Our results show that phonetic properties of affirmative nods differ from those of feedback nods. Feedback nods appear to be on average slower in production and smaller in amplitude than affirmation nods, and they are commonly produced without a co-occurring manual element. We attribute the variations in phonetic properties to the distinct roles these cues fulfill in turn-taking system. This research underlines the importance of non-manual cues in shaping the turn-taking system of sign languages, establishing the links between such research fields as sign language linguistics, conversational analysis, quantitative linguistics and computer vision.
We gratefully acknowledge the financial support of COST (European Cooperation in Science and Technology), funded by the Horizon 2020 Framework Programme of the European Union. Current grammatical ...knowledge about particular sign languages is fragmentary and of varying reliability, and it appears scattered in scientific publications where the description is often intertwined with the analysis. In general, comprehensive grammars are a rarity. The SignGram Blueprint is an innovative tool for the grammar writer: a full-fledged guide to describing all components of the grammars of sign languages in a thorough and systematic way, and with the highest scientific standards.The work builds on the existing knowledge in Descriptive Linguistics, but also on the insights from Theoretical Linguistics. It consists of two main parts running in parallel: the Checklist with all the grammatical features and phenomena the grammar writer can address, and the accompanying Manual with the relevant background information (definitions, methodological caveats, representative examples, tests, pointers to elicitation materials and bibliographical references). The areas covered are Phonology, Morphology, Lexicon, Syntax and Meaning. The Manual is endowed with hyperlinks that connect information across the work and with a pop-up glossary. The SignGram Blueprint will be a landmark for the description of sign language grammars in terms of quality and quantity.
The series is dedicated to the comparative study of sign languages around the world. Individual or collective works that systematically explore typological variation across sign languages are the ...focus of this series, with particular emphasis on undocumented, underdescribed and endangered sign languages. The scope of the series primarily includes cross-linguistic studies of grammatical domains across a larger or smaller sample of sign languages, but also encompasses the study of individual sign languages from a typological perspective and comparison between signed and spoken languages in terms of language modality, as well as theoretical and methodological contributions to sign language typology.
This book presents a first comprehensive overview of existing research on information structure in sign languages. Furthermore, it is combined with novel in-depth studies of Russian Sign Language and ...Sign Language of the Netherlands. The book discusses how topic, focus, and contrast are marked in the visual modality and what implications this has for theoretical and typological study of information structure. Such issues as syntactic and prosodic markers of information structure and their interactions, relations between different notions of information structure, and grammaticalization of markers of information structure are highlighted. Empirical studies of the two sign languages also showcase different methodologies that are used in such research and discuss their advantages and disadvantages. The book contains a general introduction to the field of information structure and thus can be used by linguists new to the field.
This is first comprehensive introduction to the linguistics of Auslan, the sign language of Australia. Assuming no prior background in language study, it explores each key aspect of the structure of ...Auslan, providing an accessible overview of its grammar (how sentences are structured), phonology (the building blocks of signs), morphology (the structure of signs), lexicon (vocabulary), semantics (how meaning is created), and discourse (how Auslan is used in context). The authors also discuss a range of myths and misunderstandings about sign languages, provide an insight into the history and development of Auslan, and show how Auslan is related to other sign languages, such as those used in Britain, the USA and New Zealand. Complete with clear illustrations of the signs in use and useful further reading lists, this is an ideal resource for anyone interested in Auslan, as well as those seeking a clear, general introduction to sign language linguistics.
PDF
