NUK - logo
VSE knjižnice (vzajemna bibliografsko-kataložna baza podatkov COBIB.SI)
PDF
  • The Janes project : language resources and tools for Slovene user generated content
    Fišer, Darja, 1978- ; Ljubešić, Nikola, 1979- ; Erjavec, Tomaž, 1960-
    The paper presents the results of the Janes project, which aimed to develop language resources and tools for Slovene user generated content. The paper first describes the 200 million word Janes ... corpus, containing tweets, forum posts, news comments, user and talk pages from Wikipedia, and blogs and blog comments, where each text is accompanied by rich metadata. The developed processing tools for Slovene user generated content are presented next, which include a tokeniser, word-normaliser, part-of-speech tagger and lemmatiser, and a named entity recogniser. A set of manually annotated datasets was also produced, both for tool training as well as for linguistic research. The developed resources and tools are made publicly available under Creative Commons licences in the repository of the CLARIN.SI research infrastructure and on GitHub, while the corpora are also available through the CLARIN.SI concordancers.
    Vir: Language resources and evaluation. - ISSN 1574-020X (Vol. 54, no. 1, 2020, str. 223-246)
    Vrsta gradiva - članek, sestavni del
    Leto - 2020
    Jezik - angleški
    COBISS.SI-ID - 68029026
    DOI

Vnos na polico