Akademska digitalna zbirka SLovenije - logo
VSE knjižnice (vzajemna bibliografsko-kataložna baza podatkov COBIB.SI)
  • Multimodal metadata assignment for cultural heritage artifacts [Elektronski vir]
    Rei, Luis ...
    We develop a multimodal classifer for the cultural heritage domain using a late fusion approach and introduce a novel data-set. The three modalities are Image, Text, and Tabular data. We based the ... image classifer on a ResNet convolutional neural network architecture and the text classifer on a multilingual transformer architecture (XML-Roberta). Both are trained as multitask classifers. Tabular data and late fusion are handled by Gradient Tree Boosting. We also show how we leveraged a specifc data model and taxonomy in a Knowledge Graph to create the dataset and to store classifcation results.
    Vir: Multimedia systems [Elektronski vir]. - ISSN 1432-1882 (Vol. 29, iss. 2, Apr. 2023, str. 847-869)
    Vrsta gradiva - e-članek ; neleposlovje za odrasle
    Leto - 2023
    Jezik - angleški
    COBISS.SI-ID - 131681539