Multi-Keyword Classification: A Case Study in Finnish Social Sciences Data Archive release_6tkiypwyazaizbauzsyeuxgbym

by Erjon Skenderi, Jukka Viljami Huhtamäki, Kostas Stefanidis

Published in Information by MDPI AG.

2021   Volume 12, Issue 12, p491

Abstract

In this paper, we consider the task of assigning relevant labels to studies in the social science domain. Manual labelling is an expensive process and prone to human error. Various multi-label text classification machine learning approaches have been proposed to resolve this problem. We introduce a dataset obtained from the Finnish Social Science Archive and comprised of 2968 research studies' metadata. The metadata of each study includes attributes, such as the "abstract" and the "set of labels". We used the Bag of Words (BoW), TF-IDF term weighting and pretrained word embeddings obtained from FastText and BERT models to generate the text representations for each study's abstract field. Our selection of multi-label classification methods includes a Naive approach, Multi-label k Nearest Neighbours (ML-kNN), Multi-Label Random Forest (ML-RF), X-BERT and Parabel. The methods were combined with the text representation techniques and their performance was evaluated on our dataset. We measured the classification accuracy of the combinations using Precision, Recall and F1 metrics. In addition, we used the Normalized Discounted Cumulative Gain to measure the label ranking performance of the selected methods combined with the text representation techniques. The results showed that the ML-RF model achieved a higher classification accuracy with the TF-IDF features and, based on the ranking score, the Parabel model outperformed the other methods.
In application/xml+jats format

Archived Files and Locations

application/pdf  892.3 kB
file_fsvocupvevejtmo5u2lspjyuje
mdpi-res.com (publisher)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2021-11-25
Language   en ?
Container Metadata
Open Access Publication
In DOAJ
In ISSN ROAD
In Keepers Registry
ISSN-L:  2078-2489
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: eec0dd2d-45ee-4365-8a3a-11ea6e14dfd7
API URL: JSON