Reusing Data and Metadata to Create New Metadata through Machine-learning & Other Programmatic Methods release_u3us5dcpyreqrnolk77eqnk7ee

by Justin Gosses, ANTHONY R. BUONOMO, Brian A. Thomas, Evan Taylor Yates, Rean W. Yuan, Jenna M. Horn

Published by Zenodo.

2019  

Abstract

Recent improvements in natural language processing (NLP) enable metadata to be created programmatically from reused original metadata or even the dataset itself. Transfer-learning applied to NLP has greatly improved performance and reduced training data requirements. In this talk, we'll compare machine-generated metadata to human-generated metadata and discuss characteristics of metadata and data archives that affect suitability for machine-learning reuse of metadata. Where as human-generated metadata is often populated once, populated from the perspective of data supplier, populated by many individuals with different words for the same thing, and limited in length, machine-generated metadata can be updated any number of times, generated from the perspective of any user, constrained to a standardized set of terms that can be evolved over time, and be any length required. Machine-learning generated metadata offers benefits but also additional needs in terms of version control, process transparency, human-computer interaction, and IT requirements. As a successful example, we'll discuss how a dataset of abstracts and associated human-tagged keywords from a standardized list of several thousand keywords were used to create a machinelearning model that predicted keyword metadata for open-source code projects on code.nasa.gov. We'll also discuss a less successful example from data.nasa.gov to show how data archive architecture and characteristics of initial metadata can be strong controls on how easy it is to leverage programmatic methods to reuse metadata to create additional metadata.
In text/plain format

Archived Files and Locations

application/pdf  2.3 MB
file_ryt7kvlwujgqngghalqhn4gb3i
zenodo.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2019-12-10
Version   1
Language   en ?
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: b0386c17-51e6-4286-9f64-dd9670f97bbb
API URL: JSON