Putting Humans in the Natural Language Processing Loop: A Survey release_bnwj25lwofcwrnjtvlta64niq4

by Zijie J. Wang, Dongjin Choi, Shenyu Xu, Diyi Yang

Released as a article .

2021  

Abstract

How can we design Natural Language Processing (NLP) systems that learn from human feedback? There is a growing research body of Human-in-the-loop (HITL) NLP frameworks that continuously integrate human feedback to improve the model itself. HITL NLP research is nascent but multifarious -- solving various NLP problems, collecting diverse feedback from different people, and applying different methods to learn from collected feedback. We present a survey of HITL NLP work from both Machine Learning (ML) and Human-Computer Interaction (HCI) communities that highlights its short yet inspiring history, and thoroughly summarize recent frameworks focusing on their tasks, goals, human interactions, and feedback learning methods. Finally, we discuss future directions for integrating human feedback in the NLP development loop.
In text/plain format

Archived Files and Locations

application/pdf  304.0 kB
file_w4ve7guxz5eylpjfkpcmnr4vgq
arxiv.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article
Stage   submitted
Date   2021-03-06
Version   v1
Language   en ?
arXiv  2103.04044v1
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 4151da9c-b840-4b1e-b94b-0fd7f728d941
API URL: JSON