A multisource fusion framework driven by user-defined knowledge for egocentric activity recognition release_4b7fqbfn7rcjpmeqwjizyldyy4

by Haibin Yu, Wenyan Jia, Zhen Li, Feixiang Gong, Ding Yuan, Hong Zhang, Mingui Sun

Published by Zenodo.

2019  

Abstract

Recently, egocentric activity recognition has attracted considerable attention in the pattern recognition and artificial intelligence communities because of its widespread applicability to human systems, including the evaluation of dietary and physical activity and the monitoring of patients and older adults. In this paper, we present a knowledge-driven multisource fusion framework for the recognition of egocentric activities in daily living (ADL). This framework employs Dezert–Smarandache theory across three information sources: the wearer's knowledge, images acquired by a wearable camera, and sensor data from wearable inertial measurement units and GPS. A simple likelihood table is designed to provide routine ADL information for each individual. A well-trained convolutional neural network is then used to produce a set of textual tags that, along with routine information and other sensor data, are used to recognize ADLs based on information theory-based statistics and a support vector machine. Our experiments show that the proposed method accurately recognizes 15 predefined ADL classes, including a variety of sedentary activities that have previously been difficult to recognize. When applied to real-life data recorded using a self-constructed wearable device, our method outperforms previous approaches, and an average accuracy of 85.4% is achieved for the 15 ADLs.
In text/plain format

Archived Files and Locations

application/pdf  8.9 MB
file_wu4a2kqocvfmvpkz7oms7i4k3q
zenodo.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2019-05-19
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: b33136fd-2314-4f5b-a892-3dba24fdbea4
API URL: JSON