Optimal nonparametric testing of Missing Completely At Random, and its connections to compatibility release_vruavyyv75fnboiondnvgu7o6a

by Thomas B Berrett, Richard J Samworth

Released as a article .

2022  

Abstract

Given a set of incomplete observations, we study the nonparametric problem of testing whether data are Missing Completely At Random (MCAR). Our first contribution is to characterise precisely the set of alternatives that can be distinguished from the MCAR null hypothesis. This reveals interesting and novel links to the theory of Fr\'echet classes (in particular, compatible distributions) and linear programming, that allow us to propose MCAR tests that are consistent against all detectable alternatives. We define an incompatibility index as a natural measure of ease of detectability, establish its key properties, and show how it can be computed exactly in some cases and bounded in others. Moreover, we prove that our tests can attain the minimax separation rate according to this measure, up to logarithmic factors. Our methodology does not require any complete cases to be effective, and is available in the R package MCARtest.
In text/plain format

Archived Files and Locations

application/pdf  827.6 kB
file_berbwoncafgmvapvy3gxdxov3e
arxiv.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article
Stage   submitted
Date   2022-05-17
Version   v1
Language   en ?
arXiv  2205.08627v1
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 824685d7-8ddd-4959-ac2a-b1e978f6f7da
API URL: JSON