Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bank
release_m6ybuemlfrflthtb6lp3j6bkc4
by
Inigo Alonso, Alberto Sabater, David Ferstl, Luis Montesano, Ana C. Murillo
2021
Abstract
This work presents a novel approach for semi-supervised semantic
segmentation, i.e., per-pixel classification problem assuming that only a small
set of the available data is labeled. We propose a novel representation
learning module based on contrastive learning. This module enforces the
segmentation network to yield similar pixel-level feature representations for
same-class samples across the whole dataset. To achieve this, we maintain a
memory bank continuously updated with feature vectors from labeled data. These
features are selected based on their quality and relevance for the contrastive
learning. In an end-to-end training, the features from both labeled and
unlabeled data are optimized to be similar to same-class samples from the
memory bank. Our approach outperforms the current state-of-the-art for
semi-supervised semantic segmentation and semi-supervised domain adaptation on
well-known public benchmarks, with larger improvements on the most challenging
scenarios, i.e., less available labeled data.
In text/plain
format
Archived Files and Locations
application/pdf 2.1 MB
file_44ryhgisnvhxvapbb73mulxe24
|
arxiv.org (repository) web.archive.org (webarchive) |
2104.13415v1
access all versions, variants, and formats of this works (eg, pre-prints)