Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bank release_m6ybuemlfrflthtb6lp3j6bkc4

by Inigo Alonso, Alberto Sabater, David Ferstl, Luis Montesano, Ana C. Murillo

Released as a article .

2021  

Abstract

This work presents a novel approach for semi-supervised semantic segmentation, i.e., per-pixel classification problem assuming that only a small set of the available data is labeled. We propose a novel representation learning module based on contrastive learning. This module enforces the segmentation network to yield similar pixel-level feature representations for same-class samples across the whole dataset. To achieve this, we maintain a memory bank continuously updated with feature vectors from labeled data. These features are selected based on their quality and relevance for the contrastive learning. In an end-to-end training, the features from both labeled and unlabeled data are optimized to be similar to same-class samples from the memory bank. Our approach outperforms the current state-of-the-art for semi-supervised semantic segmentation and semi-supervised domain adaptation on well-known public benchmarks, with larger improvements on the most challenging scenarios, i.e., less available labeled data.
In text/plain format

Archived Files and Locations

application/pdf  2.1 MB
file_44ryhgisnvhxvapbb73mulxe24
arxiv.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article
Stage   submitted
Date   2021-04-27
Version   v1
Language   en ?
arXiv  2104.13415v1
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 649c1928-3bf9-4cd1-8f29-2fd10bafcea8
API URL: JSON