BigEarthNet-MM: A Large-Scale, Multimodal, Multilabel Benchmark Archive for Remote Sensing Image Classification and Retrieval
dc.contributor.author | Sumbul, Gencer | |
dc.contributor.author | de Wall, Arne | |
dc.contributor.author | Kreuziger, Tristan | |
dc.contributor.author | Marcelino, Filipe | |
dc.contributor.author | Costa, Hugo | |
dc.contributor.author | Benevides, Pedro | |
dc.contributor.author | Caetane, Mário | |
dc.contributor.author | Demir, Begüm | |
dc.contributor.author | Markl, Volker | |
dc.date.accessioned | 2022-01-20T07:22:11Z | |
dc.date.available | 2022-01-20T07:22:11Z | |
dc.date.issued | 2021-09-29 | |
dc.description.abstract | This article presents the multimodal BigEarthNet (BigEarthNet-MM) benchmark archive consisting of 590,326 pairs of Sentinel-1 and Sentinel-2 image patches to support deep learning (DL) studies in multimodal, multilabel remote sensing (RS) image retrieval and classification. Each pair of patches in BigEarthNet-MM is annotated with multilabels provided by the CORINE Land Cover (CLC) map of 2018 based on its thematically most detailed level-3 class nomenclature. Our initial research demonstrates that some CLC classes are challenging to accurately describe by considering only (single-date) BigEarthNet-MM images. In this article, we also introduce an alternative class nomenclature as an evolution of the original CLC labels to address this problem. This is achieved by interpreting and arranging the CLC level-3 nomenclature based on the properties of BigEarthNet-MM images in a new nomenclature of 19 classes. In our experiments, we show the potential of BigEarthNet-MM for multimodal, multilabel image retrieval and classification problems by considering several state-of-the-art DL models. | en |
dc.description.sponsorship | EC/H2020/759764/EU/Accurate and Scalable Processing of Big Data in Earth Observation/BigEarth | en |
dc.description.sponsorship | BMBF, 01IS18025A, Verbundprojekt BIFOLD-BBDC: Berlin Institute for the Foundations of Learning and Data | en |
dc.identifier.eissn | 2168-6831 | |
dc.identifier.issn | 2473-2397 | |
dc.identifier.uri | https://depositonce.tu-berlin.de/handle/11303/16171 | |
dc.identifier.uri | http://dx.doi.org/10.14279/depositonce-14945 | |
dc.language.iso | en | en |
dc.rights.uri | http://rightsstatements.org/vocab/InC/1.0/ | en |
dc.subject.ddc | 006 Spezielle Computerverfahren | de |
dc.subject.other | multi-modal learning | en |
dc.subject.other | multi-label image retrieval | en |
dc.subject.other | image classification | en |
dc.subject.other | deep learning | en |
dc.subject.other | remote sensing | en |
dc.subject.other | image retrieval | en |
dc.subject.other | benchmark testing | en |
dc.title | BigEarthNet-MM: A Large-Scale, Multimodal, Multilabel Benchmark Archive for Remote Sensing Image Classification and Retrieval | en |
dc.type | Article | en |
dc.type.version | acceptedVersion | en |
dcterms.bibliographicCitation.doi | 10.1109/MGRS.2021.3089174 | en |
dcterms.bibliographicCitation.issue | 3 | en |
dcterms.bibliographicCitation.journaltitle | IEEE Geoscience and Remote Sensing Magazine | en |
dcterms.bibliographicCitation.originalpublishername | Institute of Electrical and Electronics Engineers (IEEE) | en |
dcterms.bibliographicCitation.originalpublisherplace | New York, NY | en |
dcterms.bibliographicCitation.pageend | 180 | en |
dcterms.bibliographicCitation.pagestart | 174 | en |
dcterms.bibliographicCitation.volume | 9 | en |
tub.accessrights.dnb | free | en |
tub.affiliation | Fak. 4 Elektrotechnik und Informatik::Inst. Technische Informatik und Mikroelektronik::FG Remote Sensing Image Analysis Group | de |
tub.affiliation | Fak. 4 Elektrotechnik und Informatik::Inst. Softwaretechnik und Theoretische Informatik::FG Datenbanksysteme und Informationsmanagement (DIMA) | de |
tub.affiliation.faculty | Fak. 4 Elektrotechnik und Informatik | de |
tub.affiliation.group | FG Remote Sensing Image Analysis Group | de |
tub.affiliation.group | FG Datenbanksysteme und Informationsmanagement (DIMA) | de |
tub.affiliation.institute | Inst. Technische Informatik und Mikroelektronik | de |
tub.affiliation.institute | Inst. Softwaretechnik und Theoretische Informatik | de |
tub.publisher.universityorinstitution | Technische Universität Berlin | en |