The SEN12-Flood datasets was uploaded on the IEEE Dataport:
https://ieee-dataport.org/open-access/sen12-flood
This dataset is composed of co-registered optical and SAR images time series for the detection of flood events. The Sentinel-2 images were obtained from the Mediaeval 2019 Multimedia Satellite Task [1] and are provided with Level 2A atmospheric correction. For one acquisition, there are 12 single-channel raster images provided corresponding to the different spectral bands. The Sentinel-1 images were added to the dataset. These images are provided with radiometric calibration and range doppler terrain correction based on the SRTM digital elevation model. For one acquisition, two raster images are available corresponding to the polarimetry channels VV and VH. Please follow the provided link for further details.
[1] Bischke, B., Helber, P., Schulze, C., Srinivasan, V., Dengel, A.,Borth, D., 2019. The Multimedia Satellite Task at MediaEval2019. In Proc. of the MediaEval 2019 Workshop.
A presentation of the problem and dataset, together with some results are provided in:
Flood detection in time series of optical and sar images. In International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLIII-B2-2020: 1343-1346, 2020. doi www
Earth Observation Data Science and Beyond
Conférence de clôture de la Chaire d’excellence internationale Blaise Pascal attribuée en 2017 à Mihai Datcu
Lieu et date :
Mardi 18 février 2020, 9h30-12h45, au Conservatoire national des arts et métiers (Cnam), 292 rue St Martin, Paris 3ème, amphi Jean Baptiste Say (amphi Y, voir http://www.cnam.fr/adresses-et-plans/, lien « Amphithéâtres et salles de conférence »)
Programme :
09h30-10h00 : Accueil café
10h00-10h30 : Allocutions d’introduction
Olivier Faron
Administrateur Général du Conservatoire National des Arts et Métiers
Cendrine Cruzille
Directrice de la recherche et des transferts de technologies à la région Île-de-France
Philippe Bidaud
Scientific Director for Information Processing and Intelligent Systems in ONERA, and Professor at Université Pierre et Marie Curie
10h30 -11h15 : présentation par Mihai Datcu « Earth Observation Data Science and beyond ». Vous pouvez voir les transparents projetés et écouter l’enregistrement audio de la conférence.
11h15 -12h30 : Table ronde « Artificial Intelligence for Earth Observation: present and future », animée par Mihai Datcu avec la participation de :
- Prof. Mioara Mandea, Solid Earth Programme Manager Innovation, Application and Science Directorate, CNES – Centre National d’Etudes Spatiales, Paris
- Dr. Elise Koeniguer, Ingénieur de recherche au Département Traitement de l’Information et Systèmes, ONERA, Palaiseau
- Prof. Patrick Gallinari, Machine Learning and Information Access, LIP6, Sorbonne Universités
- Dr. Patrick Gatellier, Coordinator of the AI On-Demand European platform: AI4EU, Thales
Vous pouvez voir l’enregistrement vidéo de la table ronde.
12h30 : Remerciements par Michel Crucianu, Professeur de sciences informatiques, Cnam
Résumé :
Satellites are the only global Earth Observation (EO) data source. The field of EO is presently at a key turning point, EO Big Data are now freely and openly accessible, the areas of Artificial Intelligence (AI) are explosively progressing and the computational and communication capacities are immense. This context and trends bring the AI paradigms and EO methodologies and applications in a new era. The theoretical and technological progress is amplifying the use of the EO broadening the impact in all major domains, climate, food security, urbanization, only to enumerate few. The presentation is an overview of the achievements in the frame of the International Blaise Pascal Chair of Excellence for EO Data Science in these areas, concluding with a vision of the AI4EO domains.
Seminar on Satellite Image Time Series
On 31/01/2020 at IGN, 73 avenue de Paris, 94160 Saint-Mandé
Building A Room 182 (first floor)
Registration via email: Vivien.Sainte-Fare-Garnot@ign.fr
Agenda:
10:00 – 11:00
Artificial Intelligence for Satellite Image Time Series
Mihai Datcu (Blaise Pascal Chair)
11:00 – 11:30
Joint exploitation of optical and SAR satellite imagery for vegetation monitoring
Anatol Garioud (LASTIG-IGN)
11:30 – 12:00
Satellite image time series classification with pixel-set encoders and temporal self-attention
Vivien Sainte Fare Garnot (LASTIG-IGN)
12:00-12:30 Round table and conclusions
Compression Based Pattern Recognition: Data Content Communication Channels
Talk by Mihai Datcu
CNAM, room 21.1.05, 10:30 – 12:00, January 23, 2020
The implicit data models and the expected parameters on which they are dependent may introduce biases in the Earth Observation (EO) data analysis methodologies. The estimated parameters can describe only particular, limited observations behavior. The broad diversity of the EO data, as sensing modalities, spatial, spectral, and radiometric resolution, and also the huge variety of the observed scenes make problematic the definition of a general model.
The lecture presents a communication channel approach for image information extraction. The information retrieval is elaborated based on data compression methods independent of the type, form, content or purpose of the data. This paradigm is common to any data type without the weakening effect of specializing it for specific, particular applications fields. This is realized by approaching these challenges from an Information Theoretic perspective and using also the latest progress in Algorithmic Information Theory. The objective is re-formulating the definition of the “relevant information” in relation to the notions of “image content” and “context”, for a broader class of data, including scientific and engineering instruments records.
Satellite Image Time Series Analysis
Talk by Mihai Datcu
CNAM, room 31.3.10 (accès 31, 3rd floor), 10:00 – 12:00, November 20, 2019
Since the very beginning of satellite remote sensing the methods and applications the Satellite Image Time Series (SITS) are the main nature of Earth Observation. Presently, with the regular observations and free and open access of the Copernicus data the impact of SITS is largely amplified. The challenges of the EO Big Data are critically accentuated due to joint volume explosion, high acquisition velocity and sensor variety.
The presentation emphasizes novel Artificial Intelligence (AI) paradigms to convert the SITS into valuable EO products with impact in new applications for understanding of the Earth cover spatio-temporal processes over long periods of time. AI for EO is largely an interdisciplinary field and involves the convergence of very different methods. The lecture overviews and discuss specific topics for SITS regarding the orbit, mission, sensor constellations, intelligent agents, machine learning, deep learning, data indexing, data bases, and DNN.
Artificial Intelligence for Very High Resolution Earth Observation: Environment Monitoring
Talk by Mihai Datcu
(Campus Pierre et Marie Curie de Sorbonne Université, salle 105 du LIP6 couloir 25-26 au 1er étage, 14:30 – 16:00, April 5th, 2019)
The Earth is facing unprecedented climatic, geomorphologic, environmental and anthropogenic changes, which require global scale observation and monitoring. Thus a multitude of new orbital and suborbital Earth Observation (EO) sensors and mission are in operation or will be soon launched. The interest is in a global understanding involving observation of large extended areas, and long periods of time, with a broad variety of EO sensors. The collected EO data volumes are thus increasing immensely with a rate of many Terabytes of data a day. With the current EO technologies these figure will be soon amplified, the horizons are beyond Zettabytes of data. The challenge is the exploration of these data and the timely delivery of focused information and knowledge in a simple understandable format.
Therefore, search engines, and Data Mining are new fields of study that have arisen to seek solutions to automating the extraction of information from EO observations and other related sources that can lead to Knowledge Discovery and the creation of an actionable intelligence. Knowledge Discovery is among the most interesting research trends, however, the real challenge is to combine Artificial Intelligence with the power and potential of human intelligence, this being a primary objective in the field of Human Machine Communication (HMC). The goal is to go beyond the today methods of information retrieval and develop new concepts and methods to support end users of EO data to interactively analyze the information content, extract relevant parameters, associate various sources of information, learn and/or apply knowledge and to visualize the pertinent information without getting overwhelmed. In this context, the synergy of HMC and information retrieval becomes an interdiscipl!
inary approach in automating EO data analysis.
Post-doc: Change Detection and Semantic Classification for Multimodal SAR / Optical Data time series
Post-doc jointly proposed by Cnam and ONERA, with a duration of 18 to 21 months, see the detailed proposal. Starting date: as soon as possible.
Artificial Intelligence Training and Benchmarking for Earth Observation: Data Sets and Procedures
Talk by Mihai Datcu
(CNAM, Amphitheatre Jean Prouvé (accès 11), 10:30 – 12:00, November 29, 2018)
Artificial Intelligence (AI), i.e. machine and deep learning methods are mainly used for image classification or object segmentation. The data sets are an organic part of the learning process, and also of the performance evaluation of the algorithms. High and particularly very high-resolution (VHR) Earth Observation (EO) applications primarily aim at the semantic labeling of land cover structures or objects as well as of temporal evolution classes. Therefore, we need reliable labeled data sets and tools to train the developed algorithms and assess the performance of the AI paradigms.
The lecture introduces solutions for very specific EO cases as VHR multispectral, Synthetic Aperture Radar (SAR) and multi-temporal observations. Further are described and discussed procedures and machine learning based tools to generate large semantic training and benchmark data sets. The particularities of relative data set biases and cross-dataset generalization are reviewed and an algorithmic analysis frame is introduced. Finally, are reviewed and analyzed several examples of EO benchmark data sets.
Mihai Datcu became Distinguished Lecturer for the IEEE Geoscience and Remote Sensing Society
Mihai Datcu became Distinguished Lecturer for the IEEE Geoscience and Remote Sensing Society, proposing lectures in 5 languages on the topics of Earth Observation Data Intelligence, and Knowledge Discovery and Artificial Intelligence for Earth Observation.
http://www.grss-ieee.org/education/distinguished-lecturers/
The Earth Observation Sensory Gap: from Bayesian Inference to Deep Learning
Talk by Mihai Datcu
(TerraData Workshop: ESIEE, Cité Descartes, 6 – 8 avenue Blaise Pascal, Marne la Vallée, June 25th, 2018, 14:00)
The sensory gap is the dissimilarity between the actual nature of an object and the information extracted from the signals recorded by a sensor observing this object. Earth Observation (EO) images are sensor records, gathering the signature of the observed scenes in a specific electromagnetic spectrum, therefore an indirect signature of the imaged scenes. The challenge is in inverting the physically meaningful parameters of the scene from these observations. The lecture is presenting a communication channel model for the parameter retrieval problem. The source is the ensemble of EO data, and the information contained in the data is a message. Modeling the data processing chain as a communication channel allows measuring and quantifying the amount of information each feature descriptor can provide about a set of images. The generative Bayesian models, as Latent Dirichlet Allocation (LDA), Restricted Boltzmann Machine, Generative Adversarial Networks and the latest Deep Learning paradigms are discussed and exemplified as solutions for the EO sensory gap.