MERLIN: A self-supervised strategy to train deep despeckling networks

When a highly coherent light beam, such as that emitted by radars, is diffusely reflected on a surface with a rough structure (e.g., a piece of paper, white paint or a metallic surface), it produces a random granular effect known as the 'speckle' pattern. This effect results in strong fluctuations that can reduce the quality and interpretability of images collected by synthetic aperture radar (SAR) techniques.

SAR is an imaging method that can produce fine-resolution 2D or 3D images using a resolution-limited radar system. It is often employed to collect images of landscapes or object reconstructions, which can be used to create millimeter-to-centimeter scale models of the surface of Earth or other planets.

To improve the quality and reliability of SAR data, researchers worldwide have been trying to develop techniques based on deep neural networks that could reduce the speckle effect. While some of these techniques have achieved promising results, their performance is still not optimal.

One reason for this is that most existing models learn to de-speckle images through a supervised learning process, which means that they also require speckle-free images during training. This can make training them very challenging, as speckle-free SAR images are typically unavailable and thus need to be fabricated or substituted with other images.

A team of researchers at the Polytechnic Institute of Paris and University of Lyon have recently introduced a new self-supervised learning strategy for training deep neural networks to reduce speckle effects in SAR data. This method was introduced in a paper pre-published on arXiv and set to appear on IEEE Transactions on Geoscience and Remote Sensing.

"So far, most approaches have considered a supervised training strategy, where the networks are trained to produce outputs as close as possible to speckle-free reference images," Emanuele Dalsasso, Loic Denis and Florence Tupin, the researchers who carried out the study, told TechXplore. "Speckle-free images are generally not available, which requires resorting to natural or optical images or the selection of stable areas in long time series to circumvent the lack of ground truth. Self-supervision, on the other hand, avoids the use of speckle-free images."

The new strategy for training despeckling deep neural network-based models introduced by this team of researchers was dubbed MERLIN (coMplex Self-supeRvised despeckLINg). MERLIN works by separating real and 'imaginary' parts of complex SAR images.

Remarkably, the strategy can be used to train all types of deep neural network architectures. Contrarily to previously proposed approaches, it is fully unsupervised and allows researchers to train despeckling models using single-look complex (SLC) images. SLC images are images generated from raw SAR data where individual image pixels contain amplitude and phase-related information.

https://techxplore.com/news/2021-11-merlin-self-supervised-strategy-deep-despeckling.html