Understanding SSIM

Research output: Book/ReportReportResearch


The use of the structural similarity index (SSIM) is widespread. For almost two decades, it has played a major role in image quality assessment in many different research disciplines. Clearly, its merits are indisputable in the research community. However, little deep scrutiny of this index has been performed. Contrary to popular belief, there are some interesting properties of SSIM that merit such scrutiny. In this paper, we analyze the mathematical factors of SSIM and show that it can generate results, in both synthetic and realistic use cases, that are unexpected, sometimes undefined, and nonintuitive. As a consequence, assessing image quality based on SSIM can lead to incorrect conclusions and using SSIM as a loss function for deep learning can guide neural network training in the wrong direction.
Original languageEnglish
Number of pages8
Publication statusPublished - 2020 Jun 29
Externally publishedYes


Dive into the research topics of 'Understanding SSIM'. Together they form a unique fingerprint.

Cite this