Graph Spectral Image Processing. Gene Cheung

Чтение книги онлайн.

Figure I.1. Visual comparison of JPEG dequantization methods for a butterfly at QF = 5. The corresponding PSNR values are also given. For a color version of this figure, see www.iste.co.uk/cheung/graph.zip

      3) Deep Neural Networks: Without a doubt, the singular seismic paradigm shift in data science in the last decade is deep learning. Using layers of convolutional filters, pointwise nonlinearities and pooling functions, deep neural network (DNN) architectures like convolutional neural networks (CNN) have demonstrated superior performance in a wide range of imaging tasks from denoising to classification, when a large volume of labeled data is available for training (Vemulapalli et al. 2016; Zhang et al. 2017). When labeled training data is scarce, or when the underlying data kernel is irregular (thus complicating the training of convolutional filters and the selection of pooling operators), how to best design and construct DNN for a targeted image application is a challenging problem. Moreover, a CNN purely trained from labeled data often remains a “black box”, i.e. the learned operators like filtering remain unexplainable.

Motivated by these technological trends, we have focused this book on the theory and applications of GSP tools for image processing, covering conventional images and videos, new modalities like light fields and 3D point clouds, and hybrid GSP/deep learning approaches. Different from other graph-based image processing books (Lezoray and Grady 2012), we concentrate on spectral processing techniques with frequency interpretations such as graph Fourier transforms (GFT) and graph wavelets, drawing inspiration from the long history of frequency analysis tools in traditional signal processing. Graph frequency analysis enables the definition of familiar signal processing notions, such as graph Fourier modes, bandlimitedness, and signal smoothness, using graph spectral methods that can be designed.

      Specifically, the content of this book is structured into two parts:

      1) The first part of the book discusses the fundamental GSP theories. Chapter 1, titled “Graph Spectral Filtering” by Y. Tanaka, reviews the basics of graph filtering such as graph transforms and wavelets. Chapter 2, titled “Graph Learning” by X. Dong, D. Thanou, M. Rabbat and P. Frossard, reviews recent techniques to learn an underlying graph structure given a set of observable data. Chapter 3, titled “Graph Neural Networks” by G. Fracastoro and D. Valsesia, overviews recent works generalizing DNN architectures to the graph data domain, where input signals reside on irregular graph structures.

      2) The second part of the book reviews different imaging applications of GSP. Chapters 4 and 5, titled “Graph Specral Image and Video Compression” by H.E. Egilmez, Y.-H. Chao and A. Ortega and “Graph Spectral 3D Image Compression” by T. Maugey, M. Rizkallah, N. M. Bidgoli, A. Roumy and C. Guillemot, focus on the design and applications of GSP tools for the compression of traditional images/videos and 3D images, respectively. Chapter 6, titled “Graph Spectral Image Restoration” by J. Pang and J. Zeng, focuses on the general recovery of corrupted images, e.g. image denoising and deblurring. As a new imaging modality, Chapter 7, titled “Graph Spectral Point Cloud Processing” by W. Hu, S. Chen and D. Tian, focuses on the processing of 3D point clouds for applications, such as low-level restoration and high-level unsupervised feature learning. Chapters 8 and 9, titled “Graph Spectral Image Segmentation” by M. Ng and “Graph Spectral Image Classification” by M. Ye, V. Stankovic, L. Stankovic and G. Cheung, narrow the discussion specifically to segmentation and classification, respectively, two popular research topics in the computer vision community. Finally, Chapter 10, titled “Graph Neural Networks for Image Processing” by G. Fracastoro and D. Valsesia, reviews the growing efforts to employ recent GNN architectures for conventional imaging tasks such as denoising.

      Before we jump into the various chapters, we begin with the basic definitions in GSP that will be used throughout the book. Specifically, we formally define a graph, graph spectrum, variation operators and graph signal smoothness priors in the following sections.

I.2. Graph definition

      A graph G(V, E, W) contains a set V of N nodes and a set E of M edges. While directed graphs are also possible, in this book we more commonly assume an undirected graph, where each existing edge (i, j) ∈ E is undirected and contains an edge weight w_i,j ∈ R, which is typically positive. A large positive edge weight w_i,j would mean that samples at nodes i and j are expected to be similar/correlated.

      There are many ways to compute appropriate edge weights. Especially common for images, edge weight w_i,j can be computed using a Gaussian kernel, as done in the bilateral filter (Tomasi and Manduchi 1998):

      [I.1]

      where l_i ∈ R² is the location of pixel i on the 2D image grid, x_i ∈ R is the intensity of pixel i, and

A graph signal x on G is a discrete signal of dimension N – one sample x_i ∈ R for each node¹ i СКАЧАТЬ