On the Benefits of SO(3)-Equivariant Neural Networks for Spherical Image Processing
Overview & Synopsis
This paper deals with the use of SO(3)-Equivariant Neural Networks for processing spherical images such as those acquired with bi-directional fish-eye lenses. By using Generative Adversarial Networks trained on the Planesnet dataset to generate augmented training sets, we first confirm recent results according to which the use of SO(3)-equivariance mechanisms is more efficient than training data augmentation techniques for processing data with a native spherical geometry. We then explain how the action of SO(3) on the 2d-sphere can be projected on tangent planes, leading to an equivalent reformulation of the SO(3)-convolution operator in euclidean spaces and allowing to achieve a wider range of robustness properties through the design of appropriate local pooling mechanisms. Finally, we articulate our projected SO(3) convolution with recent works on fish-eye image processing in which SU(1, 1) and SL(2, R) Equivariant Neural Networks are coupled with hyperbolic projection mechanisms, drawing the path toward a consolidated approach for processing inputs represented as signals on homogeneous spaces.
hal.science)
← / → for pages • + / - for zoom • 0 to fit width
Powered by Mozilla PDF.js v3.11
Document Information
| Document Title | On the Benefits of SO(3)-Equivariant Neural Networks for Spherical Image Processing |
|---|---|
| Author / Organization | Simon Martin, Pierre-Yves Lagrave |
| Subject & Discipline | Multidisciplinary Academic Open Research |
| Categories | Science & Mathematics |
| Publication Year | 2022 |
| License / Rights | Open Access / Creative Commons |
| Resource Verification | Listed PDF (Verification Pending) |
| Original Host Website |
HAL Open Science
(hal.science)
|
| File Format | application/pdf (Portable Document Format) |
| Language | EN |
| Catalog ID | DOC-232292 |
| Original Source Link | Visit Source Page on hal.science » |