๐Ÿ“–
On the Benefits of SO(3)-Equivariant Neural Networks for Spherical Image Processing
Simon Martin, Pierre-Yves Lagrave

On the Benefits of SO(3)-Equivariant Neural Networks for Spherical Image Processing

Author / Organization:
Science & Mathematics Published 2022 Verification Pending

Overview & Synopsis

This paper deals with the use of SO(3)-Equivariant Neural Networks for processing spherical images such as those acquired with bi-directional fish-eye lenses. By using Generative Adversarial Networks trained on the Planesnet dataset to generate augmented training sets, we first confirm recent results according to which the use of SO(3)-equivariance mechanisms is more efficient than training data augmentation techniques for processing data with a native spherical geometry. We then explain how the action of SO(3) on the 2d-sphere can be projected on tangent planes, leading to an equivalent reformulation of the SO(3)-convolution operator in euclidean spaces and allowing to achieve a wider range of robustness properties through the design of appropriate local pooling mechanisms. Finally, we articulate our projected SO(3) convolution with recent works on fish-eye image processing in which SU(1, 1) and SL(2, R) Equivariant Neural Networks are coupled with hyperbolic projection mechanisms, drawing the path toward a consolidated approach for processing inputs represented as signals on homogeneous spaces.

Indexed from repository: HAL Open Science (hal.science)
Loading document from verified source...
Keyboard Shortcuts: ← / → for pages • + / - for zoom • 0 to fit width Powered by Mozilla PDF.js v3.11

Document Information

Document Title On the Benefits of SO(3)-Equivariant Neural Networks for Spherical Image Processing
Author / Organization Simon Martin, Pierre-Yves Lagrave
Subject & Discipline Multidisciplinary Academic Open Research
Categories Science & Mathematics
Publication Year 2022
License / Rights Open Access / Creative Commons
Resource Verification Listed PDF (Verification Pending)
Original Host Website HAL Open Science (hal.science)
File Format application/pdf (Portable Document Format)
Language EN
Catalog ID DOC-232292
Original Source Link Visit Source Page on hal.science »