You asked for “all” the generalizations of convolution. Cute. Here’s the map so you don’t get lost in the algebraic jungle.

The unifying lens

Convolution is the unique linear operator that’s equivariant to a group action. Plain CNNs: group = translations on ℝ^d. General form:

(f * \psi)(x)=\int_G f(g\!\cdot\! x)\,\psi(g^{-1})\,d\mu(g)

Swap out the group G, the measure \mu, the algebra you’re working in, or make the kernel data-dependent, and you’ve got the zoo.


1) Change the symmetry group / domain


2) Change the topology: graphs and friends

Two main views:

Spectral: filter in the graph Fourier basis.