In this talk we will propose a model for intelligence inspired by fluid dynamics. By modeling the dynamics of neural activity through a PDE, we achieve a number of interesting properties.
First, we observe that latent representations transform under sensory input transformations as waves, which are in turn well modeled as the evolution of a fluid. We can use this analogy to learn "disentangled representations" of the input, meaning that every input is embedded in a point in latent space which has associated to it a number of tangent directions in which the input transforms in prescribed ways (e.g. rotating, scaling, etc.). We can relate this to equivariant representations but for arbitrary transformations rather than symmetry groups. We show that this strong inductive bias can lead to the formation of topographic organization of neurons, and leads to good predictive performance. We also discuss the reverse, namely how to use deep learning to model PDEs better, in particular the Navier Stokes equations that model the weather.
Coffee, tea and cookies will be served at 15:30h. After the colloquium we will have beer and pretzels.
The direct link to the webcast is:
https://desy.zoom.us/j/99616528733
Meeting ID: 996 1652 8733
Meeting Password: 733220
The full DESY Particle and Astroparticle Physics Colloquium programme can be found under physikseminar.desy.de/hamburg