ML Theory Seminar Prof. Song Mei from UC Berkeley Statistics is giving a seminar talk on neural network approximation theory in the modern age. The talk will be on Friday (Dec 1st) 12:30 pm -1:30 pm at Equad B205. =============================================================== Title: Revisiting neural network approximation theory in the age of generative AI Abstract: Textbooks on deep learning theory primarily perceive neural networks as universal function approximators. While this classical viewpoint is fundamental, it inadequately explains the impressive capabilities of modern generative AI models such as language models and diffusion models. This talk puts forth a refined perspective: neural networks often serve as algorithm approximators, going beyond mere function approximation. I will explain how this refined perspective offers a deeper insight into the success of modern generative AI models. Bio: Song Mei is an assistant professor of statistics and EECS at UC Berkeley. He received his Ph.D. from Stanford in June 2020. Song’s research lies at the intersection of statistics and machine learning. His recent research focuses on mathematics of deep learning and foundation models, theory of reinforcement learning, and high dimensional statistics.