BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Michigan Institute for Computational Discovery and Engineering - ECPv6.15.20//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Michigan Institute for Computational Discovery and Engineering
X-ORIGINAL-URL:https://micde.umich.edu
X-WR-CALDESC:Events for Michigan Institute for Computational Discovery and Engineering
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/Detroit
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20240310T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20241103T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20260308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20261101T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Detroit:20250320T153000
DTEND;TZID=America/Detroit:20250320T163000
DTSTAMP:20260604T062651
CREATED:20241011T222200Z
LAST-MODIFIED:20250120T170935Z
UID:10000782-1742484600-1742488200@micde.umich.edu
SUMMARY:MICDE-EECS Seminar: Mikhail Belkin\, Professor\, University of California San Diego
DESCRIPTION:Bio: Mikhail Belkin is a Professor at Halicioglu Data Science Institute and Computer Science and Engineering Department at UCSD and an Amazon Scholar. Prior to that he was a Professor at the Department of Computer Science and Engineering and the Department of Statistics at the Ohio State University. He received his Ph.D. from the Department of Mathematics at the University of Chicago (advised by Partha Niyogi). His research interests are broadly in theory and applications of machine learning\, deep learning and data analysis. Some of his well-known work includes widely used Laplacian Eigenmaps\, Graph Regularization and Manifold Regularization algorithms\, which brought ideas from classical differential geometry and spectral graph theory to data science. His more recent work has been concerned with understanding remarkable mathematical and statistical phenomena observed in deep learning. The empirical evidence necessitated revisiting some of the classical concepts in statistics and optimization\, including the basic notion of over-fitting. One of his key findings has been the “double descent” risk curve that extends the textbook U-shaped bias-variance trade-off curve beyond the point of interpolation. His recent work focusses on understanding feature learning and over-parameterization in deep learning. Mikhail Belkin is an ACM Fellow and a recipient of a NSF Career Award and a number of best paper and other awards. He had served on the editorial boards of IEEE Proceedings on Pattern Analysis Machine Intelligence and the Journal of the Machine Learning Research. He is the editor-in-chief of SIAM Journal on Mathematics of Data Science (SIMODS). \nEmergence and grokking in “simple” architectures\nAbstract: In recent years\, transformers have become a dominant machine learning methodology.\nA key element of transformer architectures is a standard neural network (MLP). I argue that MLPs alone already exhibit many remarkable behaviors observed in modern LLMs\, including emergent phenomena. Furthermore\, despite large amounts of work\, we are still far from understanding how 2-layer MLPs learn relatively simple problems\, such as “grokking” modular arithmetic. I will discuss recent progress and argue that feature-learning kernel machines (Recursive Feature Machines) isolate some key computational aspects of modern neural architectures and are preferable to MLPs as a model for analysis of emergent phenomena.
URL:https://micde.umich.edu/event/mikhail-belkin/
LOCATION:1311 EECS\, 1301 Beal Ave.\, Ann Arbor\, MI\, 48109\, United States
CATEGORIES:Micde,Micde Seminar
ATTACH;FMTTYPE=image/png:https://micde.umich.edu/wp-content/uploads/2024/10/Mikhail-Belkin-2.png
GEO:42.292322;-83.713272
X-APPLE-STRUCTURED-LOCATION;VALUE=URI;X-ADDRESS=1311 EECS 1301 Beal Ave. Ann Arbor MI 48109 United States;X-APPLE-RADIUS=500;X-TITLE=1301 Beal Ave.:geo:-83.713272,42.292322
END:VEVENT
END:VCALENDAR