Skip to content (access key 's')
Logo of Technion
Logo of CS Department
Logo of CS4People

The Taub Faculty of Computer Science Events and Talks

Data Science & Deep Learning: Algorithmic Bias in Neural Networks: From Parameters to Function Space
event speaker icon
Daniel Soudry (EE, Technion)
event date icon
Monday, 04.11.2019, 12:30
event location icon
Taub 301 Taub Bld.
In many common datasets, neural networks can achieve zero training loss yet generalize well to unseen data. Recent works suggest that this because standard training algorithms (e.g., GD or SGD) have an implicit regularization which is biased towards specific solutions, which tend to have good generalization. I will review such "algorithmic biases", how they affect the functional capabilities of the neural networks, and how this relates to generalization in simple models.