Early Brain Damage

By Volker Tresp, Ralph Neuneier, Hans-Georg Zimmermann. 1996

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Jonathan Frankle
2. Davis W. Blalock
3. Jose Javier Gonzalez Ortiz
4. John V. Guttag
5. Mohamed Elsayed
6. A. Rupam Mahmood
7. Tianlong Chen
8. Mingjie Sun

Citations in the corpus

• What is the State of Neural Network Pruning? (2020, methodology): “…with Han et al. (2015) reintroducing the magnitude-based pruning of Janowsky (1989), Lee et al. (2019b) reintroducing the saliency heuristic of Mozer & Smolensky (1989a), and He et al. (2018a) reintroducing the practice of “reviving” previously pruned weights described in Tresp et al. (1997).”
• Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning (2024, background): “…as the weight magnitude (e.g., Han et al. 2015, Park et al. 2020), first-order information (e.g., Mozer & Smolensky 1988, Hassibi & Stork 1992, Molchanov et al. 2016), second-order information (e.g., LeCun et al. 1989, Dong et al. 2017), or both (e.g., Tresp et al. 1996, Molchanov et al. 2019).”