Michael Andersch
Artificial Intelligence · 2022
A researcher in the Science corpus: 1 paper; trusts 4 researchers and is trusted by 0 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 15 citations into it
- Efficiency & Compression — 15 citations into it
- Hardware and Architecture — 10 citations into it
Whom Michael Andersch trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
Papers from Michael Andersch's perspective
Ordered by how strongly the researchers Michael Andersch trusts endorse each paper. Same corpus, a different order for every researcher.
- Language Models are Few-Shot Learners (Neural Information Processing Systems)
- Training Deep Nets with Sublinear Memory Cost
- GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
- ZeRO-Offload: Democratizing Billion-Scale Model Training
- Mesh-TensorFlow: Deep Learning for Supercomputers
- Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
- PipeDream: generalized pipeline parallelism for DNN training
- ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep learning
- Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM
- DeepSpeed: System Optimizations Enable Training Deep Learning Models with Over 100 Billion Parameters
Their papers
- Reducing Activation Recomputation in Large Transformer Models (2022) — 492 citations