Xu Cao (IrohXu)inNerd For TechAn Overview of Pipeline Parallelism and its Research ProgressKeywords: Deep Neural Network, Distributed System, Pipeline Parallelism, GPipe, PipeDream, DAPPLE, PipeMareApr 27, 2021Apr 27, 2021
