pipeDejavu: Hardware-aware Latency Predictable, Differentiable Search for Faster Config and Convergence of Distributed ML Pipeline Parallelism
python deep-learning linear-regression pytorch dynamic-programming predictive-modeling data-parallelism sampling-methods model-parallelism distributed-training differentiable-programming pipeline-parallelism hardware-aware parallel-optmization random-initialization baysian-optimisation differentiable-dynamic-programming
-
Updated
May 9, 2023 - Jupyter Notebook