Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

adding tutorial docs for DataParallel, ZeroOptimizer #170

Merged
merged 1 commit into from
May 11, 2023
Merged

adding tutorial docs for DataParallel, ZeroOptimizer #170

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/.buildinfo
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 9511c0609654d283edf3477a65e84083
config: 6a7a9cb54d9ab2728b51824ec90997d3
tags: 645f666f9bcd5a90fca523b33c5a78b7
2 changes: 2 additions & 0 deletions docs/CONCEPTS/data_parallelism.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down
2 changes: 2 additions & 0 deletions docs/CONCEPTS/dp/zero_algorithm.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -129,6 +129,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down
2 changes: 2 additions & 0 deletions docs/CONCEPTS/parallel_context.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down
8 changes: 5 additions & 3 deletions docs/CONCEPTS/tensor_model_parallelism.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@
<script>DOCUMENTATION_OPTIONS.pagename = 'CONCEPTS/tensor_model_parallelism';</script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
<link rel="next" title="Tensor Model Parallelism Tutorial" href="../TUTORIALS/tensor_model_parallelism.html" />
<link rel="next" title="Data Parallelism Tutorial" href="../TUTORIALS/data_parallelism.html" />
<link rel="prev" title="Concept of Data Parallelism" href="data_parallelism.html" />
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
Expand Down Expand Up @@ -131,6 +131,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down Expand Up @@ -339,11 +341,11 @@ <h3>References<a class="headerlink" href="#references" title="Permalink to this
</div>
</a>
<a class="right-next"
href="../TUTORIALS/tensor_model_parallelism.html"
href="../TUTORIALS/data_parallelism.html"
title="next page">
<div class="prev-next-info">
<p class="prev-next-subtitle">next</p>
<p class="prev-next-title">Tensor Model Parallelism Tutorial</p>
<p class="prev-next-title">Data Parallelism Tutorial</p>
</div>
<i class="fa-solid fa-angle-right"></i>
</a>
Expand Down
2 changes: 2 additions & 0 deletions docs/CONCEPTS/tp/1d_parallel_algorithm.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -129,6 +129,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down
2 changes: 2 additions & 0 deletions docs/CONCEPTS/tp/2d_parallel_algorithm.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -129,6 +129,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down
2 changes: 2 additions & 0 deletions docs/CONCEPTS/tp/2p5d_parallel_algorithm.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -129,6 +129,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down
2 changes: 2 additions & 0 deletions docs/CONCEPTS/tp/3d_parallel_algorithm.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -129,6 +129,8 @@
</ul>
<p aria-level="2" class="caption" role="heading"><span class="caption-text">TUTORIALS</span></p>
<ul class="nav bd-sidenav">
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/data_parallelism.html">Data Parallelism Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/zero_redundancy_optimizer.html">Zero redundancy optimizer Tutorial</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../TUTORIALS/tensor_model_parallelism.html">Tensor Model Parallelism Tutorial</a></li>
</ul>

Expand Down
Loading