Skip to content

Commit

Permalink
feat: new slide set covering issue #47 (#88)
Browse files Browse the repository at this point in the history
* feat: new slide set covering issue #47

* fix: identation of sample code
  • Loading branch information
cmeesters authored Aug 23, 2024
1 parent 0b2d74f commit ddab9c7
Show file tree
Hide file tree
Showing 2 changed files with 66 additions and 0 deletions.
3 changes: 3 additions & 0 deletions slides/Snakemake_HPC_Users.tex
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,9 @@
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\include{common/using_wrappers}

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\include{common/Fine_Tuning}

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
% \include{common/Contributing}
\end{document}
Expand Down
63 changes: 63 additions & 0 deletions slides/common/Fine_Tuning.tex
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\section{Fine Tuning Cluster Behaviour}
{
\usebackgroundtemplate{
\vbox to \paperheight{\vfil\hbox to \paperwidth{\hfil\includegraphics[height=.7\paperheight]{misc/radio-am-und-fm-tuner.png}\hfil}\vfil}
}
\frame{
\frametitle{Fine Tuning!}
\begin{mdframed}[tikzsetting={draw=white,fill=white,fill opacity=0.8,
line width=0pt},backgroundcolor=none,leftmargin=0,
rightmargin=150,innertopmargin=4pt,roundcorner=10pt]
\tableofcontents[currentsection,sections={1-4},hideothersubsections]
\end{mdframed}
}
}

%<a href="https://www.flaticon.com/de/kostenlose-icons/radio" title="radio Icons">Radio Icons erstellt von Freepik - Flaticon</a>

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\begin{frame}
\frametitle{What is this about?}
\begin{question}[Questions]
\begin{itemize}
\item What if I really need to submit \textbf{\textsc many} jobs?
\item Will crash the cluster?
\item My admins report a slow accounting DB. How do I cope with that?
\end{itemize}
\end{question}
\begin{docs}[Objectives]
\begin{enumerate}
\item Learning how throttle job submission with \Snakemake{}.
\item Knowing how to limit the status request from \Snakemake to SLURM.
\end{enumerate}
\end{docs}
\end{frame}

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\begin{frame}[fragile]
\frametitle{Limiting Job Submission Rates}
\begin{docs}
We can limit the number of jobs submitted per second with the \altvberb{--max-jobs-per-second} flag.\newline
\emph{However}, this is only necessary, when dealing with an enormous load of jobs ($\gg$ 1.000 -- 10.000 jobs)\newline\pause
The default is 10 per second.
\end{docs}
\begin{lstlisting}[language=Bash, style=Shell]
$ snakemake --max-job-per-second=0.1
\end{lstlisting}
The value may be a fraction (here: 1 job per ten seconds). Or simply
\begin{lstlisting}[language=Bash, style=Shell]
$ snakemake --max-job-per-second=5
\end{lstlisting}
which would half the submission rate (5 instead of 10)
\end{frame}

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
\begin{frame}[fragile]
\frametitle{Limiting Job Status Queries}
\begin{docs}
The SLURM executor plugin has its own limiter and ensures that the accounting data base is not overwhelmed.\newline
The \altverb{--max-status-checks-per-second} flag allows us to throttle the number of status queries per second.\newline
The default is at 10. -- Usefull for local jobs, only.
\end{docs}
\end{frame}

1 comment on commit ddab9c7

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented on ddab9c7 Aug 23, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Artifacts

Please # to comment.