Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

CI: caching: add early termination & run check on schedule #2506

Merged
merged 4 commits into from
Dec 21, 2021
Merged

CI: caching: add early termination & run check on schedule #2506

Changes from 2 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
05f73ba
CI: caching: add early termination
Anton-Latukha Dec 19, 2021
bab8157
CI: caching: run cache check 3 times a day
Anton-Latukha Dec 18, 2021
0308f15
Merge branch 'master' into 2021-12-18-keep-main-cache-by-schedule
jneira Dec 21, 2021
2dce1ed
Merge branch 'master' into 2021-12-18-keep-main-cache-by-schedule
mergify[bot] Dec 21, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 20 additions & 3 deletions .github/workflows/caching.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,18 @@ on:
push:
branches:
- master
schedule:
# Refresh snapshot every (02+8*x):25 UTC
# When cache is present it is a light check workflow with early termination.
# When primary cache is not hit - runs the cache generation.
# Why: GitHub repo has 10G pool & on overflow GitHub removes caches in FIFO manner.
# When internal branche PRs save into the same pool -
# their cache is accessible only inside of the scope of the PR.
# If main cache is forced out - there are no cache shared between PRs,
# which implies all PRs would start to create & save their cache.
# Reinstitution of the main chache puts it back into FIFO
# & so it gets shared across all PRs.
- cron: "25 2/8 * * *"

env:
cabalBuild: "v2-build all --enable-tests --enable-benchmarks"
Expand Down Expand Up @@ -130,6 +142,7 @@ jobs:
restore-keys: ${{ env.cache-name }}-

- name: Compiled deps cache
id: compiled-deps
uses: actions/cache@v2
env:
cache-name: compiled-deps
Expand All @@ -141,9 +154,12 @@ jobs:
${{ env.cache-name }}-${{ runner.os }}-${{ matrix.ghc }}-
${{ env.cache-name }}-${{ runner.os }}-

- run: cabal update
- if: (! steps.compiled-deps.outputs.cache-hit)
run: |
cabal update

- name: Download all sources
- if: (! steps.compiled-deps.outputs.cache-hit)
name: Download all sources
run: |
cabal $cabalBuild --only-download

Expand All @@ -152,7 +168,8 @@ jobs:
# but to cache what can be cached, so step is fault tolerant & would always succseed.
# 2021-12-11: NOTE: Building all targets, since
# current Cabal does not allow `all --enable-tests --enable-benchmarks --only-dependencies`
- name: Build all targets; try 3 times
- if: (! steps.compiled-deps.outputs.cache-hit)
name: Build all targets; try 3 times
continue-on-error: true
run: |
cabal $cabalBuild || cabal $cabalBuild || cabal $cabalBuild