Skip to content

Add and document tarball generation job #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
helaslo wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add and document tarball generation job #2

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ Jobs are submitted to the queue by `batch-launcher.sh`. Currently this is:
* One build-and-test cycle for each supported operating system
* One build-and-test cycle on Ubuntu LTS with asan and ubsan enabled
* cppcheck and clang-analyzer static analysis on Ubuntu LTS
* Tarball generation on debian-stable

Each job is submitted to a SLURM partition corresponding to the desired runner type. Partitions all have a single SLURM node in them, with the exception of ubuntu-lts which has two.

Expand Down
8 changes: 6 additions & 2 deletions batch-launcher.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,11 +44,15 @@ sbatch-wrapper.sh -L rikers:1 -p ubuntu-lts run-task job-ubuntu-analyze.sh 2>&1
JOB7=`sbatch-wrapper.sh -L macmini:1 -p macos run-task-macos job-macos.sh`
JOB8=`sbatch-wrapper.sh -L macmini:1 -p debian-stable-aarch64 run-task job-debian.sh`

########################################################################################################################
#Tarball generation shouldn't use any real resources, so not requesting license for it
JOB9=`sbatch-wrapper.sh -p debian-stable run-task job-tarball.sh`

########################################################################################################################
# When all jobs that can generate artifacts have finished, run a job that processes their results

# This job uses negligible CPU so while it runs on sanquentin doesn't request a vCPU license
sbatch-wrapper.sh \
-p postprocess \
--dependency=$JOB0,$JOB1,$JOB2,$JOB3,$JOB4,$JOB5,$JOB6,$JOB7,$JOB8 \
/home/ci/scopehal-ci-scripts/postprocess.sh $JOB0 $JOB1 $JOB2 $JOB3 $JOB4 $JOB5 $JOB6 $JOB7 $JOB8
--dependency=$JOB0,$JOB1,$JOB2,$JOB3,$JOB4,$JOB5,$JOB6,$JOB7,$JOB8,$JOB9 \
/home/ci/scopehal-ci-scripts/postprocess.sh $JOB0 $JOB1 $JOB2 $JOB3 $JOB4 $JOB5 $JOB6 $JOB7 $JOB8 $JOB9
8 changes: 8 additions & 0 deletions ci-jobs/job-tarball.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
#!/bin/bash
export BRANCH=$1
export COMMIT=$2

git clone --recursive https://github.com/ngscopeclient/scopehal-apps
cd scopehal-apps
git checkout $COMMIT
./test-scripts/test-driver-create-tarballs.sh