[WIP] Add functionality for updating an existing compatibility layer #229

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Draft

bedroge wants to merge 27 commits into EESSI:main from bedroge:update_compat_layer

Collaborator

bedroge commented Sep 15, 2025

Attempt to make it possible to rerun the playbook on top of an existing compat layer. Will require some changes in the installation script, as it now bind mounts an empty host dir as /cvmfs/software.eessi.io, instead it should probably just fusemount the CVMFS repo inside the container.

ocaisa and others added 3 commits

September 9, 2025 11:45


          Update trusted directories for glibc to leverage variable symlinks

519d591

Fixes EESSI#226 

Since this is pretty relevant to security, I am inclined to point these variable symlinks to `/dev/null` by default but that does not actually address the problem being discussed in EESSI#226 (having to harass the admins to link the CUDA drivers). If we can have logic in our CVMFS configuration then maybe we can address that.


          Update upload-artifact action

86f27d5


          only sync when the overlay config is changed

561194d

Collaborator Author

bedroge commented Sep 15, 2025 •

edited

Loading

Tried it with a bind mount from the host, but that doesn't work, as the files are then owned by the cvmfs user. This leads to all sorts of permission errors in the Prefix environment, e.g.

OSError: [Errno 95] Operation not supported: '/cvmfs/software.eessi.io/versions/2025.06/compat/linux/x86_64/var/lib/portage'

bedroge added 6 commits

September 15, 2025 20:32


          add sync handler

ba11c63


          rename sync handler

63f0dd4


          call sync handler

4f95707


          flush handlers

d38d6dd


          remove blank line

7cf15ef


          use ansible.builtin.meta

3d15aa0

bedroge force-pushed the update_compat_layer branch from d9288eb to 3d15aa0 Compare

September 15, 2025 18:56

bedroge added 9 commits

September 15, 2025 20:56


          add community.general dependency

2eb4c2a


          galaxy requirements file

5647d51


          point to requirements file

0d18772


          correct path to requirements file

5e1db9b


          move requirements file

5b415fa


          move requirements file

bf193be


          move requirements file

419e3ce


          Merge branch 'main' of github.com:EESSI/compatibility-layer into upda…

…te_compat_layer


          adjust trusted dirs test

f6e57eb

Collaborator Author

bedroge commented Dec 16, 2025

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-mc-aws for:arch=x86_64/generic

eessi-bot-aws bot commented Dec 16, 2025 •

edited

Loading

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-compat
Building on: generic
Building for: x86_64/generic
Job dir: /project/def-users/SHARED/jobs/2025.12/pr_229/113486

date	job status	comment
Dec 16 13:23:07 UTC 2025	submitted	job id `113486` awaits release by job manager
Dec 16 13:23:36 UTC 2025	released	job awaits launch by Slurm scheduler
Dec 16 13:29:19 UTC 2025	running	job `113486` is running
Dec 16 16:16:54 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-113486.out` ❌ some task failed ✅ found tarball Artefacts `eessi-2025.06-compat-linux-x86_64-1765901624.tar.gz` size: 1617 MiB (1696161570 bytes) entries: 180916
Dec 16 16:16:54 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite produced failures. ReFrame Summary [ FAILED ] Ran 23/23 test case(s) from 23 check(s) (6 failure(s), 0 expected failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-113486.out` ❌ found message matching `ERROR:` ❌ found message matching `[\sFAILED\s].Ran . test case`

bedroge added 4 commits

January 28, 2026 20:50


          Merge branch 'main' of github.com:EESSI/compatibility-layer into upda…

8f6d626

…te_compat_layer


          handle new compat layers and updates

c4d424f


          file that controls whether this is a new or updated compat layer

f493340


          use eessi_container.sh, allow for both new and updated compat layers

e97e3c5

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-mc-aws for:arch=x86_64/generic

eessi-bot-aws bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-compat
Building on: generic
Building for: x86_64/generic
Job dir: /project/def-users/SHARED/jobs/2026.01/pr_229/125993

date	job status	comment
Jan 29 12:18:08 UTC 2026	submitted	job id `125993` awaits release by job manager
Jan 29 12:18:18 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 12:24:51 UTC 2026	running	job `125993` is running
Jan 29 12:48:57 UTC 2026	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-125993.out` ❌ some task failed ✅ found tarball Artefacts `eessi-2025.06-compat-linux-x86_64-1769690443.tar.gz` size: 1837 MiB (1926953344 bytes) entries: 196053
Jan 29 12:48:57 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-125993.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

bedroge added 2 commits

January 29, 2026 13:47


          reuse container image for tarball step

9ac6650


          only do reprod step for new builds

62926fe

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-mc-aws for:arch=x86_64/generic

eessi-bot-aws bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-compat
Building on: generic
Building for: x86_64/generic
Job dir: /project/def-users/SHARED/jobs/2026.01/pr_229/125995

date	job status	comment
Jan 29 12:57:22 UTC 2026	submitted	job id `125995` awaits release by job manager
Jan 29 12:57:33 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 12:58:43 UTC 2026	running	job `125995` is running
Jan 29 13:17:45 UTC 2026	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-125995.out` ✅ no task failed ❌ no tarball found Artefacts Details
Jan 29 13:17:45 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-125995.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`


          fix variable name

fbffc5a

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-mc-aws for:arch=x86_64/generic

eessi-bot-aws bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-compat
Building on: generic
Building for: x86_64/generic
Job dir: /project/def-users/SHARED/jobs/2026.01/pr_229/125996

date	job status	comment
Jan 29 13:25:45 UTC 2026	submitted	job id `125996` awaits release by job manager
Jan 29 13:26:30 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 13:27:45 UTC 2026	running	job `125996` is running
Jan 29 13:49:08 UTC 2026	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-125996.out` ✅ no task failed ✅ found tarball Artefacts `eessi-2025.06-compat-linux-x86_64-1769694200.tar.gz` size: 1837 MiB (1926953344 bytes) entries: 196053
Jan 29 13:49:08 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-125996.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`


          run reprod for updates as well, use timestamped dir, don't copy boots…

6ced9cb

…trap script for updates

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-mc-aws for:arch=x86_64/generic

eessi-bot-aws bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-compat
Building on: generic
Building for: x86_64/generic
Job dir: /project/def-users/SHARED/jobs/2026.01/pr_229/125998

date	job status	comment
Jan 29 14:19:16 UTC 2026	submitted	job id `125998` awaits release by job manager
Jan 29 14:19:54 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 14:21:05 UTC 2026	running	job `125998` is running
Jan 29 14:42:48 UTC 2026	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-125998.out` ✅ no task failed ✅ found tarball Artefacts `eessi-2025.06-compat-linux-x86_64-1769697406.tar.gz` size: 1837 MiB (1926953344 bytes) entries: 196053
Jan 29 14:42:48 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-125998.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-riscv for:arch=riscv64/generic

riscv-eessi-io-bot bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-riscv for repository eessi.io-2025.06-compat
Building on: generic
Building for: riscv64/generic
Job dir: /home/eessibot/shared/jobs/2026.01/pr_229/263102

date	job status	comment
Jan 29 14:24:50 UTC 2026	submitted	job id `263102` awaits release by job manager
Jan 29 14:25:46 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 14:26:53 UTC 2026	running	job `263102` is running
Jan 29 14:28:03 UTC 2026	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-263102.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.* created!` Artefacts Details No artefacts were created or found.
Jan 29 14:28:03 UTC 2026	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job263102.test` does not exist in job directory, or parsing it failed.


          use reprod_dir everywhere

a82e84c

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-mc-aws for:arch=aarch64/generic
bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-mc-aws for:arch=x86_64/generic

eessi-bot-aws bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-compat
Building on: generic
Building for: aarch64/generic
Job dir: /project/def-users/SHARED/jobs/2026.01/pr_229/126010

date	job status	comment
Jan 29 14:59:05 UTC 2026	submitted	job id `126010` awaits release by job manager
Jan 29 15:00:04 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 15:01:17 UTC 2026	running	job `126010` is running
Jan 29 15:18:09 UTC 2026	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-126010.out` ✅ no task failed ✅ found tarball Artefacts `eessi-2025.06-compat-linux-aarch64-1769699505.tar.gz` size: 1780 MiB (1867319689 bytes) entries: 196049
Jan 29 15:18:09 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-126010.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

eessi-bot-aws bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-compat
Building on: generic
Building for: x86_64/generic
Job dir: /project/def-users/SHARED/jobs/2026.01/pr_229/126011

date	job status	comment
Jan 29 14:59:12 UTC 2026	submitted	job id `126011` awaits release by job manager
Jan 29 15:00:07 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 15:01:23 UTC 2026	running	job `126011` is running
Jan 29 15:23:39 UTC 2026	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-126011.out` ✅ no task failed ✅ found tarball Artefacts `eessi-2025.06-compat-linux-x86_64-1769699855.tar.gz` size: 1837 MiB (1926953344 bytes) entries: 196053
Jan 29 15:23:39 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-126011.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-riscv for:arch=riscv64/generic

riscv-eessi-io-bot bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-riscv for repository eessi.io-2025.06-compat
Building on: generic
Building for: riscv64/generic
Job dir: /home/eessibot/shared/jobs/2026.01/pr_229/263124

date	job status	comment
Jan 29 15:30:54 UTC 2026	submitted	job id `263124` awaits release by job manager
Jan 29 15:32:00 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 15:33:08 UTC 2026	running	job `263124` is running
Jan 29 15:34:18 UTC 2026	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-263124.out` ❌ some task failed ❌ no tarball found Artefacts Details
Jan 29 15:34:18 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason Failed for unknown reason Details ✅ job output file `slurm-263124.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-riscv for:arch=riscv64/generic

riscv-eessi-io-bot bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-riscv for repository eessi.io-2025.06-compat
Building on: generic
Building for: riscv64/generic
Job dir: /home/eessibot/shared/jobs/2026.01/pr_229/263125

date	job status	comment
Jan 29 15:34:46 UTC 2026	submitted	job id `263125` awaits release by job manager
Jan 29 15:35:23 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 15:36:31 UTC 2026	running	job `263125` is running
Jan 29 15:47:39 UTC 2026	finished	🤷 UNKNOWN (click triangle for detailed information) Job results file `_bot_job263125.result` does not exist in job directory, or parsing it failed. No artefacts were found/reported.
Jan 29 15:47:39 UTC 2026	test result	🤷 UNKNOWN (click triangle for detailed information) Job test file `_bot_job263125.test` does not exist in job directory, or parsing it failed.

Collaborator Author

bedroge commented Jan 29, 2026

bot: build repo:eessi.io-2025.06-compat instance:eessi-bot-riscv for:arch=riscv64/generic

riscv-eessi-io-bot bot commented Jan 29, 2026 •

edited

Loading

New job on instance eessi-bot-riscv for repository eessi.io-2025.06-compat
Building on: generic
Building for: riscv64/generic
Job dir: /home/eessibot/shared/jobs/2026.01/pr_229/263127

date	job status	comment
Jan 29 15:47:48 UTC 2026	submitted	job id `263127` awaits release by job manager
Jan 29 15:48:44 UTC 2026	released	job awaits launch by Slurm scheduler
Jan 29 15:49:52 UTC 2026	running	job `263127` is running

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet