Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

(WIP) Supporting checksums.json #3748

Closed
wants to merge 3 commits into from
Closed

(WIP) Supporting checksums.json #3748

wants to merge 3 commits into from

Conversation

mboisson
Copy link
Contributor

@mboisson mboisson commented Jun 17, 2021 •
edited
Loading

This is an admittedly naive implementation (a proof of concept). In particular, problems left to be resolved:

  • no test implemented or validate
  • not sure what to do with --inject-checksums
  • not sure what to do with --new-pr for the yaml file

I have tested this PR with Python-3.8.2-GCCcore-9.3.0.eb by removing the checksums from the EasyConfig, and with --enforce-checksums enabled.

It allows to remove checksums both for the main file and for the exts_list.

This is for issue #3746

@mboisson mboisson mentioned this pull request Jun 17, 2021
Closed
@boegelbot
Copy link

@mboisson: Tests failed in GitHub Actions, see https://github.com/easybuilders/easybuild-framework/actions/runs/946990891
Last 100 lines of output from first failing test suite run:

== 2021-06-17 16:17:23,875 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 16:17:23,875 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/gitdb/ext/smmap/easybuild/easyconfigs
== 2021-06-17 16:17:23,875 tools.py:299 DEBUG Checking for easybuild/easyconfigs at ../easybuild/easyconfigs
== 2021-06-17 16:17:23,875 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib/graphviz/python/easybuild/easyconfigs
== 2021-06-17 16:17:23,875 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib64/graphviz/python/easybuild/easyconfigs
== 2021-06-17 16:17:23,875 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/easybuild/easyconfigs
== 2021-06-17 16:17:23,876 easyblock.py:767 INFO Found file toy-0.0_fix-silly-typo-in-printf-statement.patch at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch
== 2021-06-17 16:17:23,876 easyblock.py:489 DEBUG File /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch found for patch toy-0.0_fix-silly-typo-in-printf-statement.patch
== 2021-06-17 16:17:23,876 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/bin/eb
== 2021-06-17 16:17:23,876 tools.py:286 INFO Not considering /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368 (no easybuild/easyconfigs subdir found)
== 2021-06-17 16:17:23,876 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/tmpTI4F5L/easybuild/easyconfigs
== 2021-06-17 16:17:23,876 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/easybuild/easyconfigs
== 2021-06-17 16:17:23,876 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/easyconfigs/test_ecs/easybuild/easyconfigs
== 2021-06-17 16:17:23,876 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/eb-fGfQPH/eb-bS4NCD/fake_vsc_IFxfVN/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/git/ext/gitdb/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /home/runner/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python27.zip/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/plat-linux2/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-tk/easybuild/easyconfigs
== 2021-06-17 16:17:23,877 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-old/easybuild/easyconfigs
== 2021-06-17 16:17:23,878 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-dynload/easybuild/easyconfigs
== 2021-06-17 16:17:23,878 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 16:17:23,878 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/gitdb/ext/smmap/easybuild/easyconfigs
== 2021-06-17 16:17:23,878 tools.py:299 DEBUG Checking for easybuild/easyconfigs at ../easybuild/easyconfigs
== 2021-06-17 16:17:23,878 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib/graphviz/python/easybuild/easyconfigs
== 2021-06-17 16:17:23,878 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib64/graphviz/python/easybuild/easyconfigs
== 2021-06-17 16:17:23,878 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/easybuild/easyconfigs
== 2021-06-17 16:17:23,879 easyblock.py:767 INFO Found file toy-extra.txt at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt
== 2021-06-17 16:17:23,879 easyblock.py:489 DEBUG File /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt found for patch ('toy-extra.txt', 'toy-0.0')
== 2021-06-17 16:17:23,879 easyblock.py:514 INFO Added patches: [{'path': '/tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch', 'name': 'toy-0.0_fix-silly-typo-in-printf-statement.patch', 'checksum': None}, {'path': '/tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt', 'copy': 'toy-0.0', 'name': 'toy-extra.txt', 'checksum': None}]
== 2021-06-17 16:17:23,879 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,879 easyblock.py:1947 INFO md5 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0.tar.gz: be662daa971a640e40be5c804d9d7d10
== 2021-06-17 16:17:23,879 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,879 easyblock.py:1947 INFO sha256 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0.tar.gz: 44332000aa33b99ad1e00cbd1a7da769220d74647060a10e807b916d73ea27bc
== 2021-06-17 16:17:23,879 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,880 easyblock.py:1947 INFO md5 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch: a99f2a72cee1689a2f7e3ace0356efb1
== 2021-06-17 16:17:23,880 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,880 easyblock.py:1947 INFO sha256 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch: 81a3accc894592152f81814fbf133d39afad52885ab52c25018722c7bda92487
== 2021-06-17 16:17:23,880 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,880 easyblock.py:1947 INFO md5 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt: 3b0787b3bf36603ae1398c4a49097893
== 2021-06-17 16:17:23,880 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,880 easyblock.py:1947 INFO sha256 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt: 4196b56771140d8e2468fb77f0240bc48ddbf5dabafe0713d612df7fafb1e458
== 2021-06-17 16:17:23,881 templates.py:189 DEBUG config: {'version': '0.0', 'name': 'barbar', 'options': {'start_dir': 'src'}}
== 2021-06-17 16:17:23,881 templates.py:216 DEBUG version found in easyconfig is 0.0
== 2021-06-17 16:17:23,881 templates.py:318 DEBUG name: name, config: barbar
== 2021-06-17 16:17:23,881 templates.py:318 DEBUG name: version, config: 0.0
== 2021-06-17 16:17:23,881 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/bin/eb
== 2021-06-17 16:17:23,881 tools.py:286 INFO Not considering /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368 (no easybuild/easyconfigs subdir found)
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/tmpTI4F5L/easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/easyconfigs/test_ecs/easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/eb-fGfQPH/eb-bS4NCD/fake_vsc_IFxfVN/easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/git/ext/gitdb/easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /home/runner/easybuild/easyconfigs
== 2021-06-17 16:17:23,882 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python27.zip/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/plat-linux2/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-tk/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-old/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-dynload/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/gitdb/ext/smmap/easybuild/easyconfigs
== 2021-06-17 16:17:23,883 tools.py:299 DEBUG Checking for easybuild/easyconfigs at ../easybuild/easyconfigs
== 2021-06-17 16:17:23,884 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib/graphviz/python/easybuild/easyconfigs
== 2021-06-17 16:17:23,884 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib64/graphviz/python/easybuild/easyconfigs
== 2021-06-17 16:17:23,884 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/easybuild/easyconfigs
== 2021-06-17 16:17:23,884 easyblock.py:767 INFO Found file barbar-0.0.tar.gz at /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz
== 2021-06-17 16:17:23,884 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,884 easyblock.py:624 INFO md5 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz: 9a77d6a39777715bfeced7f015f18b08
== 2021-06-17 16:17:23,885 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,885 easyblock.py:624 INFO sha256 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz: d5bd9908cdefbe2d29c6f8d5b45b2aaed9fd904b5e6397418bb5094fbdb3d838
== 2021-06-17 16:17:23,885 easyblock.py:627 DEBUG Verifying checksums for extension source...
== 2021-06-17 16:17:23,885 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 16:17:23,885 filetools.py:1244 DEBUG Computed md5 checksum for /tmp/runner/9490a605faf6dc164eca8adc84a5a684515c3368/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz: 9a77d6a39777715bfeced7f015f18b08 (correct checksum: be662daa971a640e40be5c804d9d7d10)
== 2021-06-17 16:17:23,887 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): Checksum verification for extension source barbar-0.0.tar.gz failed (at easybuild/framework/easyblock.py:634 in fetch_extension_sources)
== 2021-06-17 16:17:23,887 build_log.py:265 INFO ... (took < 1 sec)
== 2021-06-17 16:17:23,887 config.py:616 DEBUG software install path as specified by 'installpath' and 'subdir_software': /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/tmpubJQun/software
== 2021-06-17 16:17:23,887 filetools.py:1876 INFO Removing lock /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/tmpubJQun/software/.locks/_tmp_eb-FgLzfe_eb-wv7M4R_eb-1d3dkF_tmpubJQun_software_toy_0.0.lock...
== 2021-06-17 16:17:23,887 filetools.py:358 INFO Path /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/tmpubJQun/software/.locks/_tmp_eb-FgLzfe_eb-wv7M4R_eb-1d3dkF_tmpubJQun_software_toy_0.0.lock successfully removed.
== 2021-06-17 16:17:23,887 filetools.py:1880 INFO Lock removed: /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/tmpubJQun/software/.locks/_tmp_eb-FgLzfe_eb-wv7M4R_eb-1d3dkF_tmpubJQun_software_toy_0.0.lock
== 2021-06-17 16:17:23,887 easyblock.py:3672 WARNING build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed
== 2021-06-17 16:17:23,888 easyblock.py:301 INFO Closing log for application name toy version 0.0
== 2021-06-17 16:17:23,888 build_log.py:265 INFO FAILED: Installation ended unsuccessfully (build directory: /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/tmpTI4F5L/toy/0.0/system-system): build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed (took 0 secs)
== 2021-06-17 16:17:23,888 build_log.py:265 INFO Results of the build can be found in the log file(s) /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/eb-fGfQPH/eb-bS4NCD/easybuild-toy-0.0-20210617.161723.nNDgm.log
== 2021-06-17 16:17:23,889 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed (at easybuild/main.py:120 in build_and_install_software)
== 2021-06-17 16:17:23,889 filetools.py:1794 DEBUG Not creating existing path /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/eb-fGfQPH/eb-bS4NCD
== 2021-06-17 16:17:23,890 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): Build of /tmp/eb-FgLzfe/eb-wv7M4R/eb-1d3dkF/test.eb failed (err: 'build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed') (at easybuild/main.py:152 in build_and_install_software)


----------------------------------------------------------------------
Ran 782 tests in 1184.581s

FAILED (failures=16, errors=9)
ERROR: Not all tests were successful.

bleep, bloop, I'm just a bot (boegelbot v20200716.01)
Please talk to my owner @boegel if you notice you me acting stupid),
or submit a pull request to https://github.com/boegel/boegelbot fix the problem.

@boegelbot
Copy link

@mboisson: Tests failed in GitHub Actions, see https://github.com/easybuilders/easybuild-framework/actions/runs/947345472
Last 100 lines of output from first failing test suite run:

== 2021-06-17 18:17:30,419 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 18:17:30,419 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/gitdb/ext/smmap/easybuild/easyconfigs
== 2021-06-17 18:17:30,419 tools.py:299 DEBUG Checking for easybuild/easyconfigs at ../easybuild/easyconfigs
== 2021-06-17 18:17:30,419 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib/graphviz/python/easybuild/easyconfigs
== 2021-06-17 18:17:30,419 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib64/graphviz/python/easybuild/easyconfigs
== 2021-06-17 18:17:30,419 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/easybuild/easyconfigs
== 2021-06-17 18:17:30,420 easyblock.py:770 INFO Found file toy-0.0_fix-silly-typo-in-printf-statement.patch at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch
== 2021-06-17 18:17:30,420 easyblock.py:492 DEBUG File /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch found for patch toy-0.0_fix-silly-typo-in-printf-statement.patch
== 2021-06-17 18:17:30,420 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/bin/eb
== 2021-06-17 18:17:30,420 tools.py:286 INFO Not considering /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff (no easybuild/easyconfigs subdir found)
== 2021-06-17 18:17:30,420 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/tmpCdkYew/easybuild/easyconfigs
== 2021-06-17 18:17:30,420 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/easybuild/easyconfigs
== 2021-06-17 18:17:30,421 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/easyconfigs/test_ecs/easybuild/easyconfigs
== 2021-06-17 18:17:30,421 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/eb-xjAGGv/eb-ypnooM/fake_vsc_YmlSzf/easybuild/easyconfigs
== 2021-06-17 18:17:30,421 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/git/ext/gitdb/easybuild/easyconfigs
== 2021-06-17 18:17:30,421 tools.py:299 DEBUG Checking for easybuild/easyconfigs at easybuild/easyconfigs
== 2021-06-17 18:17:30,421 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 18:17:30,421 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /home/runner/easybuild/easyconfigs
== 2021-06-17 18:17:30,422 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python27.zip/easybuild/easyconfigs
== 2021-06-17 18:17:30,422 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/easybuild/easyconfigs
== 2021-06-17 18:17:30,422 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/plat-linux2/easybuild/easyconfigs
== 2021-06-17 18:17:30,422 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-tk/easybuild/easyconfigs
== 2021-06-17 18:17:30,422 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-old/easybuild/easyconfigs
== 2021-06-17 18:17:30,422 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-dynload/easybuild/easyconfigs
== 2021-06-17 18:17:30,423 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 18:17:30,423 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/gitdb/ext/smmap/easybuild/easyconfigs
== 2021-06-17 18:17:30,423 tools.py:299 DEBUG Checking for easybuild/easyconfigs at ../easybuild/easyconfigs
== 2021-06-17 18:17:30,423 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib/graphviz/python/easybuild/easyconfigs
== 2021-06-17 18:17:30,423 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib64/graphviz/python/easybuild/easyconfigs
== 2021-06-17 18:17:30,423 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/easybuild/easyconfigs
== 2021-06-17 18:17:30,424 easyblock.py:770 INFO Found file toy-extra.txt at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt
== 2021-06-17 18:17:30,424 easyblock.py:492 DEBUG File /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt found for patch ('toy-extra.txt', 'toy-0.0')
== 2021-06-17 18:17:30,424 easyblock.py:517 INFO Added patches: [{'path': '/tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch', 'name': 'toy-0.0_fix-silly-typo-in-printf-statement.patch', 'checksum': None}, {'path': '/tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt', 'copy': 'toy-0.0', 'name': 'toy-extra.txt', 'checksum': None}]
== 2021-06-17 18:17:30,424 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,424 easyblock.py:1950 INFO md5 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0.tar.gz: be662daa971a640e40be5c804d9d7d10
== 2021-06-17 18:17:30,425 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,425 easyblock.py:1950 INFO sha256 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0.tar.gz: 44332000aa33b99ad1e00cbd1a7da769220d74647060a10e807b916d73ea27bc
== 2021-06-17 18:17:30,425 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,425 easyblock.py:1950 INFO md5 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch: a99f2a72cee1689a2f7e3ace0356efb1
== 2021-06-17 18:17:30,425 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,425 easyblock.py:1950 INFO sha256 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-0.0_fix-silly-typo-in-printf-statement.patch: 81a3accc894592152f81814fbf133d39afad52885ab52c25018722c7bda92487
== 2021-06-17 18:17:30,425 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,426 easyblock.py:1950 INFO md5 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt: 3b0787b3bf36603ae1398c4a49097893
== 2021-06-17 18:17:30,426 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,426 easyblock.py:1950 INFO sha256 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/toy-extra.txt: 4196b56771140d8e2468fb77f0240bc48ddbf5dabafe0713d612df7fafb1e458
== 2021-06-17 18:17:30,426 templates.py:189 DEBUG config: {'version': '0.0', 'name': 'barbar', 'options': {'start_dir': 'src'}}
== 2021-06-17 18:17:30,426 templates.py:216 DEBUG version found in easyconfig is 0.0
== 2021-06-17 18:17:30,426 templates.py:318 DEBUG name: name, config: barbar
== 2021-06-17 18:17:30,427 templates.py:318 DEBUG name: version, config: 0.0
== 2021-06-17 18:17:30,427 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/bin/eb
== 2021-06-17 18:17:30,427 tools.py:286 INFO Not considering /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff (no easybuild/easyconfigs subdir found)
== 2021-06-17 18:17:30,427 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/tmpCdkYew/easybuild/easyconfigs
== 2021-06-17 18:17:30,428 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/easybuild/easyconfigs
== 2021-06-17 18:17:30,428 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/easyconfigs/test_ecs/easybuild/easyconfigs
== 2021-06-17 18:17:30,428 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/eb-xjAGGv/eb-ypnooM/fake_vsc_YmlSzf/easybuild/easyconfigs
== 2021-06-17 18:17:30,428 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/git/ext/gitdb/easybuild/easyconfigs
== 2021-06-17 18:17:30,428 tools.py:299 DEBUG Checking for easybuild/easyconfigs at easybuild/easyconfigs
== 2021-06-17 18:17:30,428 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 18:17:30,429 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /home/runner/easybuild/easyconfigs
== 2021-06-17 18:17:30,429 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python27.zip/easybuild/easyconfigs
== 2021-06-17 18:17:30,429 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/easybuild/easyconfigs
== 2021-06-17 18:17:30,429 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/plat-linux2/easybuild/easyconfigs
== 2021-06-17 18:17:30,429 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-tk/easybuild/easyconfigs
== 2021-06-17 18:17:30,429 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-old/easybuild/easyconfigs
== 2021-06-17 18:17:30,429 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/lib-dynload/easybuild/easyconfigs
== 2021-06-17 18:17:30,430 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/easybuild/easyconfigs
== 2021-06-17 18:17:30,430 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /opt/hostedtoolcache/Python/2.7.18/x64/lib/python2.7/site-packages/gitdb/ext/smmap/easybuild/easyconfigs
== 2021-06-17 18:17:30,430 tools.py:299 DEBUG Checking for easybuild/easyconfigs at ../easybuild/easyconfigs
== 2021-06-17 18:17:30,430 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib/graphviz/python/easybuild/easyconfigs
== 2021-06-17 18:17:30,430 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /usr/lib64/graphviz/python/easybuild/easyconfigs
== 2021-06-17 18:17:30,430 tools.py:299 DEBUG Checking for easybuild/easyconfigs at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/easybuild/easyconfigs
== 2021-06-17 18:17:30,431 easyblock.py:770 INFO Found file barbar-0.0.tar.gz at /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz
== 2021-06-17 18:17:30,431 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,431 easyblock.py:627 INFO md5 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz: 9a77d6a39777715bfeced7f015f18b08
== 2021-06-17 18:17:30,431 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,432 easyblock.py:627 INFO sha256 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz: d5bd9908cdefbe2d29c6f8d5b45b2aaed9fd904b5e6397418bb5094fbdb3d838
== 2021-06-17 18:17:30,432 easyblock.py:630 DEBUG Verifying checksums for extension source...
== 2021-06-17 18:17:30,432 filetools.py:1171 DEBUG Using blocksize 16777216 for calculating the checksum
== 2021-06-17 18:17:30,432 filetools.py:1244 DEBUG Computed md5 checksum for /tmp/runner/23fb3c22fc2d691da13bf35eebd83eb759c754ff/lib/python2.7/site-packages/test/framework/sandbox/sources/toy/extensions/barbar-0.0.tar.gz: 9a77d6a39777715bfeced7f015f18b08 (correct checksum: be662daa971a640e40be5c804d9d7d10)
== 2021-06-17 18:17:30,434 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): Checksum verification for extension source barbar-0.0.tar.gz failed (at easybuild/framework/easyblock.py:637 in fetch_extension_sources)
== 2021-06-17 18:17:30,434 build_log.py:265 INFO ... (took < 1 sec)
== 2021-06-17 18:17:30,434 config.py:616 DEBUG software install path as specified by 'installpath' and 'subdir_software': /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/tmpShMarF/software
== 2021-06-17 18:17:30,434 filetools.py:1876 INFO Removing lock /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/tmpShMarF/software/.locks/_tmp_eb-fr6MuL_eb-7vm1I0_eb-SHWmC4_tmpShMarF_software_toy_0.0.lock...
== 2021-06-17 18:17:30,435 filetools.py:358 INFO Path /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/tmpShMarF/software/.locks/_tmp_eb-fr6MuL_eb-7vm1I0_eb-SHWmC4_tmpShMarF_software_toy_0.0.lock successfully removed.
== 2021-06-17 18:17:30,435 filetools.py:1880 INFO Lock removed: /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/tmpShMarF/software/.locks/_tmp_eb-fr6MuL_eb-7vm1I0_eb-SHWmC4_tmpShMarF_software_toy_0.0.lock
== 2021-06-17 18:17:30,435 easyblock.py:3675 WARNING build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed
== 2021-06-17 18:17:30,435 easyblock.py:301 INFO Closing log for application name toy version 0.0
== 2021-06-17 18:17:30,436 build_log.py:265 INFO FAILED: Installation ended unsuccessfully (build directory: /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/tmpCdkYew/toy/0.0/system-system): build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed (took 0 secs)
== 2021-06-17 18:17:30,436 build_log.py:265 INFO Results of the build can be found in the log file(s) /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/eb-xjAGGv/eb-ypnooM/easybuild-toy-0.0-20210617.181730.VlzvO.log
== 2021-06-17 18:17:30,437 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed (at easybuild/main.py:120 in build_and_install_software)
== 2021-06-17 18:17:30,438 filetools.py:1794 DEBUG Not creating existing path /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/eb-xjAGGv/eb-ypnooM
== 2021-06-17 18:17:30,438 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): Build of /tmp/eb-fr6MuL/eb-7vm1I0/eb-SHWmC4/test.eb failed (err: 'build failed (first 300 chars): Checksum verification for extension source barbar-0.0.tar.gz failed') (at easybuild/main.py:152 in build_and_install_software)


----------------------------------------------------------------------
Ran 782 tests in 1204.793s

FAILED (failures=12, errors=4)
ERROR: Not all tests were successful.

bleep, bloop, I'm just a bot (boegelbot v20200716.01)
Please talk to my owner @boegel if you notice you me acting stupid),
or submit a pull request to https://github.com/boegel/boegelbot fix the problem.

@mboisson
Copy link
Contributor Author

I'm not quite sure why the 'eb' command / test-eb tests fail...

@mboisson mboisson changed the title (WIP) Supporting checksums.yaml (WIP) Supporting checksums.json Jun 18, 2021
@mboisson mboisson closed this Jun 18, 2021
@mboisson mboisson deleted the checksums_yaml branch June 18, 2021 14:34
@mboisson mboisson mentioned this pull request Jun 18, 2021
Merged
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@mboisson @boegelbot