Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tests Fail on RISC-V Platform During make check #4056

Closed
U2FsdGVkX1 opened this issue Mar 3, 2024 · 6 comments · Fixed by #4083
Closed

Tests Fail on RISC-V Platform During make check #4056

U2FsdGVkX1 opened this issue Mar 3, 2024 · 6 comments · Fixed by #4083
Assignees
Labels
Component - Testing Code in test or testpar directories, GitHub workflows Component - Tools Command-line tools like h5dump, includes high-level tools Priority - 1. High 🔼 These are important issues that should be resolved in the next release Type - Bug Please report security issues to [email protected] instead of creating an issue on GitHub
Milestone

Comments

@U2FsdGVkX1
Copy link

Describe the bug
I encountered issues when running the test suite on a RISC-V platform. Specifically, two tests related to data compression fail during the make check process.

Steps to Reproduce

  1. Configure the HDF5 build with following options.
  2. Run make -j64.
  3. Run make check.
  4. Observe the failures in the following tests:
    • Verifying output from ../../src/h5repack/h5repack -v -f /dset_deflate:*FAILED*
    • Verifying h5dump output -f GZIP=1 -m 1024 *FAILED*
      1
      2

Platform (please complete the following information)

  • HDF5 version: 1.14.3
  • OS and version: Fedora 39 RISC-V
  • Compiler and version: gcc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)
  • Build system (e.g. CMake, Autotools) and version: 3.27.7
  • Any configure options you specified: ../configure --prefix=/usr --disable-static --disable-sharedlib-rpath --enable-build-mode=production --enable-hl --enable-cxx --enable-fortran --enable-java --with-pic --with-zlib --with-szlib
@derobins derobins added Priority - 1. High 🔼 These are important issues that should be resolved in the next release Component - Tools Command-line tools like h5dump, includes high-level tools Component - Testing Code in test or testpar directories, GitHub workflows Type - Bug Please report security issues to [email protected] instead of creating an issue on GitHub labels Mar 4, 2024
@derobins
Copy link
Member

derobins commented Mar 4, 2024

This isn't a real library problem. It's failing due to the different compression ratio being picked up as "different" in a way that inappropriately fails the test. We have filtering for most things like this. Looks like we'll have to update the filters.

@derobins derobins added this to the 1.14.4 milestone Mar 4, 2024
@derobins
Copy link
Member

derobins commented Mar 4, 2024

btw, CMake will probably pass these tests since it has more comprehensive filters.

@byrnHDF
Copy link
Contributor

byrnHDF commented Mar 6, 2024

The issue is that the zlib of the test system and the zlib used by the HDF system produce slightly different compression ratios. The intent of the test is to make sure the compression was correctly applied. It seems that the test needs to be more involved to verify that the compression was correctly implemented. (Maybe allow a certain amount of delta in the values)

@rwmjones
Copy link

rwmjones commented Mar 6, 2024

Note it's never correct to assume zlib output is the same. There are multiple ways to zlib-compress a file even at the same compression level. We have found that zlib works differently on different CPU architectures. Also Fedora now uses zlib-ng not zlib.

@byrnHDF
Copy link
Contributor

byrnHDF commented Mar 6, 2024

True. It just means that the test has to be more involved in checking that kind of situation then simply doing a compare.
Again the intent is to verify that compression correctly worked. We need to enhance tests to allow for variances.

@byrnHDF
Copy link
Contributor

byrnHDF commented Mar 6, 2024

Also, simply ignoring the values makes the test almost useless as it ignores the intent.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Component - Testing Code in test or testpar directories, GitHub workflows Component - Tools Command-line tools like h5dump, includes high-level tools Priority - 1. High 🔼 These are important issues that should be resolved in the next release Type - Bug Please report security issues to [email protected] instead of creating an issue on GitHub
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants