dacapo-avrora_0 fails for JDK 21

[jiekang]

This test fails for all platforms:
https://trss.adoptium.net/testPerPlatform?testId=64f69b2117052c6715144c90

It may be due to the use of java.lang.Compiler which is removed in JDK 21. Upstream dacapo has a patch file recently added to fix this dacapobench/dacapobench#219

I have no idea how Dacapo releases are being maintained at the moment. The sourceforge files for 9.12-MR1 referenced via the Dacapo website were from 2018: https://sourceforge.net/projects/dacapobench/files/

Is the Dacapo being run at Adoptium a build from source?

Relevant logs:

2023-09-04T21:46:58.032Z] ===== DaCapo 9.12-MR1 avrora starting =====
[2023-09-04T21:46:58.032Z] Digest validation failed for stderr.log, expecting 0xda39a3ee5e6b4b0d3255bfef95601890afd80709 found 0x06c8c88a2527a461348b8f44257bfb563f20ca1f
[2023-09-04T21:46:58.032Z] ===== DaCapo 9.12-MR1 avrora FAILED =====
[2023-09-04T21:46:58.032Z] Validation FAILED for avrora default


stdout.log:

Avrora [Beta 1.7.110] - (c) 2003-2007 UCLA Compilers Group

Loading /home/jenkins/workspace/Test_openjdk21_hs_extended.perf_x86-64_linux/aqa-tests/TKG/output_16938638279253/dacapo-avrora_0/./scratch/test/tinyos/CntToRfm.elf...OK
Loading /home/jenkins/workspace/Test_openjdk21_hs_extended.perf_x86-64_linux/aqa-tests/TKG/output_16938638279253/dacapo-avrora_0/./scratch/test/tinyos/RfmToLeds.elf...OK
=={ Simulation events }=======================================================
Node          Time   Event
------------------------------------------------------------------------------
Simulation terminated with unexpected exception: ==============================================================================
Simulated time: 0 cycles

The tarball of test results [1] doesn't seem to have the stderr.log file; it would be nice to read that to see what was inside.

[1] https://ci.adoptium.net/job/Test_openjdk21_hs_extended.perf_x86-64_linux/19/artifact/benchmark_test_output.tar.gz

Test Info
Test Name: dacapo-avrora_0
Test Duration: 228 ms
Machine: test-equinix_esxi-ubuntu2204-x64-2
TRSS link for the test output: https://trss.adoptium.net/output/test?id=64f69b2117052c6715144c90

Build Info
Build Name: Test_openjdk21_hs_extended.perf_x86-64_linux
Jenkins Build start time: Sep 04 2023, 05:36 pm
Jenkins Build URL: https://ci.adoptium.net/job/Test_openjdk21_hs_extended.perf_x86-64_linux/19/
TRSS link for the build: https://trss.adoptium.net/allTestsInfo?buildId=64f699f517052c6715144236

Java Version
openjdk version "21-beta" 2023-09-19
OpenJDK Runtime Environment Temurin-21+35-202309042127 (build 21-beta+35-ea)
OpenJDK 64-Bit Server VM Temurin-21+35-202309042127 (build 21-beta+35-ea, mixed mode, sharing)

This test has been failed 3 times since Jul 08 2023, 07:45 pm
Java Version when the issue first seen
openjdk version "21-beta" 2023-09-19
OpenJDK Runtime Environment Temurin-21+30-202307082331 (build 21-beta+30-202307082331)
OpenJDK 64-Bit Server VM Temurin-21+30-202307082331 (build 21-beta+30-202307082331, mixed mode, sharing)
Jenkins Build URL: https://ci.adoptium.net/job/Test_openjdk21_hs_extended.perf_x86-64_linux/17/

The test failed on machine test-equinix_esxi-ubuntu2204-x64-2 2 times
The test failed on machine test-equinix_esxi-ubuntu2204-x64-1 1 times

[smlambert]

auto exclude test dacapo-avrora ver=21+

[smlambert]

Created the exclude PR #4749 until this is resolved.

A source code release was created modified yesterday to fix the date to 2018: https://github.com/dacapobench/dacapobench/releases/tag/v9.12-MR1-bach

We have a few options:

1. Wait for a binary release to be available via sourceforge (no work for us, but also unknown amount of waiting)
2. Switch to build from source from a tagged source code release (some work for us, is a more deterministic approach, though not a 'high priority' item)

[jiekang]

Dacapo project now has a 23.11-chopin release here: https://github.com/dacapobench/dacapobench/releases/tag/v23.11-chopin

We can try using it instead of 9.12-MR1

[smlambert]

See #4858