New Machine requirement UBI static docker containers #3586

sxa · 2024-06-07T07:19:06Z

I need to request a new machine:

New machine operating system (e.g. linux/windows/macos/solaris/aix): Linux UBI 8 and 9
New machine architecture (e.g. x64/aarch32/arm32/ppc64/ppc64le/sparc): x64, aarch64, ppc64le, s390x
Provider (leave blank if it does not matter):
Desired usage: Testing on this OS.
Any unusual specification/setup required:
How many of them are required: 1 of each

Please explain what this machine is needed for:

We ship and support ubi9-minimal docker containers with Temurin as official dockerhub images but currently do not perform any testing on UBI. There is currently one UBI8 image in jenkins but that is hosted on the skytap dockerhost machine which is offline due to insufficient credits being available to run it, so we are not running testing on any UBI versions just now. Since this is an official docker image which we shipped we are running quite a risk by not actively testing on it on a regular basis.

The initial support for UBI8 images was created in #2532 - this should be expanded to cover ubi9 (minimal version if possible, and if not ensure we understand why) and enable ubi8 again.

Related (other OSs)

sxa · 2024-06-10T15:48:42Z

FYI @Haroon-Khel this is the issue I mentioned earlier today

sxa · 2024-06-11T13:17:09Z

I did a little but of work today to test on UBI in order to compare with the Amazon Linux results so I've got these Dockerfiles that work (but may need a little more "tidying" before we make them live):

Dockerfiles.tar.gz

Haroon-Khel · 2024-06-11T16:39:55Z

x64 ubi9 container up https://ci.adoptium.net/computer/test-docker-ubi9-x64-1/ https://ci.adoptium.net/job/AQA_Test_Pipeline/277/console (jdk21 v1.0.1-release branch)

Haroon-Khel · 2024-06-11T17:23:38Z

s390x and arm64 images cant install libnss3.so

1.962 No match for argument: libnss3.so
1.989 Error: Unable to find a match: libnss3.so

And even though the x64 image couldnt find libnss3.so, it didnt cause an error during building.

Haroon-Khel · 2024-06-11T17:24:41Z

https://ci.adoptium.net/computer/test-docker-ubi9-armv8l-1/ without libnss3.so

https://ci.adoptium.net/job/AQA_Test_Pipeline/278/console (jdk21 v1.0.1-release branch)

Haroon-Khel · 2024-06-11T17:29:09Z

https://ci.adoptium.net/computer/test-docker-ubi9-s390x-1/ without libnss3.so

https://ci.adoptium.net/job/AQA_Test_Pipeline/279/console (jdk21 v1.0.1-release branch)

Haroon-Khel · 2024-06-11T17:29:47Z

ppc64le ubi9 image finding it hard to install the last line of dependencies

 > [28/30] RUN dnf install -y git make gcc xorg-x11-server-Xvfb libXrender libXi libXtst fontconfig fakeroot procps-ng hostname diffutils:                                                                          
0.574 Updating Subscription Management repositories.                                                                                                                                                                
0.575 Unable to read consumer identity                                                                                                                                                                              
0.579 
0.579 This system is not registered with an entitlement server. You can use subscription-manager to register.
0.579 
10.85 CentOS Stream 9 - BaseOS                        393  B/s | 3.9 kB     00:10    
10.85 Errors during downloading metadata for repository 'baseos':
10.85   - Downloading successful, but checksum doesn't match. Calculated: 53823a7862af9565f586a1bca3e3e31582fd80f4429eda9a4bcb5bdf9369ecce281ef67aa6b356db4cb9653e210b487cdfdfc28718fe805a1f1ccf915d05e039(sha512)  Expected: 21b9e356f319100ed0373db6e66e1cfb275a907b82f0eb74ee18bcd25b95445a6c1a319dea65383bbc691375eab05838802b383a35fda74c1f49612c1c737fd1(sha512) 
10.86 Error: Failed to download metadata for repo 'baseos': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried

sxa · 2024-06-12T08:24:51Z

s390x and arm64 images cant install libnss3.so
1.962 No match for argument: libnss3.so
1.989 Error: Unable to find a match: libnss3.so
And even though the x64 image couldnt find libnss3.so, it didnt cause an error during building.

/usr/lib64/libnss3.so is supplied in the nss package so that entry in the dockerfile probably shouldn't be there.
I'm a bit surprised that there is a difference in the same UBI version between architectures in how it handles this condition though, but 🤷🏻

Haroon-Khel · 2024-06-12T15:22:05Z

x64 ubi9 container up https://ci.adoptium.net/computer/test-docker-ubi9-x64-1/ https://ci.adoptium.net/job/AQA_Test_Pipeline/277/console (jdk21 v1.0.1-release branch)

All tests passed

https://ci.adoptium.net/computer/test-docker-ubi9-armv8l-1/ without libnss3.so

https://ci.adoptium.net/job/AQA_Test_Pipeline/278/console (jdk21 v1.0.1-release branch)

The only failure javax/imageio/plugins/png/ReadPngRGBImageWithTRNSChunk.java

https://ci.adoptium.net/computer/test-docker-ubi9-s390x-1/ without libnss3.so

https://ci.adoptium.net/job/AQA_Test_Pipeline/279/console (jdk21 v1.0.1-release branch)

Only failure jdk/jfr/jcmd/TestJcmdDump.java

Haroon-Khel · 2024-06-12T16:00:22Z

ppc64le ubi9 container is up https://ci.adoptium.net/computer/test-docker–ubi9-ppc64le-1/ . Getting this error when updating openssl-libs

Error: Transaction test error:
  file /usr/lib64/ossl-modules/fips.so from install of openssl-libs-1:3.2.2-1.el9.ppc64le conflicts with file from package openssl-fips-provider-3.0.7-2.el9.ppc64le

https://ci.adoptium.net/job/AQA_Test_Pipeline/288/console (jdk21 v1.0.1-release branch)

Haroon-Khel · 2024-06-13T11:30:45Z

https://ci.adoptium.net/job/AQA_Test_Pipeline/288/console (jdk21 v1.0.1-release branch)

https://ci.adoptium.net/computer/test-docker–ubi9-ppc64le-1/ ubi9 ppc64le jdk21 failures v1.0.1-release branch

compiler/rtm/locking/TestRTMSpinLoopCount.java
jdk/jfr/jcmd/TestJcmdDump.java
com/sun/jdi/FinalizerTest.java

Haroon-Khel · 2024-06-13T16:19:24Z

https://ci.adoptium.net/computer/test-docker-ubi8-ppc64le-1/ is up
https://ci.adoptium.net/job/AQA_Test_Pipeline/289/console jdk21 v1.0.1-release

update: failing tests:

extended openjdk
- compiler/rtm/locking/TestRTMAbortRatio.java
- jdk/jfr/jcmd/TestJcmdDump.java
- com/sun/jdi/FinalizerTest.java

sxa · 2024-06-13T16:32:32Z

https://ci.adoptium.net/job/AQA_Test_Pipeline/288/console (jdk21 v1.0.1-release branch)

ubi9 ppc64le jdk21 failures v1.0.1-release branch

Can we try and get JDK17 and 8 kicked off over the weekend too? I'm expecting it to show the same failures as Amazon Linux 2023 but it would be good to be able to see if that's true in practice :-)

sxa · 2024-06-13T16:33:51Z

https://ci.adoptium.net/job/AQA_Test_Pipeline/288/console (jdk21 v1.0.1-release branch)
ubi9 ppc64le jdk21 failures v1.0.1-release branch
compiler/rtm/locking/TestRTMSpinLoopCount.java

Interesting - don't think I've seen that one as a regular failure so it likelyt needs some investigating - I think the other two are known / intermittent.

Haroon-Khel · 2024-06-13T17:37:57Z

https://ci.adoptium.net/computer/test-docker-ubi8-x64-1/ is up
https://ci.adoptium.net/job/AQA_Test_Pipeline/290/console (jdk21 v1.0.1-release branch)

Update: extended openjdk jdk/jfr/jcmd/TestJcmdDump.java only failed test

Haroon-Khel · 2024-06-13T17:38:24Z

Can we try and get JDK17 and 8 kicked off over the weekend too? I'm expecting it to show the same failures as Amazon Linux 2023 but it would be good to be able to see if that's true in practice :-)

Yep, I just want to get a single jdk version test pipeline done before running the rest over the weekend

Haroon-Khel · 2024-06-13T17:51:20Z

https://ci.adoptium.net/computer/test-docker-ubi8-armv8-1/ is up
https://ci.adoptium.net/job/AQA_Test_Pipeline/291/console jdk21 v1.0.1-release branch

Update: Only 1 failing test jdk/jfr/jcmd/TestJcmdDump.java

Haroon-Khel · 2024-06-14T16:12:33Z

AQA test pipelines for UBI8 and 9 machines. JDK 8 11 and 17 v1.0.1-release branch

test-docker-ubi9-x64-1

https://ci.adoptium.net/job/AQA_Test_Pipeline/294/console

test-docker-ubi9-s390x-1

https://ci.adoptium.net/job/AQA_Test_Pipeline/295/console

test-docker-ubi9-armv8l-1

https://ci.adoptium.net/job/AQA_Test_Pipeline/296/console

test-docker-ubi9-ppc64le-1

https://ci.adoptium.net/job/AQA_Test_Pipeline/297/console

test-docker-ubi8-x64-1

https://ci.adoptium.net/job/AQA_Test_Pipeline/298/console

test-docker-ubi8-armv8-1

https://ci.adoptium.net/job/AQA_Test_Pipeline/299/console

test-docker-ubi8-ppc64le-1

https://ci.adoptium.net/job/AQA_Test_Pipeline/300/console

sxa · 2024-06-15T11:02:03Z

For consideration in terms of reporting: #3600
This issue is a good example as it has lots of runs so it would be good to think about how best to summarise the information.

Haroon-Khel · 2024-06-18T15:25:58Z

JDK8 11 17 v1.0.1-release branch failures only

test-docker-ubi9-x64-1

JDK8 extended openjdk
java/net/Inet6Address/B6206527.java
java/net/ipv6tests/B6521014.java

Existing infra issue affecting ppc64le static docker IPv6 tests failing on test-docker-ubuntu2204-ppc64le-1 #2949

java/nio/file/Files/probeContentType/Basic.java

Existing infra issue affecting fedora jdk8 java/nio/file/Files/probeContentType/Basic.java failed on test-docker-fedora34-x64-1 #2631

jdk_security3

Rerun 10 iterations https://ci.adoptium.net/job/Grinder/10434/console
libsoftokn3 version not found, set to 0.0: /usr/lib64/libsoftokn3.so
7 consistent failures
TEST: sun/security/pkcs11/Provider/Login.sh
TEST: sun/security/pkcs11/Secmod/AddPrivateKey.java
TEST: sun/security/pkcs11/Secmod/GetPrivateKey.java
TEST: sun/security/pkcs11/Secmod/JksSetPrivateKey.java
TEST: sun/security/pkcs11/Secmod/LoadKeystore.java
TEST: sun/security/pkcs11/Secmod/TrustAnchors.java
TEST: sun/security/tools/keytool/autotest.sh

java/rmi/activation/rmidViaInheritedChannel/InheritedChannelNotServerSocket.java
java/rmi/activation/rmidViaInheritedChannel/RmidViaInheritedChannel.java

Rerunning both rmi tests 10 iterations https://ci.adoptium.net/job/Grinder/10435/console
Passed 10/10 times ✅

JDK8 sanity openjdk
sun/security/krb5/auto/rcache_usemd5.sh

JDK11 extended system
ConcurrentLoadTest_5m (usually intermittent)

Rerunning 10 iterations https://ci.adoptium.net/job/Grinder/10442/console
Passed ✅

JDK11 extended openjdk
jdk_security3
java/time/test/java/time/format/TestUTCParse.java

JDK17 sanity system
TestJlmRemoteMemoryAuth (usually intermittent)

Rerunning 10 iterations https://ci.adoptium.net/job/Grinder/10444/console
Passed ✅

JDK17 extended openjdk
java/beans/XMLEncoder/java_awt_CardLayout.java

Rerunning 10 iterations https://ci.adoptium.net/job/Grinder/10446/console
Passed ✅

test-docker-ubi9-s390x-1

JDK11 extended openjdk
jdk_security3
java/time/test/java/time/format/TestUTCParse.java

JDK17 extended perf
renaissance-movie-lens (usually intermittent)

Rerun 10 iterations https://ci.adoptium.net/job/Grinder/10436/console
Passed 5/10 times ✅

test-docker-ubi9-armv8l-1

JDK8 extended openjdk
java/net/Inet6Address/B6206527.java
java/net/ipv6tests/B6521014.java

Existing issue IPv6 tests failing on test-docker-ubuntu2204-ppc64le-1 #2949

java/nio/file/Files/probeContentType/Basic.java

Existing issue jdk8 java/nio/file/Files/probeContentType/Basic.java failed on test-docker-fedora34-x64-1 #2631

sun/security/tools/keytool/autotest.sh

JDK11 extended openjdk
java/time/test/java/time/format/TestUTCParse.java

test-docker-ubi9-ppc64le-1

JDK8 sanity openjdk
sun/security/krb5/auto/rcache_usemd5.sh

JDK8 extended openjdk
java/nio/file/Files/probeContentType/Basic.java
jdk_security3

JDK11 extended openjdk
jdk_security3
java/time/test/java/time/format/TestUTCParse.java

Rerun 10 iterations https://ci.adoptium.net/job/Grinder/10439/console
Consistent failure

JDK17 extended openjdk
compiler/rtm/locking/TestRTMAbortThreshold.java

Rerun 10 iterations https://ci.adoptium.net/job/Grinder/10437/console
Passed 9/10 times ✅

test-docker-ubi8-x64-1

JDK8 sanity openjdk
sun/security/krb5/auto/rcache_usemd5.sh

JDK8 extended openjdk
java/net/Inet6Address/B6206527.java
java/net/ipv6tests/B6521014.java

Existing issue IPv6 tests failing on test-docker-ubuntu2204-ppc64le-1 #2949

sun/security/pkcs11/fips/TestTLS12.java

JDK11 extended openjdk
java/time/test/java/time/format/TestUTCParse.java

JDK17 extended openjdk
java/beans/PropertyEditor/TestFontClassJava.java

Rerun 10 iterations https://ci.adoptium.net/job/Grinder/10445/console
Passed ✅

test-docker-ubi8-armv8-1

JDK8 extended openjdk
java/net/Inet6Address/B6206527.java
java/net/ipv6tests/B6521014.java

Existing issue IPv6 tests failing on test-docker-ubuntu2204-ppc64le-1 #2949

JDk11 extended openjdk
java/time/test/java/time/format/TestUTCParse.java

test-docker-ubi8-ppc64le-1

JDK8 sanity openjdk
sun/security/krb5/auto/rcache_usemd5.sh

JDK8 extended openjdk
java/net/Inet6Address/B6206527.java
java/net/ipv6tests/B6521014.java
sun/security/pkcs11/fips/TestTLS12.java

Rerun security test 10 iterations https://ci.adoptium.net/job/Grinder/10440/console
Consistent failure

JDK11 extended openjdk
java/time/test/java/time/format/TestUTCParse.java
tools/jmod/hashes/HashesOrderTest.java
jdk/jfr/event/runtime/TestThreadCpuTimeEvent.java

Rerunning jmod and jfr test 10 iterations https://ci.adoptium.net/job/Grinder/10438/console
Passed 10/10 times ✅

JDK17 extended openjdk
compiler/rtm/locking/TestRTMAbortThreshold.java

Rerunning 10 iterations https://ci.adoptium.net/job/Grinder/10443/console
Passed 9/10 times ✅

Haroon-Khel · 2024-06-21T11:12:35Z

Grouping all of the common consistent failures:

Known issue #2949
java/net/Inet6Address/B6206527.java
java/net/ipv6tests/B6521014.java

Known issue #2631
java/nio/file/Files/probeContentType/Basic.java

jdk_security3

sun/security/krb5/auto/rcache_usemd5.sh sxa: Related: #3521, adoptium/aqa-tests#5300 (comment), and referenced for JDK11 in adoptium/aqa-tests#3065

java/time/test/java/time/format/TestUTCParse.java sxa: Referenced in multiple triage issues such as adoptium/aqa-tests#5232 (comment) - needs issue raising.

sun/security/tools/keytool/autotest.sh - sxa: Seems common on newer distributions

sxa · 2024-07-31T10:15:18Z

@Haroon-Khel Is there any additional work needed here or do we have enough live UBI machines now?

Haroon-Khel · 2024-07-31T11:11:36Z

The machines are live, this can be closed

sxa added Machine Request currency labels Jun 7, 2024

github-actions bot added the docker label Jun 7, 2024

sxa added this to the 2024-06 (June) milestone Jun 7, 2024

Haroon-Khel self-assigned this Jun 11, 2024

Haroon-Khel mentioned this issue Jun 11, 2024

docker: Add ubi9 docker static dockerfile #3592

Merged

6 tasks

Haroon-Khel mentioned this issue Jun 13, 2024

Ubi8.dockerstatic.dockerfile #3595

Merged

6 tasks

Haroon-Khel mentioned this issue Jun 24, 2024

UBI and Ubuntu 2404 test failure summary #3614

Open

Haroon-Khel mentioned this issue Jul 5, 2024

java/time/test/java/time/format/TestUTCParse.java failing on multiple platforms for JDK11 #3658

Closed

sxa mentioned this issue Jul 5, 2024

JDK8 fips/TestTLS12 failure on Ubuntu 24.04 adoptium/aqa-tests#5420

Open

Haroon-Khel closed this as completed Jul 31, 2024

Haroon-Khel mentioned this issue Sep 23, 2024

New Machine requirement: UBI9 static docker container #3227

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

New Machine requirement UBI static docker containers #3586

New Machine requirement UBI static docker containers #3586

sxa commented Jun 7, 2024

sxa commented Jun 10, 2024

sxa commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024 •

edited

Loading

Haroon-Khel commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024

sxa commented Jun 12, 2024

Haroon-Khel commented Jun 12, 2024

Haroon-Khel commented Jun 12, 2024 •

edited

Loading

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

sxa commented Jun 13, 2024

sxa commented Jun 13, 2024

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

Haroon-Khel commented Jun 13, 2024

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

Haroon-Khel commented Jun 14, 2024

sxa commented Jun 15, 2024

Haroon-Khel commented Jun 18, 2024 •

edited

Loading

Haroon-Khel commented Jun 21, 2024 •

edited by sxa

Loading

sxa commented Jul 31, 2024

Haroon-Khel commented Jul 31, 2024

New Machine requirement UBI static docker containers #3586

New Machine requirement UBI static docker containers #3586

Comments

sxa commented Jun 7, 2024

sxa commented Jun 10, 2024

sxa commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024 • edited Loading

Haroon-Khel commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024

Haroon-Khel commented Jun 11, 2024

sxa commented Jun 12, 2024

Haroon-Khel commented Jun 12, 2024

Haroon-Khel commented Jun 12, 2024 • edited Loading

Haroon-Khel commented Jun 13, 2024 • edited Loading

Haroon-Khel commented Jun 13, 2024 • edited Loading

sxa commented Jun 13, 2024

sxa commented Jun 13, 2024

Haroon-Khel commented Jun 13, 2024 • edited Loading

Haroon-Khel commented Jun 13, 2024

Haroon-Khel commented Jun 13, 2024 • edited Loading

Haroon-Khel commented Jun 14, 2024

sxa commented Jun 15, 2024

Haroon-Khel commented Jun 18, 2024 • edited Loading

JDK8 11 17 v1.0.1-release branch failures only

test-docker-ubi9-x64-1

test-docker-ubi9-s390x-1

test-docker-ubi9-armv8l-1

test-docker-ubi9-ppc64le-1

test-docker-ubi8-x64-1

test-docker-ubi8-armv8-1

test-docker-ubi8-ppc64le-1

Haroon-Khel commented Jun 21, 2024 • edited by sxa Loading

sxa commented Jul 31, 2024

Haroon-Khel commented Jul 31, 2024

Haroon-Khel commented Jun 11, 2024 •

edited

Loading

Haroon-Khel commented Jun 12, 2024 •

edited

Loading

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

Haroon-Khel commented Jun 13, 2024 •

edited

Loading

Haroon-Khel commented Jun 18, 2024 •

edited

Loading

Haroon-Khel commented Jun 21, 2024 •

edited by sxa

Loading