Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Builds failing on test-rackspace-fedora32-x64-1 #3446

Closed
richardlau opened this issue Aug 10, 2023 · 2 comments
Closed

Builds failing on test-rackspace-fedora32-x64-1 #3446

richardlau opened this issue Aug 10, 2023 · 2 comments

Comments

@richardlau
Copy link
Member

Looking at https://ci.nodejs.org/computer/test-rackspace-fedora32-x64-1/builds node-test-commit-linux builds are generally failing since around 28 days ago.

Recent failures look to be consistent with running out of memory during compilation:
e.g. https://ci.nodejs.org/job/node-test-commit-linux/nodes=fedora-last-latest-x64/53170/console

10:44:32 g++: fatal error: Killed signal terminated program cc1plus
10:44:32 compilation terminated.
10:44:32 make[2]: *** [tools/v8_gypfiles/v8_compiler.target.mk:300: /home/iojs/build/workspace/node-test-commit-linux/out/Release/obj.target/v8_compiler/deps/v8/src/compiler/pipeline.o] Error 1
10:44:32 make[2]: *** Waiting for unfinished jobs....
10:44:33 rm fae5cd31e116e929ac9742c7ac8b778409c12442.intermediate 6b04da42d62d5f3977b891ee206dbea255371b5a.intermediate 6d56ffc625106484bcd0e32f6a53388732e310f7.intermediate
10:44:33 make[1]: *** [Makefile:134: node] Error 2
10:44:33 make: *** [Makefile:566: build-ci] Error 2

The machine has 2GB RAM available (no swap):

[root@test-rackspace-fedora32-x64-1 ~]# free -h
              total        used        free      shared  buff/cache   available
Mem:          1.9Gi       215Mi        74Mi        10Mi       1.6Gi       1.6Gi
Swap:            0B          0B          0B
[root@test-rackspace-fedora32-x64-1 ~]#

compared to test-digitalocean-fedora32-x64-1 which has 2GB of swap:

[root@test-digitalocean-fedora32-x64-1 ~]# free -h
              total        used        free      shared  buff/cache   available
Mem:          1.9Gi       286Mi       1.4Gi       0.0Ki       231Mi       1.5Gi
Swap:         2.0Gi       189Mi       1.8Gi
[root@test-digitalocean-fedora32-x64-1 ~]#

I'll try rebooting the machine for now -- we'll probably eventually end up replacing this machine as part of #3350.

@richardlau
Copy link
Member Author

richardlau commented Aug 10, 2023

So I did previously add swap to this machine: #2527 (comment)
Sure enough the swapfile exists:

[root@test-rackspace-fedora32-x64-1 ~]# ls -al /swapfile
-rw------- 1 root root 2147483648 Oct 13  2021 /swapfile
[root@test-rackspace-fedora32-x64-1 ~]#

I've enabled swap:

[root@test-rackspace-fedora32-x64-1 ~]# swapon /swapfile
[root@test-rackspace-fedora32-x64-1 ~]# free -h
              total        used        free      shared  buff/cache   available
Mem:          1.9Gi       197Mi        72Mi        10Mi       1.7Gi       1.6Gi
Swap:         2.0Gi          0B       2.0Gi
[root@test-rackspace-fedora32-x64-1 ~]#

@richardlau
Copy link
Member Author

Builds are passing again on this machine.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant