Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

make -C docker release_build FAILED, REGRESSION?? #447

Closed
josephwnv opened this issue Nov 21, 2023 · 8 comments
Closed

make -C docker release_build FAILED, REGRESSION?? #447

josephwnv opened this issue Nov 21, 2023 · 8 comments
Assignees
@Shixiaowei02
Labels
build triaged Issue has been triaged by maintainers

Comments

@josephwnv
Copy link

Today, I got the following error on various environment, My own PC, Azure VM and company server.

When I ran "make -C docker release_build" follow instruction in
https://github.com/NVIDIA/TensorRT-LLM/blob/release/0.5.0/docs/source/installation.md

It used to work for me but not work today.

Repro steps are

apt-get update && apt-get -y install git git-lfs
git clone https://github.com/NVIDIA/TensorRT-LLM.git
cd TensorRT-LLM
git submodule update --init --recursive
git lfs install
git lfs pull
make -C docker release_build

#0 43.10 /usr/local/mpi/bin/mpicc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.10/src/MPI.o -Lbuild/temp.linux-x86_64-3.10 -ldl -o build/lib.linux-x86_64-3.10/mpi4py/MPI.cpython-310-x86_64-linux-gnu.so
#0 43.10 writing build/lib.linux-x86_64-3.10/mpi4py/mpi.cfg
#0 43.10 Traceback (most recent call last):
#0 43.10 File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in
#0 43.10 main()
#0 43.10 File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
#0 43.10 json_out['return_val'] = hook(**hook_input['kwargs'])
#0 43.10 File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 251, in build_wheel
#0 43.10 return _build_backend().build_wheel(wheel_directory, config_settings,
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 404, in build_wheel
#0 43.10 return self._build_with_temp_dir(
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 389, in _build_with_temp_dir
#0 43.10 self.run_setup()
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 311, in run_setup
#0 43.10 exec(code, locals())
#0 43.10 File "", line 644, in
#0 43.10 File "", line 641, in main
#0 43.10 File "", line 492, in run_setup
#0 43.10 File "/tmp/pip-install-8050735a/mpi4py_6482ffe4a2ee4078aa02472ce31c8a15/conf/mpidistutils.py", line 541, in setup
#0 43.10 return fcn_setup(**attrs)
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/init.py", line 103, in setup
#0 43.10 return distutils.core.setup(**attrs)
#0 43.10 File "/usr/lib/python3.10/distutils/core.py", line 148, in setup
#0 43.10 dist.run_commands()
#0 43.10 File "/usr/lib/python3.10/distutils/dist.py", line 966, in run_commands
#0 43.10 self.run_command(cmd)
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/dist.py", line 963, in run_command
#0 43.10 super().run_command(command)
#0 43.10 File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
#0 43.10 cmd_obj.run()
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/wheel/bdist_wheel.py", line 371, in run
#0 43.10 install = self.reinitialize_command("install", reinit_subcommands=True)
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/init.py", line 216, in reinitialize_command
#0 43.10 cmd = _Command.reinitialize_command(self, command, reinit_subcommands)
#0 43.10 File "/usr/lib/python3.10/distutils/cmd.py", line 305, in reinitialize_command
#0 43.10 return self.distribution.reinitialize_command(command,
#0 43.10 File "/usr/lib/python3.10/distutils/dist.py", line 938, in reinitialize_command
#0 43.10 command = self.get_command_obj(command_name)
#0 43.10 File "/usr/lib/python3.10/distutils/dist.py", line 858, in get_command_obj
#0 43.10 cmd_obj = self.command_obj[command] = klass(self)
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/init.py", line 174, in init
#0 43.10 super().init(dist)
#0 43.10 File "/usr/lib/python3.10/distutils/cmd.py", line 62, in init
#0 43.10 self.initialize_options()
#0 43.10 File "/tmp/pip-build-env-_y1p3opv/overlay/local/lib/python3.10/dist-packages/setuptools/command/install.py", line 50, in initialize_options
#0 43.10 orig.install.initialize_options(self)
#0 43.10 File "/usr/lib/python3.10/_distutils_system_mod.py", line 33, in initialize_options
#0 43.10 super().initialize_options()
#0 43.10 TypeError: super(type, obj): obj must be an instance or subtype of type
#0 43.10 [end of output]
#0 43.10
#0 43.10 note: This error originates from a subprocess, and is likely not a problem with pip.
#0 43.10 ERROR: Failed building wheel for mpi4py
#0 43.10 Failed to build mpi4py
#0 43.10 ERROR: Could not build wheels for mpi4py, which is required to install pyproject.toml-based projects
@Chevolier
Copy link

Same issue, anyone find a solution?

@defuyun
Copy link

defuyun commented Nov 21, 2023 •
edited
Loading

I got the same error. this is my console

#7 70.14   × Building wheel for mpi4py (pyproject.toml) did not run successfully.
#7 70.14   │ exit code: 1
#7 70.14   ╰─> [263 lines of output]
#7 70.14       running bdist_wheel
#7 70.14       running build
#7 70.14       running build_src
#7 70.14       running build_py
#7 70.14       creating build
#7 70.14       creating build/lib.linux-x86_64-3.10
#7 70.14       creating build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/__init__.py -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/run.py -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/bench.py -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/__main__.py -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       creating build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/_lib.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/_core.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/aplus.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/__init__.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/_base.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/__main__.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/server.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/pool.py -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       creating build/lib.linux-x86_64-3.10/mpi4py/util
#7 70.14       copying src/mpi4py/util/dtlib.py -> build/lib.linux-x86_64-3.10/mpi4py/util
#7 70.14       copying src/mpi4py/util/__init__.py -> build/lib.linux-x86_64-3.10/mpi4py/util
#7 70.14       copying src/mpi4py/util/pkl5.py -> build/lib.linux-x86_64-3.10/mpi4py/util
#7 70.14       copying src/mpi4py/MPI.pyi -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/bench.pyi -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/dl.pyi -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/__main__.pyi -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/run.pyi -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/__init__.pyi -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/py.typed -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/__init__.pxd -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/MPI.pxd -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       copying src/mpi4py/libmpi.pxd -> build/lib.linux-x86_64-3.10/mpi4py
#7 70.14       creating build/lib.linux-x86_64-3.10/mpi4py/include
#7 70.14       creating build/lib.linux-x86_64-3.10/mpi4py/include/mpi4py
#7 70.14       copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-x86_64-3.10/mpi4py/include/mpi4py
#7 70.14       copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-x86_64-3.10/mpi4py/include/mpi4py
#7 70.14       copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-x86_64-3.10/mpi4py/include/mpi4py
#7 70.14       copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-x86_64-3.10/mpi4py/include/mpi4py
#7 70.14       copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-x86_64-3.10/mpi4py/include/mpi4py
#7 70.14       copying src/mpi4py/futures/pool.pyi -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/_core.pyi -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/server.pyi -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/aplus.pyi -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/__main__.pyi -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/__init__.pyi -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/futures/_lib.pyi -> build/lib.linux-x86_64-3.10/mpi4py/futures
#7 70.14       copying src/mpi4py/util/dtlib.pyi -> build/lib.linux-x86_64-3.10/mpi4py/util
#7 70.14       copying src/mpi4py/util/__init__.pyi -> build/lib.linux-x86_64-3.10/mpi4py/util
#7 70.14       copying src/mpi4py/util/pkl5.pyi -> build/lib.linux-x86_64-3.10/mpi4py/util
#7 70.14       running build_clib
#7 70.14       MPI configuration: [mpi] from 'mpi.cfg'
#7 70.14       MPI C compiler:    /usr/local/mpi/bin/mpicc
#7 70.14       MPI C++ compiler:  /usr/local/mpi/bin/mpicxx
#7 70.14       MPI F compiler:    /usr/local/mpi/bin/mpifort
#7 70.14       MPI F90 compiler:  /usr/local/mpi/bin/mpif90
#7 70.14       MPI F77 compiler:  /usr/local/mpi/bin/mpif77
#7 70.14       checking for library 'lmpe' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -llmpe -o _configtest
#7 70.14       /usr/bin/ld: cannot find -llmpe: No such file or directory
#7 70.14       collect2: error: ld returned 1 exit status
#7 70.14       failure.
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       building 'mpe' dylib library
#7 70.14       creating build/temp.linux-x86_64-3.10
#7 70.14       creating build/temp.linux-x86_64-3.10/src
#7 70.14       creating build/temp.linux-x86_64-3.10/src/lib-pmpi
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-x86_64-3.10/src/lib-pmpi/mpe.o
#7 70.14       creating build/lib.linux-x86_64-3.10/mpi4py/lib-pmpi
#7 70.14       /usr/local/mpi/bin/mpicc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed build/temp.linux-x86_64-3.10/src/lib-pmpi/mpe.o -o build/lib.linux-x86_64-3.10/mpi4py/lib-pmpi/libmpe.so
#7 70.14       checking for library 'vt-mpi' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -lvt-mpi -o _configtest
#7 70.14       /usr/bin/ld: cannot find -lvt-mpi: No such file or directory
#7 70.14       collect2: error: ld returned 1 exit status
#7 70.14       failure.
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       checking for library 'vt.mpi' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -lvt.mpi -o _configtest
#7 70.14       /usr/bin/ld: cannot find -lvt.mpi: No such file or directory
#7 70.14       collect2: error: ld returned 1 exit status
#7 70.14       failure.
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       building 'vt' dylib library
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-x86_64-3.10/src/lib-pmpi/vt.o
#7 70.14       /usr/local/mpi/bin/mpicc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed build/temp.linux-x86_64-3.10/src/lib-pmpi/vt.o -o build/lib.linux-x86_64-3.10/mpi4py/lib-pmpi/libvt.so
#7 70.14       checking for library 'vt-mpi' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -lvt-mpi -o _configtest
#7 70.14       /usr/bin/ld: cannot find -lvt-mpi: No such file or directory
#7 70.14       collect2: error: ld returned 1 exit status
#7 70.14       failure.
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       checking for library 'vt.mpi' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -lvt.mpi -o _configtest
#7 70.14       /usr/bin/ld: cannot find -lvt.mpi: No such file or directory
#7 70.14       collect2: error: ld returned 1 exit status
#7 70.14       failure.
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       building 'vt-mpi' dylib library
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-x86_64-3.10/src/lib-pmpi/vt-mpi.o
#7 70.14       /usr/local/mpi/bin/mpicc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed build/temp.linux-x86_64-3.10/src/lib-pmpi/vt-mpi.o -o build/lib.linux-x86_64-3.10/mpi4py/lib-pmpi/libvt-mpi.so
#7 70.14       checking for library 'vt-hyb' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -lvt-hyb -o _configtest
#7 70.14       /usr/bin/ld: cannot find -lvt-hyb: No such file or directory
#7 70.14       collect2: error: ld returned 1 exit status
#7 70.14       failure.
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       checking for library 'vt.ompi' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -lvt.ompi -o _configtest
#7 70.14       /usr/bin/ld: cannot find -lvt.ompi: No such file or directory
#7 70.14       collect2: error: ld returned 1 exit status
#7 70.14       failure.
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       building 'vt-hyb' dylib library
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-x86_64-3.10/src/lib-pmpi/vt-hyb.o
#7 70.14       /usr/local/mpi/bin/mpicc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed build/temp.linux-x86_64-3.10/src/lib-pmpi/vt-hyb.o -o build/lib.linux-x86_64-3.10/mpi4py/lib-pmpi/libvt-hyb.so
#7 70.14       running build_ext
#7 70.14       MPI configuration: [mpi] from 'mpi.cfg'
#7 70.14       MPI C compiler:    /usr/local/mpi/bin/mpicc
#7 70.14       MPI C++ compiler:  /usr/local/mpi/bin/mpicxx
#7 70.14       MPI F compiler:    /usr/local/mpi/bin/mpifort
#7 70.14       MPI F90 compiler:  /usr/local/mpi/bin/mpif90
#7 70.14       MPI F77 compiler:  /usr/local/mpi/bin/mpif77
#7 70.14       checking for dlopen() availability ...
#7 70.14       checking for header 'dlfcn.h' ...
#7 70.14       x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       success!
#7 70.14       checking for library 'dl' ...
#7 70.14       x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       x86_64-linux-gnu-gcc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -ldl -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for function 'dlopen' ...
#7 70.14       x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       x86_64-linux-gnu-gcc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -ldl -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       building 'mpi4py.dl' extension
#7 70.14       x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/usr/include/python3.10 -c src/dynload.c -o build/temp.linux-x86_64-3.10/src/dynload.o
#7 70.14       x86_64-linux-gnu-gcc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.10/src/dynload.o -Lbuild/temp.linux-x86_64-3.10 -ldl -o build/lib.linux-x86_64-3.10/mpi4py/dl.cpython-310-x86_64-linux-gnu.so
#7 70.14       checking for MPI compile and link ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for missing MPI functions/symbols ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       checking for function 'MPI_Type_create_f90_integer' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for function 'MPI_Type_create_f90_real' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for function 'MPI_Type_create_f90_complex' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for function 'MPI_Status_c2f' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for function 'MPI_Status_f2c' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for symbol 'MPI_LB' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for symbol 'MPI_UB' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for dlopen() availability ...
#7 70.14       checking for header 'dlfcn.h' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o
#7 70.14       success!
#7 70.14       checking for library 'dl' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -ldl -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       checking for function 'dlopen' ...
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.10 -c _configtest.c -o _configtest.o
#7 70.14       /usr/local/mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-x86_64-3.10 -ldl -o _configtest
#7 70.14       success!
#7 70.14       removing: _configtest.c _configtest.o _configtest
#7 70.14       building 'mpi4py.MPI' extension
#7 70.14       /usr/local/mpi/bin/mpicc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/usr/include/python3.10 -c src/MPI.c -o build/temp.linux-x86_64-3.10/src/MPI.o
#7 70.14       /usr/local/mpi/bin/mpicc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.10/src/MPI.o -Lbuild/temp.linux-x86_64-3.10 -ldl -o build/lib.linux-x86_64-3.10/mpi4py/MPI.cpython-310-x86_64-linux-gnu.so
#7 70.14       writing build/lib.linux-x86_64-3.10/mpi4py/mpi.cfg
#7 70.14       Traceback (most recent call last):
#7 70.14         File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
#7 70.14           main()
#7 70.14         File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
#7 70.14           json_out['return_val'] = hook(**hook_input['kwargs'])
#7 70.14         File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 251, in build_wheel
#7 70.14           return _build_backend().build_wheel(wheel_directory, config_settings,
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 404, in build_wheel
#7 70.14           return self._build_with_temp_dir(
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 389, in _build_with_temp_dir
#7 70.14           self.run_setup()
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 311, in run_setup
#7 70.14           exec(code, locals())
#7 70.14         File "<string>", line 644, in <module>
#7 70.14         File "<string>", line 641, in main
#7 70.14         File "<string>", line 492, in run_setup
#7 70.14         File "/tmp/pip-install-8sru13t5/mpi4py_8e30ea2099e14aada36c5f98d80011e3/conf/mpidistutils.py", line 541, in setup
#7 70.14           return fcn_setup(**attrs)
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/__init__.py", line 103, in setup
#7 70.14           return distutils.core.setup(**attrs)
#7 70.14         File "/usr/lib/python3.10/distutils/core.py", line 148, in setup
#7 70.14           dist.run_commands()
#7 70.14         File "/usr/lib/python3.10/distutils/dist.py", line 966, in run_commands
#7 70.14           self.run_command(cmd)
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/dist.py", line 963, in run_command
#7 70.14           super().run_command(command)
#7 70.14         File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
#7 70.14           cmd_obj.run()
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/wheel/bdist_wheel.py", line 371, in run
#7 70.14           install = self.reinitialize_command("install", reinit_subcommands=True)
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/__init__.py", line 216, in reinitialize_command
#7 70.14           cmd = _Command.reinitialize_command(self, command, reinit_subcommands)
#7 70.14         File "/usr/lib/python3.10/distutils/cmd.py", line 305, in reinitialize_command
#7 70.14           return self.distribution.reinitialize_command(command,
#7 70.14         File "/usr/lib/python3.10/distutils/dist.py", line 938, in reinitialize_command
#7 70.14           command = self.get_command_obj(command_name)
#7 70.14         File "/usr/lib/python3.10/distutils/dist.py", line 858, in get_command_obj
#7 70.14           cmd_obj = self.command_obj[command] = klass(self)
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/__init__.py", line 174, in __init__
#7 70.14           super().__init__(dist)
#7 70.14         File "/usr/lib/python3.10/distutils/cmd.py", line 62, in __init__
#7 70.14           self.initialize_options()
#7 70.14         File "/tmp/pip-build-env-0fu6ilef/overlay/local/lib/python3.10/dist-packages/setuptools/command/install.py", line 50, in initialize_options
#7 70.14           orig.install.initialize_options(self)
#7 70.14         File "/usr/lib/python3.10/_distutils_system_mod.py", line 33, in initialize_options
#7 70.14           super().initialize_options()
#7 70.14       TypeError: super(type, obj): obj must be an instance or subtype of type
#7 70.14       [end of output]
#7 70.14   
#7 70.14   note: This error originates from a subprocess, and is likely not a problem with pip.
#7 70.14   ERROR: Failed building wheel for mpi4py
#7 70.14 Failed to build mpi4py
#7 70.14 ERROR: Could not build wheels for mpi4py, which is required to install pyproject.toml-based projects
#7 70.58 
#7 70.58 [notice] A new release of pip is available: 23.2.1 -> 23.3.1
#7 70.58 [notice] To update, run: python -m pip install --upgrade pip
------
executor failed running [/bin/bash -c bash ./install_base.sh && rm install_base.sh]: exit code: 1

@xinji1
Copy link

xinji1 commented Nov 21, 2023

same issue, any solution?

@nv-guomingz
Copy link
Collaborator

we're working on it.

@nv-guomingz nv-guomingz added triaged Issue has been triaged by maintainers build labels Nov 21, 2023
@Shixiaowei02 Shixiaowei02 self-assigned this Nov 21, 2023
@Shixiaowei02
Copy link
Collaborator

Shixiaowei02 commented Nov 21, 2023 •
edited
Loading

Please refer to mpi4py/mpi4py#431 and patch the code, then pip install from it. Thanks! @josephwnv @Chevolier @defuyun @xinji1

If you have a better solution, please tell us. And will synchronize the fix to main branch on this Friday.

@defuyun
Copy link

defuyun commented Nov 21, 2023

@Shixiaowei02 ran pip with your branch and it seems to be working. thanks!

@apache2046
Copy link

apache2046 commented Nov 22, 2023 •
edited
Loading

Please refer to mpi4py/mpi4py#431 and patch the code, then pip install from it. Thanks! @josephwnv @Chevolier @defuyun @xinji1

If you have a better solution, please tell us. And will synchronize the fix to main branch on this Friday.

thanks, this works for me
change docker/common/install_base.sh

#pip install mpi4py
pip install git+https://github.com/Shixiaowei02/mpi4py.git@fix-setuptools-version

@Shixiaowei02 Shixiaowei02 mentioned this issue Nov 23, 2023
Closed
@jdemouth-nvidia
Copy link
Collaborator

Thanks. I'm closing that issue. Feel free to reopen if needed.

@kaiyux kaiyux mentioned this issue Nov 24, 2023
Merged
Closed
@Shixiaowei02 Shixiaowei02 mentioned this issue Nov 27, 2023
Merged
@robosina robosina mentioned this issue Nov 29, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Shixiaowei02 Shixiaowei02

Labels
build triaged Issue has been triaged by maintainers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@apache2046 @defuyun @jdemouth-nvidia @Shixiaowei02 @Chevolier @josephwnv @nv-guomingz @xinji1