docs: Create CentOS installation guide #372

jodh-intel · 2017-07-28T16:09:44Z

Write a document explaining how to install Clear Containers 3.0 on a
CentOS 7 system. Added associated scripts and configuration
files (which are lightly modified versions from
https://github.com/01org/cc-oci-runtime).

Fixes #371.

Signed-off-by: James O. D. Hunt [email protected]

jodh-intel · 2017-07-28T16:11:44Z

Before this lands, we need an ack to confirm the instructions work for both:

CentOS 7
RHEL 7

@GabyCT - do you still have your RHEL environment?

coveralls · 2017-07-28T16:14:08Z

Coverage remained the same at 53.451% when pulling a04cfa6 on jodh-intel:add-centos-install-doc into df043b1 on clearcontainers:master.

jodh-intel · 2017-07-28T16:45:52Z

Note that this PR also uses the docker name cc-runtime (see #370).

GabyCT · 2017-08-01T22:15:28Z

@jodh-intel sorry, I do not have a RHEL

jodh-intel · 2017-08-08T15:36:57Z

@GabyCT, @chavafg - do you know roughly how long it would take to get a system setup to test this?

GabyCT · 2017-08-10T14:53:34Z

@jodh-intel I will try to setup the end of the week

gorozco1 · 2017-08-10T15:05:44Z

@jodh-intel @GabyCT For Clear Containers 3.0 We only need scripts for RHEL.
CentOS packages are OK.

jodh-intel · 2017-08-10T16:28:01Z

@gorozco1 - sure, the script does use the OBS packages, but most of the logic is needed to build qemu-lite which isn't in OBS fwics.

GabyCT · 2017-08-11T21:06:38Z

@jodh-intel, I am trying to test this issue however when I am doing the pull of your PR it has confilicts with the versions.txt could you please solve this so I can run it thanks

coveralls · 2017-08-15T15:48:46Z

Coverage remained the same at 55.39% when pulling 2a782dd on jodh-intel:add-centos-install-doc into 7bde8a9 on clearcontainers:master.

GabyCT · 2017-08-15T16:21:33Z

@jodh-intel, when I running the script at RHEL, the following error is show:

Error: Package docker-ce-17.06.0.ce-1.el7.centos.x86_64 (docker-ce-stable)
Requires: container-selinux >= 2.9
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest

GabyCT · 2017-08-15T16:23:53Z

@jodh-intel maybe it is related with this issue moby/moby#31651

GabyCT · 2017-08-15T16:24:24Z

@jodh-intel, I am using RHEL 7.3

GabyCT · 2017-08-15T16:46:45Z

@jodh-intel , I 've been searching and this problem is quite common as it appears in several sites docker/for-linux#20

GabyCT · 2017-08-15T20:30:55Z

@jodh-intel I forgot to mention that the system where I did the test was a fresh installed RHEL

jodh-intel · 2017-08-16T11:11:41Z

Hi @GabyCT - Is the container-selinux package installed by default? What does yum info container-selinux show?

@gorozco1, @chavafg - I seem to remember we've seen something like this before. Any thoughts?

GabyCT · 2017-08-16T14:23:34Z

@jodh-intel , if I do
yum info container-selinux
Error: No matching Packages to list

chavafg · 2017-08-16T14:51:30Z

We had some issues[1] with clear-containers-selinux on CentOS, which is provided by us. But seems that this package is from the RHEL repos. Someone from the issue that @GabyCT pasted above, recommends to manually download and install the package: docker/for-linux#20 (comment)

Not sure if that could work for us.

[1] clearcontainers/packaging#7

GabyCT · 2017-08-16T15:05:39Z

@chavafg actually this script is using the Centos packages for RHEL

GabyCT · 2017-08-16T15:08:49Z

@chavafg what is doing is trying to install the docker packages of centos in RHEL

sudo yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo
sudo yum -y install docker-ce

chavafg · 2017-08-16T15:17:05Z

maybe we need access to the EPEL repos?

GabyCT · 2017-08-16T15:40:50Z

@chavafg installing the rpm fixed the issue with docker, now we have the following error

Loaded plugins: product-id
adding repo from: http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/RHEL_7.3/home:clearcontainers:clear-containers-3.repo
grabbing file http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/RHEL_7.3/home:clearcontainers:clear-containers-3.repo to /etc/yum.repos.d/home:clearcontainers:clear-containers-3.repo
Could not fetch/save url http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/RHEL_7.3/home:clearcontainers:clear-containers-3.repo to file /etc/yum.repos.d/home:clearcontainers:clear-containers-3.repo: [Errno 14] HTTP Error 404 - Not Found

@gorozco1 the resource is not available

jodh-intel · 2017-08-16T16:00:48Z

Hi @GabyCT - I've now updated this PR to account for the small (but annoying ;) difference between CentOS and RHEL whereby the former sets VERSION_ID in /etc/os-release to the major release number (7), whereas RHEL sets it to major.minor format (7.3). This should fix the issue you were seeing with the OBS URL being incorrect on RHEL only.

coveralls · 2017-08-16T16:02:26Z

Coverage remained the same at 55.39% when pulling 44572bc on jodh-intel:add-centos-install-doc into 743362f on clearcontainers:master.

eadamsintel · 2017-09-08T15:14:26Z

I asked Tom to try this out and the following step failed. When doing the git clone this centos-setup.sh is not there. How can I get the centos-setup.sh script?

script -efc ./installation/centos-setup.sh

[stack@otc-tme-cleartest clearcontainers]$ cd runtime
[stack@otc-tme-cleartest runtime]$ script -efc ./installation/centos-setup.sh
Script started, file is typescript
bash: ./installation/centos-setup.sh: No such file or directory
Script done, file is typescript

jodh-intel · 2017-09-08T15:25:37Z

Hi @eadamsintel, this PR contains files that only exist in my branch (until it is merged into master). But the docs on this PR must assume they have already been merged into master.

Hence, to allow Tom to test this, he will have to follow the instructions but rather than running these commands:

$ cd $HOME/go/src/github/clearcontainers
$ git clone https://github.com/clearcontainers/runtime
$ cd runtime

... he must run:

$ cd $HOME/go/src/github/clearcontainers
$ git clone https://github.com/jodh-intel/runtime
$ cd runtime
$ git checkout add-centos-install-doc

gorozco1 · 2017-09-08T22:02:06Z

installation/centos-setup.sh

+
+# Install pre-requisites for gcc
+gmp_file="gmp-${gmp_version}.tar.bz2"
+curl -L -O "ftp://gcc.gnu.org/pub/gcc/infrastructure/${gmp_file}"


Could we try to use always http/https if possible (some times user might be behind proxy and it might not work 100% with ftp)

gorozco1 · 2017-09-08T22:02:48Z

installation/centos-setup.sh

+compile gmp "${gmp_file}" "gmp-${gmp_version}"
+
+mpfr_file="mpfr-${mpfr_version}.tar.bz2"
+curl -L -O "ftp://gcc.gnu.org/pub/gcc/infrastructure/${mpfr_file}"


could we replace for http/https protocol?

gorozco1 · 2017-09-08T22:02:50Z

installation/centos-setup.sh

+compile mpfr "${mpfr_file}" "mpfr-${mpfr_version}"
+
+mpc_file="mpc-${mpc_version}.tar.gz"
+curl -L -O "ftp://gcc.gnu.org/pub/gcc/infrastructure/${mpc_file}"


could we replace for http/https protocol?

eadamsintel · 2017-09-10T15:58:53Z

Feedback from Tom "That workaround worked. The script is running. Had some proxy issues i had to work around. also the nopassword variable for sudo isn't working properly, been using root instead."

jodh-intel · 2017-09-11T07:07:47Z

Hi @eadamsintel - I think proxies are out of scope of the document. Could tom comment on exactly what the problem with the sudo setup was (what is his github username?)?

I've just re-checked the sudo instructions and they are working for me.

Wrote a document explaining how to install Clear Containers 3.0 on a CentOS 7 system. Added associated scripts and configuration files (which are lightly modified versions from https://github.com/01org/cc-oci-runtime). Fixes clearcontainers#371. Signed-off-by: James O. D. Hunt <[email protected]>

coveralls · 2017-09-11T08:33:57Z

Coverage remained the same at 97.04% when pulling 64ace3a on jodh-intel:add-centos-install-doc into 1fe09bb on clearcontainers:master.

clearcontainersbot · 2017-09-11T08:35:46Z

Popular Images qa-passed 👍

coveralls · 2017-09-11T08:38:18Z

Coverage remained the same at 97.04% when pulling 155f374 on jodh-intel:add-centos-install-doc into 1fe09bb on clearcontainers:master.

clearcontainersbot · 2017-09-11T08:42:14Z

Popular Images qa-passed 👍

jodh-intel · 2017-09-11T09:11:57Z

Hi @gorozco1 - good call on https urls! Fixed, re-tested and branch updated.

tcthorn-intel · 2017-09-12T03:43:27Z

I finally got a github account - I was able to get the script to run as a user - there appears to be an issue with the gobject version:

configure: error: Package requirements (gobject-2.0 >= 2.37.6 gio-2.0) were not met:

Requested 'gobject-2.0 >= 2.37.6' but version of GObject is 2.36.3

Consider adjusting the PKG_CONFIG_PATH environment variable if you
installed software in a non-standard prefix.

Alternatively, you may set the environment variables JSON_CFLAGS
and JSON_LIBS to avoid the need to call pkg-config.
See the pkg-config man page for more details.
Script done, file is typescript
[root@otc-tme-cleartest runtime]#

--Tom

jodh-intel · 2017-09-12T06:58:00Z

Hi @tcthorn-intel - thanks for testing. I am confused though: there shouldn't be any version issues since we explicitly pin the builds to particular versions of libraries: gobject, gio and glib should all be at the same version - the one the script downloads.

Please can you attach your typescript file which might give us some more clues.

gorozco1 · 2017-09-12T15:54:08Z

@jodh-intel can we merge this now?

gorozco1 · 2017-09-12T15:55:06Z

@devimc @grahamwhaley @mcastelino could you review/approve this PR?

tcthorn-intel · 2017-09-12T16:56:11Z

Hi @jodh-intel Not a problem, I've attached the logfile.

typescript.txt

jodh-intel · 2017-09-13T08:44:09Z

Hi @tcthorn-intel - I can't be sure, but your typescript suggests you were running on a RHEL system. If so, that's the problem - this PR is only for CentOS 7.

jodh-intel · 2017-09-13T08:45:22Z

@gorozco1 - I'd love this to be merged as this PR has been open waaaaaaaay too long imho. We need atleast 1 independent test of it though. Do you want to give it a go?

tcthorn-intel · 2017-09-13T17:52:16Z

Hi @jodh-intel - The system was built with Centos 7.0. I rebuilt it prior to submitting my findings to make sure it wasn't something I had done.

gorozco1 · 2017-09-13T18:22:13Z

@jodh-intel I just tried the last bits of this PR and it works as expected. lgtm

jodh-intel · 2017-09-14T07:20:11Z

Hi @tcthorn-intel - ok. Although it isn't stipulated in the doc, there is a tacit assumption that this be run on a fully-updated system. The script does update all packages with yum, but maybe the problems you are seeing somehow result from starting with a 7.0 system (rather than a more recent 7.3 one) without a reboot?

@gorozco1 - thanks for the ack. Just need one more from an approver...

sameo · 2017-09-14T10:46:05Z

LGTM

tcthorn-intel · 2017-09-14T19:14:47Z

Hi @jodh-intel - I can retry with 7.3 if you'd like. However, not to be a pain or anything - if that's the cause of the issue I saw, I would recommend stating somewhere near the top the exact release that it has been tested on. At present it just says "CentOS version 7", and that implies that it works either only on 7.0, or all of the 7 series (which would include 7.0).. Having spent time in both validation and customer support groups - if it's left undefined, someone will try it with the random 7.x install they have just laying around and fully patch it to the latest CentOS packages available for that release (per instructions), which may or may not work.

That's just my $.02 though.

gorozco1 · 2017-09-14T19:33:13Z

It was tested in CentOS Linux release 7.3.1611

tcthorn-intel · 2017-09-14T19:38:32Z

@gorozco1 Thanks!

jodh-intel added the in progress label Jul 28, 2017

chavafg mentioned this pull request Aug 3, 2017

Test runtime/pr372 under RHEL clearcontainers/tests#311

Open

jodh-intel mentioned this pull request Aug 10, 2017

cc-runtime: Does not build on RHEL systems due glibc-static package missing clearcontainers/packaging#38

Closed

jodh-intel mentioned this pull request Aug 11, 2017

docs : Automate release notes #410

Merged

jodh-intel force-pushed the add-centos-install-doc branch from a04cfa6 to 2a782dd Compare August 15, 2017 15:44

jodh-intel force-pushed the add-centos-install-doc branch from 2a782dd to 44572bc Compare August 16, 2017 15:57

gorozco1 reviewed Sep 8, 2017

View reviewed changes

jodh-intel force-pushed the add-centos-install-doc branch from bdfd5ab to 64ace3a Compare September 11, 2017 08:29

jodh-intel force-pushed the add-centos-install-doc branch from 64ace3a to 155f374 Compare September 11, 2017 08:33

sameo merged commit d34cdad into clearcontainers:master Sep 14, 2017

sameo removed in progress release gating labels Sep 14, 2017

docs: Create CentOS installation guide #372

docs: Create CentOS installation guide #372

Conversation

jodh-intel commented Jul 28, 2017 • edited Loading

jodh-intel commented Jul 28, 2017

coveralls commented Jul 28, 2017 • edited Loading

jodh-intel commented Jul 28, 2017

GabyCT commented Aug 1, 2017

jodh-intel commented Aug 8, 2017

GabyCT commented Aug 10, 2017

gorozco1 commented Aug 10, 2017

jodh-intel commented Aug 10, 2017

GabyCT commented Aug 11, 2017

coveralls commented Aug 15, 2017 • edited Loading

GabyCT commented Aug 15, 2017

GabyCT commented Aug 15, 2017

GabyCT commented Aug 15, 2017

GabyCT commented Aug 15, 2017

GabyCT commented Aug 15, 2017

jodh-intel commented Aug 16, 2017

GabyCT commented Aug 16, 2017

chavafg commented Aug 16, 2017

GabyCT commented Aug 16, 2017

GabyCT commented Aug 16, 2017

chavafg commented Aug 16, 2017

GabyCT commented Aug 16, 2017

jodh-intel commented Aug 16, 2017

coveralls commented Aug 16, 2017 • edited Loading

eadamsintel commented Sep 8, 2017

jodh-intel commented Sep 8, 2017

gorozco1 Sep 8, 2017

Choose a reason for hiding this comment

gorozco1 Sep 8, 2017

Choose a reason for hiding this comment

gorozco1 Sep 8, 2017

Choose a reason for hiding this comment

eadamsintel commented Sep 10, 2017 • edited Loading

jodh-intel commented Sep 11, 2017

coveralls commented Sep 11, 2017 • edited Loading

clearcontainersbot commented Sep 11, 2017

coveralls commented Sep 11, 2017 • edited Loading

clearcontainersbot commented Sep 11, 2017

jodh-intel commented Sep 11, 2017

tcthorn-intel commented Sep 12, 2017

jodh-intel commented Sep 12, 2017

gorozco1 commented Sep 12, 2017

gorozco1 commented Sep 12, 2017

tcthorn-intel commented Sep 12, 2017

jodh-intel commented Sep 13, 2017

jodh-intel commented Sep 13, 2017

tcthorn-intel commented Sep 13, 2017

gorozco1 commented Sep 13, 2017

jodh-intel commented Sep 14, 2017

sameo commented Sep 14, 2017 • edited by grahamwhaley Loading

tcthorn-intel commented Sep 14, 2017

gorozco1 commented Sep 14, 2017

tcthorn-intel commented Sep 14, 2017

jodh-intel commented Jul 28, 2017 •

edited

Loading

coveralls commented Jul 28, 2017 •

edited

Loading

coveralls commented Aug 15, 2017 •

edited

Loading

coveralls commented Aug 16, 2017 •

edited

Loading

eadamsintel commented Sep 10, 2017 •

edited

Loading

coveralls commented Sep 11, 2017 •

edited

Loading

coveralls commented Sep 11, 2017 •

edited

Loading

sameo commented Sep 14, 2017 •

edited by grahamwhaley

Loading