Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix user for binding tests #96

Merged
merged 14 commits into from
Dec 3, 2019
Merged

Conversation

BenjaminRodenberg
Copy link
Member

@BenjaminRodenberg BenjaminRodenberg commented Sep 18, 2019

We should use USER precice for the bindings tests, as well.

This PR should only be merged after #123 has been merged.

@BenjaminRodenberg BenjaminRodenberg self-assigned this Sep 18, 2019
@BenjaminRodenberg
Copy link
Member Author

BenjaminRodenberg commented Sep 18, 2019

I observed that sudo apt install python3-pip does not work for Ubuntu 18.04, since the version is too old (see https://github.com/precice/precice/wiki/Non%E2%80%93standard-APIs#python-bindings-version-of-pip3-is-too-old). We have to install pip3 using wget ... && python3 get_pip.py (currently installs: version 19.2.3) instead.

I believe that at an earlier point in time pip3 provided via apt was sufficient (pip3 version 9.0.1 on Ubuntu1804). This was also the original reason for providing Test_bindings and Test_bindings.Ubuntu1804. We obviously have a regression here...

I do not know, when we actually introduced changes that broke compatibility with pip 9.0.1. I am also not 100% sure whether we should try to make the python bindings compatible with pip 9.0.1, again, or whether the current state is fine (for sure running apt install pip3 is simpler than the current approach...).

Any opinions on this question

I am currently investigating the situation if I use Ubuntu 19.04. Edit: See #97

@BenjaminRodenberg BenjaminRodenberg added the bug Something isn't working label Sep 18, 2019
@BenjaminRodenberg
Copy link
Member Author

@shkodm Something else seems not to work with the runner scripts: https://travis-ci.org/precice/systemtests/jobs/586477760#L445-L452

@BenjaminRodenberg
Copy link
Member Author

On Ubuntu 1904, we can actually use the pip provided via apt. See #97

@shkodm
Copy link
Contributor

shkodm commented Sep 18, 2019

@shkodm Something else seems not to work with the runner scripts: https://travis-ci.org/precice/systemtests/jobs/586477760#L445-L452

Nice catch. I will fix that.

@BenjaminRodenberg BenjaminRodenberg changed the base branch from master to develop November 27, 2019 11:05
@BenjaminRodenberg BenjaminRodenberg marked this pull request as ready for review November 28, 2019 18:45
@BenjaminRodenberg BenjaminRodenberg deleted the BenjaminRueth-patch-users branch December 19, 2019 15:30
Eder-K added a commit that referenced this pull request Jan 15, 2020
* Update travis job name for Bindings

* Add `allowed_failures` section to travis.yml

Also adds the currently failing Ubuntu1804.sudo.mpich job to this
section.

For a job to be allowed to fail, it must be added to both the `include`
and `allowed_failures` sections.
A failure of such a job will not cause subseqent stages to be
cancelled.

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Fix docker username on login (#109)

* Fix custom tags for adapter images #109

Closes #109

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Improve log header info (#107)

* Improve automatic commit messages (#106)

* New referenceOutput for fe-fe.Ubuntu1804.home

* Removing all changes from trigger_systemtests.py for customised testing

* Reverting more changes done for customised testing

* Removing whitespace in trigger file

* Fix dimension setting for reference data

* Print build ID when systemtest is triggered (#105)

Closes #105

* Print build number instead of build ID (#105)

* Update job title to explain failure tolerance

* Match job titles in include and allow_failures

* Fix travis job list

* Fix ubuntu1804.home tag

* Use deployment instead of `after_success` (#116)

Clean up travis structure

Add documentation for adding tests and handling deploy

Closes #103

* Only specify job name in `allow_failures` (#117)

Closes #117

[skip travis]

* Pull from repository before pushing (#118)

Issue a `git pull --rebase` before pushing to
precice_st_output. This should help scripts erroring
due to missing commits in local version.

Closes #118

* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* update installation procedure for python bindings

* use precice Repository

* Fix folder creation wrt user rights

* Use precice repository and fix users

* Navigate to correct folder

* Navigate to correct folder and run correct command

Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>
Eder-K added a commit that referenced this pull request May 5, 2020
* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* Fix tests failing due to no output (#148)

* Remove non-tests temporarily

* Remove log surpression

* Remove -d argument`

* Fix replacement of xml element

* nutils-of: Fix replacement of xml element (#149)

* Fix of-of and of-of_np (#150)

* of-of: Fix replacement of xml element

* of-of_np: Fix replacement of xml element

* Replace post-processing with acceleration using sed

* Replace post-processing with acceleration using sed

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 2460f9a.

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 832ce4a.

* escapte double quotes

* Escape quotes

Co-authored-by: Konrad Eder <[email protected]>

* Fix Calculix-OpenFOAM (#153)

Update the locally stored config file according to tutorials#60

* Fix SU2-Calculix (#152)

* Update configuration filename

* Run silent_compose in detached mode

* Revert '-d' argument adding

* Redirect ccx output to logfile

* Redirect ccx output to null

* Fix dealii-of and ccx-of_fsi [PETSc] (#154)

* Update sed insertion according to tutorials#60

* Update config.xml names for of-ccx.FSI.petsc

* Surpress of-adapter output

* Fix participant name

* Remove output surpression

* Restore silent functionality

* Add optional debug argument

* Add verbose optional argument

* Escape dots

* Delay of container start

* Run nutils-of in verbose mode

* Add success message

* Fix typo

* Add PETSc of-ccx to allowed failures

* Update PETSc of-ccx name

* Remove line

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of (#157)

* Remove sleep command

* Use exit codes for success as well

* Add tests for bindings on Ubuntu 18.04 (#129)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

* Revert "Add tests for bindings on Ubuntu 18.04 (#129)" (#159)

* Update solverdummy location (#162)

* Install Eigen from source for Ubuntu 16.04 (#163)

* Identify requests from TravisCI website (#165)

* Remove test for preCICE package Ubuntu 16.04

* Add installation of pkg-config (#166)

72a0bd7 switched from installing eigen via apt to installing eigen from source. This results in also not installing pkg-config that is a dependency of eigen. Therefore we now have to individually install pkg-config. Otherwise builds under Ubuntu16.04 relying on pkg-config will fail.

* Restructure tools and bindings (#164)

* Update path of solverdummies. Was changed in precice/precice#630 from tools/solverdummies to examples/solverdummies.

* Update use new repository fortran-module for f2003 solverdummy and corresponding bindings

Co-authored-by: Gerasimos Chourdakis <[email protected]>

* Allow failure for adapters depending on PETSc

* Fix typo

* Fix Test_bindings

* Change timestep-length to time-window-size

* Adapt CMake variables for preCICE v2 (#167)

See precice/precice#609

* Add system_testing.py example

* Update reference results for su2-ccx test case (#172)

* Update column names of reference files (#168)

* Update headers for fe-fe test

* provoke test failure with wrong reference

* Revert "provoke test failure with wrong reference"

This reverts commit 90ff76e.

* Update column names for fe-fe 1804

* Fix md link

* Remove .gitkeep

* Update column names

* Remove string filter

* Update column names

* Add missing spaces

* Add spacing

* Restore filtering

* reintroduce whitespace errors to make tests succeed

Co-authored-by: Konrad Eder <[email protected]>

* Update openfoam-adapter in accordance with config changes (#174)

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Update to OF5

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Update referenceOutput for OF5

* Readd preCICE building

* Add python script for building images and pushing them (#131)

* add system tests for cplscheme

* add cplscheme test

* run cplscheme test as local test

* use Ubuntu 18.04 as base image

* Use system_testing.py instead of local_test.py

Changed this, since this is the correct way to do it. local_test.py is only meant for local tests. I had to add an additional build stage that uses the debugMasterSockets branch on the preCICE main repository.

* Fix indentation

* Fix --build-arg and add a Ubuntu18.04 build

* first draft solution for #77

* roll out changes to all base images

* remove default docker username to force user to provide it and avoid inconsistencies

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* add argument to switch petsc on/off

* remove unrelated change

* remove unrelated files

* modify tag depending on petsc

* Factor out tag composition

* Add script for pushing

* Use benjaminrueth and push_base.py

* Fix and document tagging

* temporarily allow failure

* Use a more explicit name for script

* Extract features in python scripts. Introduces some code duplication, but is more flexible. Code duplication will be removed as soon as #137 is solved.

* fix error

* Use list to keep track of features, add petsc as feature to list for better consistency

* use python script for building and pushing adapters

* Fix syntax errors

* Use dict instead of list

This is a partial remedy for the problem mentioned in #131 (comment)

* Update push_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update push_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* use dict.get for less verbose code

* Fix error

* Filter away None

* Use less verbose approach

Co-authored-by: Konrad Eder <[email protected]>

* Overhaul pushing to precice_st_output (#147)

* Add file

* Replace pushing script

* Add pull --rebase to final push

* Allow -t, -s arguments for now

* Add readme to job folders

* Format bash commands

* Fix variable

* Comment out unneeded functions

* Add pushing failsafe

* Improve commit msg

* Fix function import

* Improve README generation

* Fix parenthesis

* Fix formatting

* Fix variable

* Add wrapping quotes

* Improve readme generation

* Fix indents

* Fix word

* Add message after test success

* Only run tests

* Replace deploy with after_success

* Update push command structure

* Add log pushing

* Add log pushing

* Add logging command

* Fix indent

* Fix variable name

* Fix variable name again

* Fix import

* Fix variable name

* Rename logfile

* Rename log file

* Make output files optional

* Formatting

* Fix variable name

* Fix var name

* Fix name

* Uncomment mkdir line

* Adjust commit msg building

* Add debug print

* Add debug prints

* Compare with string instead of integer

* Enable verbose output

* Add Logs to ignored files

* Fix base selection

* Reuse of container delay

* Revert travis xml to original

* Move test templates into separate directory

* Use jinja for readme templating

* Move test templates into separate directory

* Move test templates into separate directory

* Add missing logs msg

* Add missing log message

* Add general information

* Check if output is enabled

* Remove comment block

* Compare text columns as well

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Add branch info

* Add branch info

* Remove old pushing script

* Update to OF5

* Fix line

* Install Jinja2

* Fix path

* Fix compare script

* Enable output for OF tests

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Only run tests

* Rename nutils test

* Revert compare script to develop version

* Remove sleep command

* Restore travis jobs

* Fix variable name

* Insert job name in folder name instead

* Set default branch to master

* Move job name into commit msg

* Update reference data for of-ccx_fsi PETSc (#177)

* Update reference data

* Remove 0.orig

* Update folder naming

* Identify PETSc feature

* Build preCICE with Debug (#175)

* Only install minimal python depdendencies manually

* Update to newest pip version
* Use pyproject.toml for installation of all python depdendencies

* Download boost from sourceforge (#196)

* Add verbose to local_test (#191)

* Add bindings test for Ubuntu 18.04 (#160)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Rüth <[email protected]>

* Update deploy section in bindings 1804

* Explicitly list variables when rendering jinja template (#199)

* Replace locals() with explicit list

* Replace locals() with explicit list

* Clarify variable name

* Fix variable

* Check column names in compare_results.sh (#173)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Add seperating line

* Add prints for script start and end

* Update preciceDict

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of test (#178)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Add delay to OF container

* Enable verbose output

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Perform clean OF5 install instead of folder copy

* Temporarily run docker push not in deploy

* Add seperating line

* Fix dockerfile argument

* Use folder-copy method

* Add prints for script start and end

* Update preciceDict

* Move comment

* Update reference files

* Clean up job names

Co-authored-by: Benjamin Rüth <[email protected]>

* Use TRAVIS_BRANCH to select branch of toolchain being tested (#136)

* Use TRAVIS_BRANCH to select branch of toolchain being tested #125

* Add logic to also support pull requests

* Fix syntax error

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* use correct build-arg for OF Adapter

* Fix syntax

* Remove preCICe builds

* Print wmake.log

* Use --branch option for all tests

* Add jinja2 (accidentally removed in merge)

* Revert changes applied to reference output

* Reintroduce changes from #147 (accidentally removed in merge)

* Remove libyaml-cpp-dev

* Add missing line

* Add TRAVIS_BRANCH to bindings 18.04

Co-authored-by: Rüth <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>

* Fix OF-OF nearest projection (#203)

* Apply #206 to develop (#208)

* Add documentation entry for renewing token (#210)

* Disable currently failing tests

* Disable dealii-of

* Extend log pushing to precice_st_output (#201)

* Add adapter and precice logs

* Add push commands for precice and adapter builds

* Fix indent

* Move variable declaration

* Add log extraction for OF adapters

* Add image tag as environ variable

* Add log extraction for adapters

* Add info on job type

* Add comma

* Move variable

* Create folder earlier

* Add debug print

* Add debug print

* Add print at end of script

* Fix variable

* Remove export command

* Store tag in intermediary file

* Import common

* Change sourcing command

* Fix file reading

* Add print

* Use file writer instead of env variable

* Add debug print

* FormattingFormattingFormattingFormattingFormattingFormattingFormattingFormattingFormatting

* Remove file after reading

* Create temporary container

* Add try/except for Travis log requests

* Call container by name

* Insert launch command

* Fix launch command

* Simplfy Logs folder creation

* Fix Logs folder location

* Fix folder path

* Remove .home

* Fix import

* Fix import

* Add line

* Add debug print

* Fix symbol

* Fix docker copy

* Add zero padding for job names

* Make logs folder before test start

* Add debug print

* Remove debug prints

* Remove try-except block

* Skip request call

* Add headers for log request

* Fix variable name

* Improve clarity when triggering systemtest (#213)

* Only test adapters

* Trigger build with updated token

* Only run dealii

* Update push script call

* Fix bracket

* Fix bracket

* Add link to build

* Flush output

* Add prints on exit

* Add visual separators

* Wrap link

* Restore travis.yml

* Test dealii trigger

* Add coloring

* Format line

* Remove experimental trigger test

* Add correct tags

* Fix test timeouts (#216)

* Make tests verbose

* Shorten timesteps to 100 from 400

* Combine directory creation commands

* Enable result output for Su2-ccx and nutils-of

* Update referenceOutput

* Truncate unnecessary jobs

* Exclude events log from reference

* Exclude events log from reference

* Adjust path

* Update fortran dummy execution

* Update fortran dummy execution

* Reduce dealii-of runtime from 5 to 1

* Adjust referenceOutput

* Restore travis.yml

* Fix log copy

* Patch SU2-CCX test output (#217)

* Fix log copy

* Add watchpoint log to output

* Adjust branch argument

* Enable output

* Restore .travis.yml

* Update watchpoing log

* Deactivate nutils-of test

* Mark su2-ccx test as unstable

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Rüth <[email protected]>
Eder-K added a commit that referenced this pull request May 6, 2020
* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* Fix tests failing due to no output (#148)

* Remove non-tests temporarily

* Remove log surpression

* Remove -d argument`

* Fix replacement of xml element

* nutils-of: Fix replacement of xml element (#149)

* Fix of-of and of-of_np (#150)

* of-of: Fix replacement of xml element

* of-of_np: Fix replacement of xml element

* Replace post-processing with acceleration using sed

* Replace post-processing with acceleration using sed

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 2460f9a.

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 832ce4a.

* escapte double quotes

* Escape quotes

Co-authored-by: Konrad Eder <[email protected]>

* Fix Calculix-OpenFOAM (#153)

Update the locally stored config file according to tutorials#60

* Fix SU2-Calculix (#152)

* Update configuration filename

* Run silent_compose in detached mode

* Revert '-d' argument adding

* Redirect ccx output to logfile

* Redirect ccx output to null

* Fix dealii-of and ccx-of_fsi [PETSc] (#154)

* Update sed insertion according to tutorials#60

* Update config.xml names for of-ccx.FSI.petsc

* Surpress of-adapter output

* Fix participant name

* Remove output surpression

* Restore silent functionality

* Add optional debug argument

* Add verbose optional argument

* Escape dots

* Delay of container start

* Run nutils-of in verbose mode

* Add success message

* Fix typo

* Add PETSc of-ccx to allowed failures

* Update PETSc of-ccx name

* Remove line

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of (#157)

* Remove sleep command

* Use exit codes for success as well

* Add tests for bindings on Ubuntu 18.04 (#129)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

* Revert "Add tests for bindings on Ubuntu 18.04 (#129)" (#159)

* Update solverdummy location (#162)

* Install Eigen from source for Ubuntu 16.04 (#163)

* Identify requests from TravisCI website (#165)

* Remove test for preCICE package Ubuntu 16.04

* Add installation of pkg-config (#166)

72a0bd7 switched from installing eigen via apt to installing eigen from source. This results in also not installing pkg-config that is a dependency of eigen. Therefore we now have to individually install pkg-config. Otherwise builds under Ubuntu16.04 relying on pkg-config will fail.

* Restructure tools and bindings (#164)

* Update path of solverdummies. Was changed in precice/precice#630 from tools/solverdummies to examples/solverdummies.

* Update use new repository fortran-module for f2003 solverdummy and corresponding bindings

Co-authored-by: Gerasimos Chourdakis <[email protected]>

* Allow failure for adapters depending on PETSc

* Fix typo

* Fix Test_bindings

* Change timestep-length to time-window-size

* Adapt CMake variables for preCICE v2 (#167)

See precice/precice#609

* Add system_testing.py example

* Update reference results for su2-ccx test case (#172)

* Update column names of reference files (#168)

* Update headers for fe-fe test

* provoke test failure with wrong reference

* Revert "provoke test failure with wrong reference"

This reverts commit 90ff76e.

* Update column names for fe-fe 1804

* Fix md link

* Remove .gitkeep

* Update column names

* Remove string filter

* Update column names

* Add missing spaces

* Add spacing

* Restore filtering

* reintroduce whitespace errors to make tests succeed

Co-authored-by: Konrad Eder <[email protected]>

* Update openfoam-adapter in accordance with config changes (#174)

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Update to OF5

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Update referenceOutput for OF5

* Readd preCICE building

* Add python script for building images and pushing them (#131)

* add system tests for cplscheme

* add cplscheme test

* run cplscheme test as local test

* use Ubuntu 18.04 as base image

* Use system_testing.py instead of local_test.py

Changed this, since this is the correct way to do it. local_test.py is only meant for local tests. I had to add an additional build stage that uses the debugMasterSockets branch on the preCICE main repository.

* Fix indentation

* Fix --build-arg and add a Ubuntu18.04 build

* first draft solution for #77

* roll out changes to all base images

* remove default docker username to force user to provide it and avoid inconsistencies

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* add argument to switch petsc on/off

* remove unrelated change

* remove unrelated files

* modify tag depending on petsc

* Factor out tag composition

* Add script for pushing

* Use benjaminrueth and push_base.py

* Fix and document tagging

* temporarily allow failure

* Use a more explicit name for script

* Extract features in python scripts. Introduces some code duplication, but is more flexible. Code duplication will be removed as soon as #137 is solved.

* fix error

* Use list to keep track of features, add petsc as feature to list for better consistency

* use python script for building and pushing adapters

* Fix syntax errors

* Use dict instead of list

This is a partial remedy for the problem mentioned in #131 (comment)

* Update push_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update push_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* use dict.get for less verbose code

* Fix error

* Filter away None

* Use less verbose approach

Co-authored-by: Konrad Eder <[email protected]>

* Overhaul pushing to precice_st_output (#147)

* Add file

* Replace pushing script

* Add pull --rebase to final push

* Allow -t, -s arguments for now

* Add readme to job folders

* Format bash commands

* Fix variable

* Comment out unneeded functions

* Add pushing failsafe

* Improve commit msg

* Fix function import

* Improve README generation

* Fix parenthesis

* Fix formatting

* Fix variable

* Add wrapping quotes

* Improve readme generation

* Fix indents

* Fix word

* Add message after test success

* Only run tests

* Replace deploy with after_success

* Update push command structure

* Add log pushing

* Add log pushing

* Add logging command

* Fix indent

* Fix variable name

* Fix variable name again

* Fix import

* Fix variable name

* Rename logfile

* Rename log file

* Make output files optional

* Formatting

* Fix variable name

* Fix var name

* Fix name

* Uncomment mkdir line

* Adjust commit msg building

* Add debug print

* Add debug prints

* Compare with string instead of integer

* Enable verbose output

* Add Logs to ignored files

* Fix base selection

* Reuse of container delay

* Revert travis xml to original

* Move test templates into separate directory

* Use jinja for readme templating

* Move test templates into separate directory

* Move test templates into separate directory

* Add missing logs msg

* Add missing log message

* Add general information

* Check if output is enabled

* Remove comment block

* Compare text columns as well

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Add branch info

* Add branch info

* Remove old pushing script

* Update to OF5

* Fix line

* Install Jinja2

* Fix path

* Fix compare script

* Enable output for OF tests

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Only run tests

* Rename nutils test

* Revert compare script to develop version

* Remove sleep command

* Restore travis jobs

* Fix variable name

* Insert job name in folder name instead

* Set default branch to master

* Move job name into commit msg

* Update reference data for of-ccx_fsi PETSc (#177)

* Update reference data

* Remove 0.orig

* Update folder naming

* Identify PETSc feature

* Build preCICE with Debug (#175)

* Only install minimal python depdendencies manually

* Update to newest pip version
* Use pyproject.toml for installation of all python depdendencies

* Download boost from sourceforge (#196)

* Add verbose to local_test (#191)

* Add bindings test for Ubuntu 18.04 (#160)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Rüth <[email protected]>

* Update deploy section in bindings 1804

* Explicitly list variables when rendering jinja template (#199)

* Replace locals() with explicit list

* Replace locals() with explicit list

* Clarify variable name

* Fix variable

* Check column names in compare_results.sh (#173)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Add seperating line

* Add prints for script start and end

* Update preciceDict

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of test (#178)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Add delay to OF container

* Enable verbose output

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Perform clean OF5 install instead of folder copy

* Temporarily run docker push not in deploy

* Add seperating line

* Fix dockerfile argument

* Use folder-copy method

* Add prints for script start and end

* Update preciceDict

* Move comment

* Update reference files

* Clean up job names

Co-authored-by: Benjamin Rüth <[email protected]>

* Use TRAVIS_BRANCH to select branch of toolchain being tested (#136)

* Use TRAVIS_BRANCH to select branch of toolchain being tested #125

* Add logic to also support pull requests

* Fix syntax error

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* use correct build-arg for OF Adapter

* Fix syntax

* Remove preCICe builds

* Print wmake.log

* Use --branch option for all tests

* Add jinja2 (accidentally removed in merge)

* Revert changes applied to reference output

* Reintroduce changes from #147 (accidentally removed in merge)

* Remove libyaml-cpp-dev

* Add missing line

* Add TRAVIS_BRANCH to bindings 18.04

Co-authored-by: Rüth <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>

* Fix OF-OF nearest projection (#203)

* Apply #206 to develop (#208)

* Add documentation entry for renewing token (#210)

* Disable currently failing tests

* Disable dealii-of

* Extend log pushing to precice_st_output (#201)

* Add adapter and precice logs

* Add push commands for precice and adapter builds

* Fix indent

* Move variable declaration

* Add log extraction for OF adapters

* Add image tag as environ variable

* Add log extraction for adapters

* Add info on job type

* Add comma

* Move variable

* Create folder earlier

* Add debug print

* Add debug print

* Add print at end of script

* Fix variable

* Remove export command

* Store tag in intermediary file

* Import common

* Change sourcing command

* Fix file reading

* Add print

* Use file writer instead of env variable

* Add debug print

* FormattingFormattingFormattingFormattingFormattingFormattingFormattingFormattingFormatting

* Remove file after reading

* Create temporary container

* Add try/except for Travis log requests

* Call container by name

* Insert launch command

* Fix launch command

* Simplfy Logs folder creation

* Fix Logs folder location

* Fix folder path

* Remove .home

* Fix import

* Fix import

* Add line

* Add debug print

* Fix symbol

* Fix docker copy

* Add zero padding for job names

* Make logs folder before test start

* Add debug print

* Remove debug prints

* Remove try-except block

* Skip request call

* Add headers for log request

* Fix variable name

* Improve clarity when triggering systemtest (#213)

* Only test adapters

* Trigger build with updated token

* Only run dealii

* Update push script call

* Fix bracket

* Fix bracket

* Add link to build

* Flush output

* Add prints on exit

* Add visual separators

* Wrap link

* Restore travis.yml

* Test dealii trigger

* Add coloring

* Format line

* Remove experimental trigger test

* Add correct tags

* Fix test timeouts (#216)

* Make tests verbose

* Shorten timesteps to 100 from 400

* Combine directory creation commands

* Enable result output for Su2-ccx and nutils-of

* Update referenceOutput

* Truncate unnecessary jobs

* Exclude events log from reference

* Exclude events log from reference

* Adjust path

* Update fortran dummy execution

* Update fortran dummy execution

* Reduce dealii-of runtime from 5 to 1

* Adjust referenceOutput

* Restore travis.yml

* Fix log copy

* Patch SU2-CCX test output (#217)

* Fix log copy

* Add watchpoint log to output

* Adjust branch argument

* Enable output

* Restore .travis.yml

* Update watchpoing log

* Deactivate nutils-of test

* Mark su2-ccx test as unstable

* Update trigger script in accordance with #147

* Add correct tagging for systest triggers

* Use manual tag for docker image

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Rüth <[email protected]>
Eder-K added a commit that referenced this pull request May 15, 2020
* Add test for elastictube1d tutorial

* Add referenceOutput for elastictube1d test

* Add travis commands for elastictube1d test

* Add 1dtube to solver directory

* Fix wording

* Print avg/max diff values after file content

Moves the diff command above the line printing avg and max diff.
This is to make it easier to see average/maximal diff values when
the amount of line differences are very large in a file. Otherwise
the 'diff' command might flood the output and make the avg/max
line hard to find.

* Add 1dtube to test_type

* Rename test to describe python version

* Add test for c++ version

* Add C++ version of elastictube1d test

* Differentiate py and cxx version of elastictube1d

* Add C++ version of elastictube1d test

* Add missing root permissions for copying results

[ci-skip]

* Update name of 1dtube argument

* Remove wrong cp command

[ci skip]

* Run whole Dockerfile as root

* Remove unnecessary abbreviations

* Update 1dtube test names

* Update 1dtube test names

* Merge with develop and update to more recent folder structure (#155)

* Update travis job name for Bindings

* Add `allowed_failures` section to travis.yml

Also adds the currently failing Ubuntu1804.sudo.mpich job to this
section.

For a job to be allowed to fail, it must be added to both the `include`
and `allowed_failures` sections.
A failure of such a job will not cause subseqent stages to be
cancelled.

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Fix docker username on login (#109)

* Fix custom tags for adapter images #109

Closes #109

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Improve log header info (#107)

* Improve automatic commit messages (#106)

* New referenceOutput for fe-fe.Ubuntu1804.home

* Removing all changes from trigger_systemtests.py for customised testing

* Reverting more changes done for customised testing

* Removing whitespace in trigger file

* Fix dimension setting for reference data

* Print build ID when systemtest is triggered (#105)

Closes #105

* Print build number instead of build ID (#105)

* Update job title to explain failure tolerance

* Match job titles in include and allow_failures

* Fix travis job list

* Fix ubuntu1804.home tag

* Use deployment instead of `after_success` (#116)

Clean up travis structure

Add documentation for adding tests and handling deploy

Closes #103

* Only specify job name in `allow_failures` (#117)

Closes #117

[skip travis]

* Pull from repository before pushing (#118)

Issue a `git pull --rebase` before pushing to
precice_st_output. This should help scripts erroring
due to missing commits in local version.

Closes #118

* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* update installation procedure for python bindings

* use precice Repository

* Fix folder creation wrt user rights

* Use precice repository and fix users

* Navigate to correct folder

* Navigate to correct folder and run correct command

Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>

* Use branch of PR precice/elastictube1d#22 until it is merged

* Revert "Use branch of PR precice/elastictube1d#22 until it is merged"

This reverts commit bdc1b17.

* Update referenceOutput files for 1dtube_py (#161)

* Add os version to foldername

* Add 1dtube cxx to compose tests

* Remove folder permission

* Only run elastictube tests

* Add env variable

* Restore user creation

* Add permissions

* Remove unused volumes

* Make elastictube tests verbose

* Update 1dtube cxx reference

* Use default develop branch

* Improve text filter in compare_results.sh (#212)

* Add timestamp filter

* Restructure filtering

* Adjust referenceOutput

* Revert default preCICE branch to develop

* Restore TRAVIS_BRANCH

This reverts commit 288f71b.

* Run on develop instead of TRAVIS_BRANCH

* Run on develop instead of TRAVIS_BRANCH

* Remove branch arg, use default setting

* Use precice develop for tests

* Enable output

* Enable full diff print

* Update reference output

* Update outdated argument

* Remove events-summary from copied logs

* Add small message to each comparison

* Purge reference

* Update referenceOutput

* Convert 1dtube-py to compose test

* Add debug print

* Update reference for 1dtube-py

* Restore travis.yml

* Use default precice version (develop)

* Make default precice branch develop

* Shorten of-ccx petsc test from 5 to 1

* Update reference

* Fix yml syntax

* Fix style

Co-authored-by: Benjamin Rüth <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>
Co-authored-by: ishaandesai <[email protected]>
Eder-K added a commit that referenced this pull request Jun 18, 2020
* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* Fix tests failing due to no output (#148)

* Remove non-tests temporarily

* Remove log surpression

* Remove -d argument`

* Fix replacement of xml element

* nutils-of: Fix replacement of xml element (#149)

* Fix of-of and of-of_np (#150)

* of-of: Fix replacement of xml element

* of-of_np: Fix replacement of xml element

* Replace post-processing with acceleration using sed

* Replace post-processing with acceleration using sed

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 2460f9a.

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 832ce4a.

* escapte double quotes

* Escape quotes

Co-authored-by: Konrad Eder <[email protected]>

* Fix Calculix-OpenFOAM (#153)

Update the locally stored config file according to tutorials#60

* Fix SU2-Calculix (#152)

* Update configuration filename

* Run silent_compose in detached mode

* Revert '-d' argument adding

* Redirect ccx output to logfile

* Redirect ccx output to null

* Fix dealii-of and ccx-of_fsi [PETSc] (#154)

* Update sed insertion according to tutorials#60

* Update config.xml names for of-ccx.FSI.petsc

* Surpress of-adapter output

* Fix participant name

* Remove output surpression

* Restore silent functionality

* Add optional debug argument

* Add verbose optional argument

* Escape dots

* Delay of container start

* Run nutils-of in verbose mode

* Add success message

* Fix typo

* Add PETSc of-ccx to allowed failures

* Update PETSc of-ccx name

* Remove line

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of (#157)

* Remove sleep command

* Use exit codes for success as well

* Add tests for bindings on Ubuntu 18.04 (#129)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

* Revert "Add tests for bindings on Ubuntu 18.04 (#129)" (#159)

* Update solverdummy location (#162)

* Install Eigen from source for Ubuntu 16.04 (#163)

* Identify requests from TravisCI website (#165)

* Remove test for preCICE package Ubuntu 16.04

* Add installation of pkg-config (#166)

72a0bd7 switched from installing eigen via apt to installing eigen from source. This results in also not installing pkg-config that is a dependency of eigen. Therefore we now have to individually install pkg-config. Otherwise builds under Ubuntu16.04 relying on pkg-config will fail.

* Restructure tools and bindings (#164)

* Update path of solverdummies. Was changed in precice/precice#630 from tools/solverdummies to examples/solverdummies.

* Update use new repository fortran-module for f2003 solverdummy and corresponding bindings

Co-authored-by: Gerasimos Chourdakis <[email protected]>

* Allow failure for adapters depending on PETSc

* Fix typo

* Fix Test_bindings

* Change timestep-length to time-window-size

* Adapt CMake variables for preCICE v2 (#167)

See precice/precice#609

* Add system_testing.py example

* Update reference results for su2-ccx test case (#172)

* Update column names of reference files (#168)

* Update headers for fe-fe test

* provoke test failure with wrong reference

* Revert "provoke test failure with wrong reference"

This reverts commit 90ff76e.

* Update column names for fe-fe 1804

* Fix md link

* Remove .gitkeep

* Update column names

* Remove string filter

* Update column names

* Add missing spaces

* Add spacing

* Restore filtering

* reintroduce whitespace errors to make tests succeed

Co-authored-by: Konrad Eder <[email protected]>

* Update openfoam-adapter in accordance with config changes (#174)

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Update to OF5

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Update referenceOutput for OF5

* Readd preCICE building

* Add python script for building images and pushing them (#131)

* add system tests for cplscheme

* add cplscheme test

* run cplscheme test as local test

* use Ubuntu 18.04 as base image

* Use system_testing.py instead of local_test.py

Changed this, since this is the correct way to do it. local_test.py is only meant for local tests. I had to add an additional build stage that uses the debugMasterSockets branch on the preCICE main repository.

* Fix indentation

* Fix --build-arg and add a Ubuntu18.04 build

* first draft solution for #77

* roll out changes to all base images

* remove default docker username to force user to provide it and avoid inconsistencies

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* add argument to switch petsc on/off

* remove unrelated change

* remove unrelated files

* modify tag depending on petsc

* Factor out tag composition

* Add script for pushing

* Use benjaminrueth and push_base.py

* Fix and document tagging

* temporarily allow failure

* Use a more explicit name for script

* Extract features in python scripts. Introduces some code duplication, but is more flexible. Code duplication will be removed as soon as #137 is solved.

* fix error

* Use list to keep track of features, add petsc as feature to list for better consistency

* use python script for building and pushing adapters

* Fix syntax errors

* Use dict instead of list

This is a partial remedy for the problem mentioned in #131 (comment)

* Update push_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update push_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* use dict.get for less verbose code

* Fix error

* Filter away None

* Use less verbose approach

Co-authored-by: Konrad Eder <[email protected]>

* Overhaul pushing to precice_st_output (#147)

* Add file

* Replace pushing script

* Add pull --rebase to final push

* Allow -t, -s arguments for now

* Add readme to job folders

* Format bash commands

* Fix variable

* Comment out unneeded functions

* Add pushing failsafe

* Improve commit msg

* Fix function import

* Improve README generation

* Fix parenthesis

* Fix formatting

* Fix variable

* Add wrapping quotes

* Improve readme generation

* Fix indents

* Fix word

* Add message after test success

* Only run tests

* Replace deploy with after_success

* Update push command structure

* Add log pushing

* Add log pushing

* Add logging command

* Fix indent

* Fix variable name

* Fix variable name again

* Fix import

* Fix variable name

* Rename logfile

* Rename log file

* Make output files optional

* Formatting

* Fix variable name

* Fix var name

* Fix name

* Uncomment mkdir line

* Adjust commit msg building

* Add debug print

* Add debug prints

* Compare with string instead of integer

* Enable verbose output

* Add Logs to ignored files

* Fix base selection

* Reuse of container delay

* Revert travis xml to original

* Move test templates into separate directory

* Use jinja for readme templating

* Move test templates into separate directory

* Move test templates into separate directory

* Add missing logs msg

* Add missing log message

* Add general information

* Check if output is enabled

* Remove comment block

* Compare text columns as well

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Add branch info

* Add branch info

* Remove old pushing script

* Update to OF5

* Fix line

* Install Jinja2

* Fix path

* Fix compare script

* Enable output for OF tests

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Only run tests

* Rename nutils test

* Revert compare script to develop version

* Remove sleep command

* Restore travis jobs

* Fix variable name

* Insert job name in folder name instead

* Set default branch to master

* Move job name into commit msg

* Update reference data for of-ccx_fsi PETSc (#177)

* Update reference data

* Remove 0.orig

* Update folder naming

* Identify PETSc feature

* Build preCICE with Debug (#175)

* Only install minimal python depdendencies manually

* Update to newest pip version
* Use pyproject.toml for installation of all python depdendencies

* Download boost from sourceforge (#196)

* Add verbose to local_test (#191)

* Add bindings test for Ubuntu 18.04 (#160)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Rüth <[email protected]>

* Update deploy section in bindings 1804

* Explicitly list variables when rendering jinja template (#199)

* Replace locals() with explicit list

* Replace locals() with explicit list

* Clarify variable name

* Fix variable

* Check column names in compare_results.sh (#173)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Add seperating line

* Add prints for script start and end

* Update preciceDict

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of test (#178)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Add delay to OF container

* Enable verbose output

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Perform clean OF5 install instead of folder copy

* Temporarily run docker push not in deploy

* Add seperating line

* Fix dockerfile argument

* Use folder-copy method

* Add prints for script start and end

* Update preciceDict

* Move comment

* Update reference files

* Clean up job names

Co-authored-by: Benjamin Rüth <[email protected]>

* Use TRAVIS_BRANCH to select branch of toolchain being tested (#136)

* Use TRAVIS_BRANCH to select branch of toolchain being tested #125

* Add logic to also support pull requests

* Fix syntax error

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* use correct build-arg for OF Adapter

* Fix syntax

* Remove preCICe builds

* Print wmake.log

* Use --branch option for all tests

* Add jinja2 (accidentally removed in merge)

* Revert changes applied to reference output

* Reintroduce changes from #147 (accidentally removed in merge)

* Remove libyaml-cpp-dev

* Add missing line

* Add TRAVIS_BRANCH to bindings 18.04

Co-authored-by: Rüth <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>

* Fix OF-OF nearest projection (#203)

* Apply #206 to develop (#208)

* Add documentation entry for renewing token (#210)

* Disable currently failing tests

* Disable dealii-of

* Extend log pushing to precice_st_output (#201)

* Add adapter and precice logs

* Add push commands for precice and adapter builds

* Fix indent

* Move variable declaration

* Add log extraction for OF adapters

* Add image tag as environ variable

* Add log extraction for adapters

* Add info on job type

* Add comma

* Move variable

* Create folder earlier

* Add debug print

* Add debug print

* Add print at end of script

* Fix variable

* Remove export command

* Store tag in intermediary file

* Import common

* Change sourcing command

* Fix file reading

* Add print

* Use file writer instead of env variable

* Add debug print

* FormattingFormattingFormattingFormattingFormattingFormattingFormattingFormattingFormatting

* Remove file after reading

* Create temporary container

* Add try/except for Travis log requests

* Call container by name

* Insert launch command

* Fix launch command

* Simplfy Logs folder creation

* Fix Logs folder location

* Fix folder path

* Remove .home

* Fix import

* Fix import

* Add line

* Add debug print

* Fix symbol

* Fix docker copy

* Add zero padding for job names

* Make logs folder before test start

* Add debug print

* Remove debug prints

* Remove try-except block

* Skip request call

* Add headers for log request

* Fix variable name

* Improve clarity when triggering systemtest (#213)

* Only test adapters

* Trigger build with updated token

* Only run dealii

* Update push script call

* Fix bracket

* Fix bracket

* Add link to build

* Flush output

* Add prints on exit

* Add visual separators

* Wrap link

* Restore travis.yml

* Test dealii trigger

* Add coloring

* Format line

* Remove experimental trigger test

* Add correct tags

* Fix test timeouts (#216)

* Make tests verbose

* Shorten timesteps to 100 from 400

* Combine directory creation commands

* Enable result output for Su2-ccx and nutils-of

* Update referenceOutput

* Truncate unnecessary jobs

* Exclude events log from reference

* Exclude events log from reference

* Adjust path

* Update fortran dummy execution

* Update fortran dummy execution

* Reduce dealii-of runtime from 5 to 1

* Adjust referenceOutput

* Restore travis.yml

* Fix log copy

* Patch SU2-CCX test output (#217)

* Fix log copy

* Add watchpoint log to output

* Adjust branch argument

* Enable output

* Restore .travis.yml

* Update watchpoing log

* Deactivate nutils-of test

* Mark su2-ccx test as unstable

* Update trigger script in accordance with #147

* Add correct tagging for systest triggers

* Use manual tag for docker image

* Fix nutils-of test (#218)

* Run only nutils-of, verbose

* Update repository location

* Keep nutils version constant

* Restore travis.yml

* Add elastictube1d test (#128)

* Add test for elastictube1d tutorial

* Add referenceOutput for elastictube1d test

* Add travis commands for elastictube1d test

* Add 1dtube to solver directory

* Fix wording

* Print avg/max diff values after file content

Moves the diff command above the line printing avg and max diff.
This is to make it easier to see average/maximal diff values when
the amount of line differences are very large in a file. Otherwise
the 'diff' command might flood the output and make the avg/max
line hard to find.

* Add 1dtube to test_type

* Rename test to describe python version

* Add test for c++ version

* Add C++ version of elastictube1d test

* Differentiate py and cxx version of elastictube1d

* Add C++ version of elastictube1d test

* Add missing root permissions for copying results

[ci-skip]

* Update name of 1dtube argument

* Remove wrong cp command

[ci skip]

* Run whole Dockerfile as root

* Remove unnecessary abbreviations

* Update 1dtube test names

* Update 1dtube test names

* Merge with develop and update to more recent folder structure (#155)

* Update travis job name for Bindings

* Add `allowed_failures` section to travis.yml

Also adds the currently failing Ubuntu1804.sudo.mpich job to this
section.

For a job to be allowed to fail, it must be added to both the `include`
and `allowed_failures` sections.
A failure of such a job will not cause subseqent stages to be
cancelled.

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Fix docker username on login (#109)

* Fix custom tags for adapter images #109

Closes #109

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Improve log header info (#107)

* Improve automatic commit messages (#106)

* New referenceOutput for fe-fe.Ubuntu1804.home

* Removing all changes from trigger_systemtests.py for customised testing

* Reverting more changes done for customised testing

* Removing whitespace in trigger file

* Fix dimension setting for reference data

* Print build ID when systemtest is triggered (#105)

Closes #105

* Print build number instead of build ID (#105)

* Update job title to explain failure tolerance

* Match job titles in include and allow_failures

* Fix travis job list

* Fix ubuntu1804.home tag

* Use deployment instead of `after_success` (#116)

Clean up travis structure

Add documentation for adding tests and handling deploy

Closes #103

* Only specify job name in `allow_failures` (#117)

Closes #117

[skip travis]

* Pull from repository before pushing (#118)

Issue a `git pull --rebase` before pushing to
precice_st_output. This should help scripts erroring
due to missing commits in local version.

Closes #118

* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* update installation procedure for python bindings

* use precice Repository

* Fix folder creation wrt user rights

* Use precice repository and fix users

* Navigate to correct folder

* Navigate to correct folder and run correct command

Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>

* Use branch of PR precice/elastictube1d#22 until it is merged

* Revert "Use branch of PR precice/elastictube1d#22 until it is merged"

This reverts commit bdc1b17.

* Update referenceOutput files for 1dtube_py (#161)

* Add os version to foldername

* Add 1dtube cxx to compose tests

* Remove folder permission

* Only run elastictube tests

* Add env variable

* Restore user creation

* Add permissions

* Remove unused volumes

* Make elastictube tests verbose

* Update 1dtube cxx reference

* Use default develop branch

* Improve text filter in compare_results.sh (#212)

* Add timestamp filter

* Restructure filtering

* Adjust referenceOutput

* Revert default preCICE branch to develop

* Restore TRAVIS_BRANCH

This reverts commit 288f71b.

* Run on develop instead of TRAVIS_BRANCH

* Run on develop instead of TRAVIS_BRANCH

* Remove branch arg, use default setting

* Use precice develop for tests

* Enable output

* Enable full diff print

* Update reference output

* Update outdated argument

* Remove events-summary from copied logs

* Add small message to each comparison

* Purge reference

* Update referenceOutput

* Convert 1dtube-py to compose test

* Add debug print

* Update reference for 1dtube-py

* Restore travis.yml

* Use default precice version (develop)

* Make default precice branch develop

* Shorten of-ccx petsc test from 5 to 1

* Update reference

* Fix yml syntax

* Fix style

Co-authored-by: Benjamin Rüth <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>
Co-authored-by: ishaandesai <[email protected]>

* Fix inconsistent output in 1dtube test (#224)

* Enable output

* Ignore version/revision

* Disable output

* Code_Aster-adapter system test (#205)

* Initial code aster dockerfile

* Change the default install directory

* Add procedure to install the adapter

* Add dockerfiles for Code_Aster solver, and Code_Aster adapter.
Prepare dummy docker-compose.yml file for system test

* Initial code aster dockerfile

* Change the default install directory

* Add procedure to install the adapter

* Add dockerfiles for Code_Aster solver, and Code_Aster adapter.
Prepare dummy docker-compose.yml file for system test

* Add docker-compose for Code_Aster. including docker.export

* Update docker-compose, still error in REPE_OUT location inside volume

* Update docker-compose and docker files for code-aster solver and adapter, to run with a precice coupling with openfoam.

* Add codeaster builds

* Fix indent

* Add codeaster test to compose test list

* Add prefix

* Fix prefix

* Fix prefix

* Add referenceOutput

* Change code_aster output from binary .med, to ascii .resu results

* Fix tutorial path

* Fix positional argument

* Set default preCICE branch to develop

* Update reference

* Update reference

* Only copy results to Output

* Disable output for of-ca

Co-authored-by: shkodm <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>

* Fix indent in codeaster adapter job

* Add date to text filter

* Update reference files for 1dtube tests (#225)

* Update reference

* Set permission of Output folder

* Fix permissions

* Remove debug print

* Remove sys.exit (#190)

Co-authored-by: Konrad Eder <[email protected]>

* Add optional st_branch argument for debugging

* Add optional output in trigger_systemtest (#226)

* Add shortened output argument

* Allow deal.ii adapter failure until tutorials#79

* Adjust dockerfile search

* Add base argument to push script

* Fix cloning command in preprocessing step

* Add variable for install folder name

* Replace folder info with install_mode

* Differentiate bindings and fenicsadapter branches

* Add special preproc command for pip installs

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Rüth <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>
Co-authored-by: ishaandesai <[email protected]>
Co-authored-by: Michel Takken <[email protected]>
Co-authored-by: shkodm <[email protected]>
Co-authored-by: Frédéric Simonis <[email protected]>
Eder-K added a commit that referenced this pull request Aug 7, 2020
* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* Fix tests failing due to no output (#148)

* Remove non-tests temporarily

* Remove log surpression

* Remove -d argument`

* Fix replacement of xml element

* nutils-of: Fix replacement of xml element (#149)

* Fix of-of and of-of_np (#150)

* of-of: Fix replacement of xml element

* of-of_np: Fix replacement of xml element

* Replace post-processing with acceleration using sed

* Replace post-processing with acceleration using sed

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 2460f9a.

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 832ce4a.

* escapte double quotes

* Escape quotes

Co-authored-by: Konrad Eder <[email protected]>

* Fix Calculix-OpenFOAM (#153)

Update the locally stored config file according to tutorials#60

* Fix SU2-Calculix (#152)

* Update configuration filename

* Run silent_compose in detached mode

* Revert '-d' argument adding

* Redirect ccx output to logfile

* Redirect ccx output to null

* Fix dealii-of and ccx-of_fsi [PETSc] (#154)

* Update sed insertion according to tutorials#60

* Update config.xml names for of-ccx.FSI.petsc

* Surpress of-adapter output

* Fix participant name

* Remove output surpression

* Restore silent functionality

* Add optional debug argument

* Add verbose optional argument

* Escape dots

* Delay of container start

* Run nutils-of in verbose mode

* Add success message

* Fix typo

* Add PETSc of-ccx to allowed failures

* Update PETSc of-ccx name

* Remove line

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of (#157)

* Remove sleep command

* Use exit codes for success as well

* Add tests for bindings on Ubuntu 18.04 (#129)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

* Revert "Add tests for bindings on Ubuntu 18.04 (#129)" (#159)

* Update solverdummy location (#162)

* Install Eigen from source for Ubuntu 16.04 (#163)

* Identify requests from TravisCI website (#165)

* Remove test for preCICE package Ubuntu 16.04

* Add installation of pkg-config (#166)

72a0bd7 switched from installing eigen via apt to installing eigen from source. This results in also not installing pkg-config that is a dependency of eigen. Therefore we now have to individually install pkg-config. Otherwise builds under Ubuntu16.04 relying on pkg-config will fail.

* Restructure tools and bindings (#164)

* Update path of solverdummies. Was changed in precice/precice#630 from tools/solverdummies to examples/solverdummies.

* Update use new repository fortran-module for f2003 solverdummy and corresponding bindings

Co-authored-by: Gerasimos Chourdakis <[email protected]>

* Allow failure for adapters depending on PETSc

* Fix typo

* Fix Test_bindings

* Change timestep-length to time-window-size

* Adapt CMake variables for preCICE v2 (#167)

See precice/precice#609

* Add system_testing.py example

* Update reference results for su2-ccx test case (#172)

* Update column names of reference files (#168)

* Update headers for fe-fe test

* provoke test failure with wrong reference

* Revert "provoke test failure with wrong reference"

This reverts commit 90ff76e.

* Update column names for fe-fe 1804

* Fix md link

* Remove .gitkeep

* Update column names

* Remove string filter

* Update column names

* Add missing spaces

* Add spacing

* Restore filtering

* reintroduce whitespace errors to make tests succeed

Co-authored-by: Konrad Eder <[email protected]>

* Update openfoam-adapter in accordance with config changes (#174)

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Update to OF5

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Update referenceOutput for OF5

* Readd preCICE building

* Add python script for building images and pushing them (#131)

* add system tests for cplscheme

* add cplscheme test

* run cplscheme test as local test

* use Ubuntu 18.04 as base image

* Use system_testing.py instead of local_test.py

Changed this, since this is the correct way to do it. local_test.py is only meant for local tests. I had to add an additional build stage that uses the debugMasterSockets branch on the preCICE main repository.

* Fix indentation

* Fix --build-arg and add a Ubuntu18.04 build

* first draft solution for #77

* roll out changes to all base images

* remove default docker username to force user to provide it and avoid inconsistencies

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* add argument to switch petsc on/off

* remove unrelated change

* remove unrelated files

* modify tag depending on petsc

* Factor out tag composition

* Add script for pushing

* Use benjaminrueth and push_base.py

* Fix and document tagging

* temporarily allow failure

* Use a more explicit name for script

* Extract features in python scripts. Introduces some code duplication, but is more flexible. Code duplication will be removed as soon as #137 is solved.

* fix error

* Use list to keep track of features, add petsc as feature to list for better consistency

* use python script for building and pushing adapters

* Fix syntax errors

* Use dict instead of list

This is a partial remedy for the problem mentioned in #131 (comment)

* Update push_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update push_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* use dict.get for less verbose code

* Fix error

* Filter away None

* Use less verbose approach

Co-authored-by: Konrad Eder <[email protected]>

* Overhaul pushing to precice_st_output (#147)

* Add file

* Replace pushing script

* Add pull --rebase to final push

* Allow -t, -s arguments for now

* Add readme to job folders

* Format bash commands

* Fix variable

* Comment out unneeded functions

* Add pushing failsafe

* Improve commit msg

* Fix function import

* Improve README generation

* Fix parenthesis

* Fix formatting

* Fix variable

* Add wrapping quotes

* Improve readme generation

* Fix indents

* Fix word

* Add message after test success

* Only run tests

* Replace deploy with after_success

* Update push command structure

* Add log pushing

* Add log pushing

* Add logging command

* Fix indent

* Fix variable name

* Fix variable name again

* Fix import

* Fix variable name

* Rename logfile

* Rename log file

* Make output files optional

* Formatting

* Fix variable name

* Fix var name

* Fix name

* Uncomment mkdir line

* Adjust commit msg building

* Add debug print

* Add debug prints

* Compare with string instead of integer

* Enable verbose output

* Add Logs to ignored files

* Fix base selection

* Reuse of container delay

* Revert travis xml to original

* Move test templates into separate directory

* Use jinja for readme templating

* Move test templates into separate directory

* Move test templates into separate directory

* Add missing logs msg

* Add missing log message

* Add general information

* Check if output is enabled

* Remove comment block

* Compare text columns as well

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Add branch info

* Add branch info

* Remove old pushing script

* Update to OF5

* Fix line

* Install Jinja2

* Fix path

* Fix compare script

* Enable output for OF tests

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Only run tests

* Rename nutils test

* Revert compare script to develop version

* Remove sleep command

* Restore travis jobs

* Fix variable name

* Insert job name in folder name instead

* Set default branch to master

* Move job name into commit msg

* Update reference data for of-ccx_fsi PETSc (#177)

* Update reference data

* Remove 0.orig

* Update folder naming

* Identify PETSc feature

* Build preCICE with Debug (#175)

* Only install minimal python depdendencies manually

* Update to newest pip version
* Use pyproject.toml for installation of all python depdendencies

* Download boost from sourceforge (#196)

* Add verbose to local_test (#191)

* Add bindings test for Ubuntu 18.04 (#160)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Rüth <[email protected]>

* Update deploy section in bindings 1804

* Explicitly list variables when rendering jinja template (#199)

* Replace locals() with explicit list

* Replace locals() with explicit list

* Clarify variable name

* Fix variable

* Check column names in compare_results.sh (#173)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Add seperating line

* Add prints for script start and end

* Update preciceDict

Co-authored-by: Benjamin Rüth <[email protected]>

* Fix nutils-of test (#178)

* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Add delay to OF container

* Enable verbose output

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Perform clean OF5 install instead of folder copy

* Temporarily run docker push not in deploy

* Add seperating line

* Fix dockerfile argument

* Use folder-copy method

* Add prints for script start and end

* Update preciceDict

* Move comment

* Update reference files

* Clean up job names

Co-authored-by: Benjamin Rüth <[email protected]>

* Use TRAVIS_BRANCH to select branch of toolchain being tested (#136)

* Use TRAVIS_BRANCH to select branch of toolchain being tested #125

* Add logic to also support pull requests

* Fix syntax error

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* use correct build-arg for OF Adapter

* Fix syntax

* Remove preCICe builds

* Print wmake.log

* Use --branch option for all tests

* Add jinja2 (accidentally removed in merge)

* Revert changes applied to reference output

* Reintroduce changes from #147 (accidentally removed in merge)

* Remove libyaml-cpp-dev

* Add missing line

* Add TRAVIS_BRANCH to bindings 18.04

Co-authored-by: Rüth <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>

* Fix OF-OF nearest projection (#203)

* Apply #206 to develop (#208)

* Add documentation entry for renewing token (#210)

* Disable currently failing tests

* Disable dealii-of

* Extend log pushing to precice_st_output (#201)

* Add adapter and precice logs

* Add push commands for precice and adapter builds

* Fix indent

* Move variable declaration

* Add log extraction for OF adapters

* Add image tag as environ variable

* Add log extraction for adapters

* Add info on job type

* Add comma

* Move variable

* Create folder earlier

* Add debug print

* Add debug print

* Add print at end of script

* Fix variable

* Remove export command

* Store tag in intermediary file

* Import common

* Change sourcing command

* Fix file reading

* Add print

* Use file writer instead of env variable

* Add debug print

* FormattingFormattingFormattingFormattingFormattingFormattingFormattingFormattingFormatting

* Remove file after reading

* Create temporary container

* Add try/except for Travis log requests

* Call container by name

* Insert launch command

* Fix launch command

* Simplfy Logs folder creation

* Fix Logs folder location

* Fix folder path

* Remove .home

* Fix import

* Fix import

* Add line

* Add debug print

* Fix symbol

* Fix docker copy

* Add zero padding for job names

* Make logs folder before test start

* Add debug print

* Remove debug prints

* Remove try-except block

* Skip request call

* Add headers for log request

* Fix variable name

* Improve clarity when triggering systemtest (#213)

* Only test adapters

* Trigger build with updated token

* Only run dealii

* Update push script call

* Fix bracket

* Fix bracket

* Add link to build

* Flush output

* Add prints on exit

* Add visual separators

* Wrap link

* Restore travis.yml

* Test dealii trigger

* Add coloring

* Format line

* Remove experimental trigger test

* Add correct tags

* Fix test timeouts (#216)

* Make tests verbose

* Shorten timesteps to 100 from 400

* Combine directory creation commands

* Enable result output for Su2-ccx and nutils-of

* Update referenceOutput

* Truncate unnecessary jobs

* Exclude events log from reference

* Exclude events log from reference

* Adjust path

* Update fortran dummy execution

* Update fortran dummy execution

* Reduce dealii-of runtime from 5 to 1

* Adjust referenceOutput

* Restore travis.yml

* Fix log copy

* Patch SU2-CCX test output (#217)

* Fix log copy

* Add watchpoint log to output

* Adjust branch argument

* Enable output

* Restore .travis.yml

* Update watchpoing log

* Deactivate nutils-of test

* Mark su2-ccx test as unstable

* Update trigger script in accordance with #147

* Add correct tagging for systest triggers

* Use manual tag for docker image

* Fix nutils-of test (#218)

* Run only nutils-of, verbose

* Update repository location

* Keep nutils version constant

* Restore travis.yml

* Add elastictube1d test (#128)

* Add test for elastictube1d tutorial

* Add referenceOutput for elastictube1d test

* Add travis commands for elastictube1d test

* Add 1dtube to solver directory

* Fix wording

* Print avg/max diff values after file content

Moves the diff command above the line printing avg and max diff.
This is to make it easier to see average/maximal diff values when
the amount of line differences are very large in a file. Otherwise
the 'diff' command might flood the output and make the avg/max
line hard to find.

* Add 1dtube to test_type

* Rename test to describe python version

* Add test for c++ version

* Add C++ version of elastictube1d test

* Differentiate py and cxx version of elastictube1d

* Add C++ version of elastictube1d test

* Add missing root permissions for copying results

[ci-skip]

* Update name of 1dtube argument

* Remove wrong cp command

[ci skip]

* Run whole Dockerfile as root

* Remove unnecessary abbreviations

* Update 1dtube test names

* Update 1dtube test names

* Merge with develop and update to more recent folder structure (#155)

* Update travis job name for Bindings

* Add `allowed_failures` section to travis.yml

Also adds the currently failing Ubuntu1804.sudo.mpich job to this
section.

For a job to be allowed to fail, it must be added to both the `include`
and `allowed_failures` sections.
A failure of such a job will not cause subseqent stages to be
cancelled.

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Fix docker username on login (#109)

* Fix custom tags for adapter images #109

Closes #109

* Initial commit to target specific tutorial branch for systemtest

* Add launch argument to specify systemtests branch

Allows requests to run on a specific branch of the systemtests
repository instead of the default master branch

* Adding input parameters to commands in docker-compose.yml

* Improve log header info (#107)

* Improve automatic commit messages (#106)

* New referenceOutput for fe-fe.Ubuntu1804.home

* Removing all changes from trigger_systemtests.py for customised testing

* Reverting more changes done for customised testing

* Removing whitespace in trigger file

* Fix dimension setting for reference data

* Print build ID when systemtest is triggered (#105)

Closes #105

* Print build number instead of build ID (#105)

* Update job title to explain failure tolerance

* Match job titles in include and allow_failures

* Fix travis job list

* Fix ubuntu1804.home tag

* Use deployment instead of `after_success` (#116)

Clean up travis structure

Add documentation for adding tests and handling deploy

Closes #103

* Only specify job name in `allow_failures` (#117)

Closes #117

[skip travis]

* Pull from repository before pushing (#118)

Issue a `git pull --rebase` before pushing to
precice_st_output. This should help scripts erroring
due to missing commits in local version.

Closes #118

* use branch develop as default for all tests

* remove old python bindings. Update tests to only use new bindings

* Remove python_future

* Fix user for binding tests (#96)

* Apply tests to python bindings in precice/python-bindings (#133)

* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory

* Allow failure for PETSc

* Allow failure for nutils <-> OpenFOAM. #132

* use DOCKER_USERNAME, where it is appropriate

* Use Ubuntu18.04 for Nutils-OF test (#132)

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output

* update installation procedure for python bindings

* use precice Repository

* Fix folder creation wrt user rights

* Use precice repository and fix users

* Navigate to correct folder

* Navigate to correct folder and run correct command

Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>

* Use branch of PR precice/elastictube1d#22 until it is merged

* Revert "Use branch of PR precice/elastictube1d#22 until it is merged"

This reverts commit bdc1b17.

* Update referenceOutput files for 1dtube_py (#161)

* Add os version to foldername

* Add 1dtube cxx to compose tests

* Remove folder permission

* Only run elastictube tests

* Add env variable

* Restore user creation

* Add permissions

* Remove unused volumes

* Make elastictube tests verbose

* Update 1dtube cxx reference

* Use default develop branch

* Improve text filter in compare_results.sh (#212)

* Add timestamp filter

* Restructure filtering

* Adjust referenceOutput

* Revert default preCICE branch to develop

* Restore TRAVIS_BRANCH

This reverts commit 288f71b.

* Run on develop instead of TRAVIS_BRANCH

* Run on develop instead of TRAVIS_BRANCH

* Remove branch arg, use default setting

* Use precice develop for tests

* Enable output

* Enable full diff print

* Update reference output

* Update outdated argument

* Remove events-summary from copied logs

* Add small message to each comparison

* Purge reference

* Update referenceOutput

* Convert 1dtube-py to compose test

* Add debug print

* Update reference for 1dtube-py

* Restore travis.yml

* Use default precice version (develop)

* Make default precice branch develop

* Shorten of-ccx petsc test from 5 to 1

* Update reference

* Fix yml syntax

* Fix style

Co-authored-by: Benjamin Rüth <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>
Co-authored-by: ishaandesai <[email protected]>

* Fix inconsistent output in 1dtube test (#224)

* Enable output

* Ignore version/revision

* Disable output

* Code_Aster-adapter system test (#205)

* Initial code aster dockerfile

* Change the default install directory

* Add procedure to install the adapter

* Add dockerfiles for Code_Aster solver, and Code_Aster adapter.
Prepare dummy docker-compose.yml file for system test

* Initial code aster dockerfile

* Change the default install directory

* Add procedure to install the adapter

* Add dockerfiles for Code_Aster solver, and Code_Aster adapter.
Prepare dummy docker-compose.yml file for system test

* Add docker-compose for Code_Aster. including docker.export

* Update docker-compose, still error in REPE_OUT location inside volume

* Update docker-compose and docker files for code-aster solver and adapter, to run with a precice coupling with openfoam.

* Add codeaster builds

* Fix indent

* Add codeaster test to compose test list

* Add prefix

* Fix prefix

* Fix prefix

* Add referenceOutput

* Change code_aster output from binary .med, to ascii .resu results

* Fix tutorial path

* Fix positional argument

* Set default preCICE branch to develop

* Update reference

* Update reference

* Only copy results to Output

* Disable output for of-ca

Co-authored-by: shkodm <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>

* Fix indent in codeaster adapter job

* Add date to text filter

* Update reference files for 1dtube tests (#225)

* Update reference

* Set permission of Output folder

* Fix permissions

* Remove debug print

* Remove sys.exit (#190)

Co-authored-by: Konrad Eder <[email protected]>

* Add optional st_branch argument for debugging

* Add optional output in trigger_systemtest (#226)

* Add shortened output argument

* Change namings to new dealii solver namings

* Allow deal.ii adapter failure until tutorials#79

* Adjust dockerfile search

* Add base argument to push script

* Fix cloning command in preprocessing step

* Change parameter file naming

* Add variable for install folder name

* Replace folder info with install_mode

* Differentiate bindings and fenicsadapter branches

* Add special preproc command for pip installs

* Remove deal.ii adapter from allowed failures

* Update to deal.ii v9.2 solver (#234)

* Add internal exceptions (#233)

* Add exceptions

* Patch referenceOutput for 1dtube tests (#235)

* Enable pushing output

* Add txt filter for line number

* Update CalculiX-related tests to use v2.16 (#231)

* Update ccx version to 2.16

* Update solver to ccx 2.16

* Fix line

* Use ccx-2.16 docker image

* Shorten su2-ccx test to 25 iterations

* Update reference for of-ccx

* Fix link

* Decrease iterations

* Update reference

* Update reference

* Update reference

* Enable output for of-ccx_fsi petsc

* Enable output for su-ccx

* Update reference

* Restore travis.yml

* Allow deal.ii test to fail until PR merge

* Enable output for ccx related tests

* Update reference data for ccx tests

* Update reference data for nutils-of (#237)

* Disable output

* Update nutils-of reference data

* Update reference files for of-of and of-of_np (#238)

* Update numpy/scipy versions in fe-fe test (#241)

* Update python version from 3.5 to 3.8

* Use python version 3.7

* Use python v3.6

* Remove numpy install during precice build

* Update default precice base image

* Install numpy using pip3

* Restore apt-get numpy install for base image

* Fix link

* Specify numpy v1.14.5

* Move numpy install

* Overhaul comparison script core (#176)

* Add assertion

* Fix variable overwrite in diff computation

* Clarify success message

* Use total counter instead of NR*NF

* Add comma

* Rework filters

* Add comments

* Fix comparison failure in Su2-CalculiX (#244)

* Move whitespace removal to prefilter

* Enable su2-ccx output

* Update reference

* Disable output

* Add .docker_tag

* Remove PETSc jobs from allowed failure list

* Add branch argument in correct position

* Remove branch arg

* Attempt to save logs even if test fails

* Allow precice-ubuntu1604 w/ PETSc to fail

* Update reference log to include residual warning

* Update reference files (#247)

* Set locale (#248)

* Set locale to en_US.UTF-8

* Install locales with apt

* Remove defunct line

* Allow fenics-adapter to fail

[skip ci]

* Fix typo in docs (well... just to trigger Travis)

* Update PETSc to v3.12 (#246)

* Use PETSc with 18.04

* Update to use PETSc 3.12 with 18.04

* Fix indentation

* Merge subsequent run commands

* Link petsc library

* Adjust linked path

* Restore commented lines

* Reduce travis.yml temporarily

* Use Makefile from calculix-adapter#41

* Separate precice branch from adapter branch

* Install ARPACK and spooles from apt

* Use PR version of Makefile

* Clean up deprecated code

* Fix build adapter command

* Rename test folder

* Extend LD_LIBRARY_PATH

* Format command

* Remove symbol

* Remove slash

* Reduce test time to 0.1

* Fix LD_LIBRARY_PATH

* Revert max-time to 1

* Use newer openfoam-adapter dockerfile

* Update base version in st_output push

* Separate preCICE branch and adapter branch

* Restore .travis.yml

[skip ci]

* Update Ubuntu 16.04 PETSc version

[ci skip]

* Remove debug command

[ci skip]

* Update openfoam-adapter dockerfile path

* Use makefile-dep-apt branch

* Fix double PETSc argument

* Add permissions to petsc dir

* Format line

* Move precice user creation

* Update base image in openfoam tests to 18.04

* Make Ubuntu 18.04 the default image

* Remove 16.04 suffixes

* Update default base image

* Add missing adapter builds with 18.04

* Add deal.ii 18.04 to allowed failures

* Omit suffix for default base image

* Update base version for triggered tests

* Enable output for 1dtube_py

* Update reference

* Disable output

* Update reference

* Fix broken args

* Add missing hyphen

* Fix nutils-of test command

* Fix argument name

* Use PETSc download mirror

* Install PETSc as root

* Fix push arg in of-ccx_fsi

* Disable debug output

* Update allowed failures

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Gerasimos Chourdakis <[email protected]>
Co-authored-by: Rüth <[email protected]>
Co-authored-by: Ishaan Desai <[email protected]>
Co-authored-by: David Schneider <[email protected]>
Co-authored-by: ishaandesai <[email protected]>
Co-authored-by: Michel Takken <[email protected]>
Co-authored-by: shkodm <[email protected]>
Co-authored-by: Frédéric Simonis <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants