Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Apply trigger_systemtest changes to master #220

Merged
merged 62 commits into from
May 6, 2020
Merged

Apply trigger_systemtest changes to master #220

merged 62 commits into from
May 6, 2020

Conversation

Eder-K
Copy link
Contributor

@Eder-K Eder-K commented May 5, 2020

At this point, the triggering system is again be in a functioning state such that the sent requests correctly make use of the push script introduced in #147 (example build on the deal.ii adapter). This merge is the last necessary step so that the adapter repositories have access to the new version.

BenjaminRodenberg and others added 30 commits November 27, 2019 12:41
* replace installation of python bindings from precice/precice with bindings from precice/python-bindings

* directly use repository address for pip3 install, avoids cloning

* Fix fe-fe test by adding cd to user directory
* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Remove python_future

* use Ubuntu 18.04, don't install enum34

* Update name of test and folder

* add ubuntu 18.04 version of OF adapter

* trigger CI

* fix syntax error

* Add output for better logs

* use Ubuntu18.04 and OpenFOAM5 for Solver and Adapter

* update reference results

* Change order to reduce diff

* Use OF5 for creation of reference results

* add debug output

* Use reference results from precice_st_output (#142)

* Remove debugging output
* Remove non-tests temporarily

* Remove log surpression

* Remove -d argument`

* Fix replacement of xml element

* nutils-of: Fix replacement of xml element (#149)

* Fix of-of and of-of_np (#150)

* of-of: Fix replacement of xml element

* of-of_np: Fix replacement of xml element

* Replace post-processing with acceleration using sed

* Replace post-processing with acceleration using sed

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 2460f9a.

* Revert "Replace post-processing with acceleration using sed"

This reverts commit 832ce4a.

* escapte double quotes

* Escape quotes

Co-authored-by: Konrad Eder <[email protected]>

* Fix Calculix-OpenFOAM (#153)

Update the locally stored config file according to tutorials#60

* Fix SU2-Calculix (#152)

* Update configuration filename

* Run silent_compose in detached mode

* Revert '-d' argument adding

* Redirect ccx output to logfile

* Redirect ccx output to null

* Fix dealii-of and ccx-of_fsi [PETSc] (#154)

* Update sed insertion according to tutorials#60

* Update config.xml names for of-ccx.FSI.petsc

* Surpress of-adapter output

* Fix participant name

* Remove output surpression

* Restore silent functionality

* Add optional debug argument

* Add verbose optional argument

* Escape dots

* Delay of container start

* Run nutils-of in verbose mode

* Add success message

* Fix typo

* Add PETSc of-ccx to allowed failures

* Update PETSc of-ccx name

* Remove line

Co-authored-by: Benjamin Rüth <[email protected]>
* Remove sleep command

* Use exit codes for success as well
* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04
72a0bd7 switched from installing eigen via apt to installing eigen from source. This results in also not installing pkg-config that is a dependency of eigen. Therefore we now have to individually install pkg-config. Otherwise builds under Ubuntu16.04 relying on pkg-config will fail.
* Update path of solverdummies. Was changed in precice/precice#630 from tools/solverdummies to examples/solverdummies.

* Update use new repository fortran-module for f2003 solverdummy and corresponding bindings

Co-authored-by: Gerasimos Chourdakis <[email protected]>
* Update headers for fe-fe test

* provoke test failure with wrong reference

* Revert "provoke test failure with wrong reference"

This reverts commit 90ff76e.

* Update column names for fe-fe 1804

* Fix md link

* Remove .gitkeep

* Update column names

* Remove string filter

* Update column names

* Add missing spaces

* Add spacing

* Restore filtering

* reintroduce whitespace errors to make tests succeed

Co-authored-by: Konrad Eder <[email protected]>
* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Remove preCICe builds

* Print wmake.log

* Upgrade to OF5

* Fix typo

* Update to OF5

* Update reference files for openfoam5

* Update config path manipulation

* Update referenceOutput for OF5

* Update referenceOutput for OF5
* add system tests for cplscheme

* add cplscheme test

* run cplscheme test as local test

* use Ubuntu 18.04 as base image

* Use system_testing.py instead of local_test.py

Changed this, since this is the correct way to do it. local_test.py is only meant for local tests. I had to add an additional build stage that uses the debugMasterSockets branch on the preCICE main repository.

* Fix indentation

* Fix --build-arg and add a Ubuntu18.04 build

* first draft solution for #77

* roll out changes to all base images

* remove default docker username to force user to provide it and avoid inconsistencies

* remove old python bindings. Update tests to only use new bindings

* trigger CI

* add argument to switch petsc on/off

* remove unrelated change

* remove unrelated files

* modify tag depending on petsc

* Factor out tag composition

* Add script for pushing

* Use benjaminrueth and push_base.py

* Fix and document tagging

* temporarily allow failure

* Use a more explicit name for script

* Extract features in python scripts. Introduces some code duplication, but is more flexible. Code duplication will be removed as soon as #137 is solved.

* fix error

* Use list to keep track of features, add petsc as feature to list for better consistency

* use python script for building and pushing adapters

* Fix syntax errors

* Use dict instead of list

This is a partial remedy for the problem mentioned in #131 (comment)

* Update push_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update push_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_precice.py

Co-Authored-By: Konrad Eder <[email protected]>

* Update build_adapter.py

Co-Authored-By: Konrad Eder <[email protected]>

* use dict.get for less verbose code

* Fix error

* Filter away None

* Use less verbose approach

Co-authored-by: Konrad Eder <[email protected]>
Eder-K and others added 24 commits March 8, 2020 14:04
* remove old python bindings. Update tests to only use new bindings

* trigger CI

* Add tests for bindings on Ubuntu 18.04

Co-authored-by: BenjaminRueth <[email protected]>
Co-authored-by: Rüth <[email protected]>
* Replace locals() with explicit list

* Replace locals() with explicit list

* Clarify variable name

* Fix variable
* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Add seperating line

* Add prints for script start and end

* Update preciceDict

Co-authored-by: Benjamin Rüth <[email protected]>
* Compare text columns as well

* Remove color arg

* Extend numerical diff filter

* Revert fe-fe test to wrong columns

* Fix line

* Remove indent for text diff

* Update indentation

* Correct fe-fe columns"

This reverts commit 3d2a639.

* Clean up comments

* Add delay to OF container

* Enable verbose output

* Fix typo

Co-Authored-By: Benjamin Rüth <[email protected]>

* Perform clean OF5 install instead of folder copy

* Temporarily run docker push not in deploy

* Add seperating line

* Fix dockerfile argument

* Use folder-copy method

* Add prints for script start and end

* Update preciceDict

* Move comment

* Update reference files

* Clean up job names

Co-authored-by: Benjamin Rüth <[email protected]>
* Use TRAVIS_BRANCH to select branch of toolchain being tested #125

* Add logic to also support pull requests

* Fix syntax error

* Remove yaml-cpp install

* Remove yaml-cpp install

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete preciceDict

* Create preciceDict

* Delete precice-adapter-config.yml

* Create preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Delete precice-adapter-config.yml

* Add preciceDict

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* Update .travis.yml

* use correct build-arg for OF Adapter

* Fix syntax

* Remove preCICe builds

* Print wmake.log

* Use --branch option for all tests

* Add jinja2 (accidentally removed in merge)

* Revert changes applied to reference output

* Reintroduce changes from #147 (accidentally removed in merge)

* Remove libyaml-cpp-dev

* Add missing line

* Add TRAVIS_BRANCH to bindings 18.04

Co-authored-by: Rüth <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>
Co-authored-by: Konrad Eder <[email protected]>
* Add adapter and precice logs

* Add push commands for precice and adapter builds

* Fix indent

* Move variable declaration

* Add log extraction for OF adapters

* Add image tag as environ variable

* Add log extraction for adapters

* Add info on job type

* Add comma

* Move variable

* Create folder earlier

* Add debug print

* Add debug print

* Add print at end of script

* Fix variable

* Remove export command

* Store tag in intermediary file

* Import common

* Change sourcing command

* Fix file reading

* Add print

* Use file writer instead of env variable

* Add debug print

* FormattingFormattingFormattingFormattingFormattingFormattingFormattingFormattingFormatting

* Remove file after reading

* Create temporary container

* Add try/except for Travis log requests

* Call container by name

* Insert launch command

* Fix launch command

* Simplfy Logs folder creation

* Fix Logs folder location

* Fix folder path

* Remove .home

* Fix import

* Fix import

* Add line

* Add debug print

* Fix symbol

* Fix docker copy

* Add zero padding for job names

* Make logs folder before test start

* Add debug print

* Remove debug prints

* Remove try-except block

* Skip request call

* Add headers for log request

* Fix variable name
* Only test adapters

* Trigger build with updated token

* Only run dealii

* Update push script call

* Fix bracket

* Fix bracket

* Add link to build

* Flush output

* Add prints on exit

* Add visual separators

* Wrap link

* Restore travis.yml

* Test dealii trigger

* Add coloring

* Format line
* Make tests verbose

* Shorten timesteps to 100 from 400

* Combine directory creation commands

* Enable result output for Su2-ccx and nutils-of

* Update referenceOutput

* Truncate unnecessary jobs

* Exclude events log from reference

* Exclude events log from reference

* Adjust path

* Update fortran dummy execution

* Update fortran dummy execution

* Reduce dealii-of runtime from 5 to 1

* Adjust referenceOutput

* Restore travis.yml
* Fix log copy

* Add watchpoint log to output

* Adjust branch argument

* Enable output

* Restore .travis.yml

* Update watchpoing log
@Eder-K Eder-K requested a review from MakisH May 5, 2020 22:46
@Eder-K Eder-K changed the title Apply newest trigger_systemtest changes to master Apply trigger_systemtest changes to master May 6, 2020
@Eder-K
Copy link
Contributor Author

Eder-K commented May 6, 2020

Note that the build failure is due to TravisCI blocking docker image deployment from active pull requests, not from the code failing. The deal.ii-adapter build mentioned above is representative of the actual code behavior.

@Eder-K Eder-K merged commit e29c102 into master May 6, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants