Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test clusters ( was clusterformation ) - part 3 #33264

Closed

Commits on Jul 12, 2018

  1. Implement Version in java

    - This allows to move all  all .java files from .groovy.
    - Will prevent eclipse from tangling up in this setup
    - make it possible to use Version from Java
    alpar-t committed Jul 12, 2018
    Configuration menu
    Copy the full SHA
    4b532c0 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2018

  1. Configuration menu
    Copy the full SHA
    506dfc8 View commit details
    Browse the repository at this point in the history
  2. PR review comments

    alpar-t committed Jul 13, 2018
    Configuration menu
    Copy the full SHA
    952af44 View commit details
    Browse the repository at this point in the history
  3. Cluster formation plugin with reference counting

    ```
    > Task :plugins:ingest-user-agent:listElasticSearchClusters
    Starting cluster: myTestCluster
       * myTestCluster: /home/alpar/work/elastic/elasticsearch/plugins/ingest-user-agent/foo
    Asked to unClaimAndStop myTestCluster, since cluster still has 1 claim it will not be stopped
    
    > Task :plugins:ingest-user-agent:testme UP-TO-DATE
    Stopping myTestCluster, since no of claims is 0
    ```
    
    - Meant to auto manage the clusters lifecycle
    - Add integration test for cluster formation
    alpar-t committed Jul 13, 2018
    Configuration menu
    Copy the full SHA
    cddb550 View commit details
    Browse the repository at this point in the history
  4. Fix rebase

    alpar-t committed Jul 13, 2018
    Configuration menu
    Copy the full SHA
    dfc38a1 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2018

  1. Configuration menu
    Copy the full SHA
    b01ed0e View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2018

  1. Configuration menu
    Copy the full SHA
    7ac5b7c View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2018

  1. Configuration menu
    Copy the full SHA
    f2fb450 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2018

  1. remove task extension

    alpar-t committed Aug 16, 2018
    Configuration menu
    Copy the full SHA
    2d0e478 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2018

  1. address PR

    alpar-t committed Aug 17, 2018
    Configuration menu
    Copy the full SHA
    938ef53 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2018

  1. Listener in anonymous class

    alpar-t committed Aug 21, 2018
    Configuration menu
    Copy the full SHA
    a611747 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2018

  1. Configuration menu
    Copy the full SHA
    5483186 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2018

  1. Cluster formation plugin with reference counting

    ```
    > Task :plugins:ingest-user-agent:listElasticSearchClusters
    Starting cluster: myTestCluster
       * myTestCluster: /home/alpar/work/elastic/elasticsearch/plugins/ingest-user-agent/foo
    Asked to unClaimAndStop myTestCluster, since cluster still has 1 claim it will not be stopped
    
    > Task :plugins:ingest-user-agent:testme UP-TO-DATE
    Stopping myTestCluster, since no of claims is 0
    ```
    
    - Meant to auto manage the clusters lifecycle
    - Add integration test for cluster formation
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    121e025 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9baed19 View commit details
    Browse the repository at this point in the history
  3. Add an explicit dependency between tests of different versions

    Without this the tasks from different version can be ordered randomly
    causing the snapshot test to fail ( i.e. creating snapshot for multiple
    versions in the same location ).
    Gradle happens to order them correctly when ran without "parallel" but
    switches up the ordering when not.
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    8a4d21f View commit details
    Browse the repository at this point in the history
  4. Gradle orders all celanups up-fron with --parallel

    Rather than fighting it, move to do it right before the runner
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    da69766 View commit details
    Browse the repository at this point in the history
  5. Configure depenedencies based on configuration

    And check resulting artifact when starting up the cluster
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    ba4f4a9 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    de87e74 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    2df0545 View commit details
    Browse the repository at this point in the history
  8. Non working attempt to start ES with threads and Gradle exec

    Seems this hoggs some internal Gradle file locks, and messes with
    Gradle's internals.
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    6574f82 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    4d44141 View commit details
    Browse the repository at this point in the history
  10. Working ProcessBuilder based implementation to start cluster

    To be able to use process builder, the min java version for build was
    bumped to 9.
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    df6a529 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    d2a7810 View commit details
    Browse the repository at this point in the history
  12. Lazy wait for ES

    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    2f03501 View commit details
    Browse the repository at this point in the history
  13. Move build integration tests out of :buildSrc project

    This way building buildSrc will not be delayed for all invocations, and
    will be less disruptive if integration tests fail
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    ea381b1 View commit details
    Browse the repository at this point in the history
  14. Clean up docs and naming

    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    64afbd0 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    5ecae33 View commit details
    Browse the repository at this point in the history
  16. Imrooove documentation, various fixes

    - support for multi project when not all projects apply the plugin.
        - add a test for it
    - only register task liseners once per build ( not once per project )
    - make the node name safe for paths and cluster name, even if it has `:` or `#` ( will be replaced by `-`)
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    fc877d5 View commit details
    Browse the repository at this point in the history
  17. Add cleanup hooks to make sure no processes survive the build

    Clean up the processes after even after `^C` is pressed.
    The way Gradle does this is depending on the use of the Daemon,
    but for us, even with the Daemon interupting it does not work as it
    should and it eventually self terminates.
    
    The downside is that the ES processes will be cleaned up with a delay
    caused by  Gradle trying and failing to clean up the Daemon.
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    af9c74f View commit details
    Browse the repository at this point in the history
  18. Support closures as system props for testing

    Allows to pass in closures that would evaluate at execution time.
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    1ecb42f View commit details
    Browse the repository at this point in the history
  19. Integrate the new clusterformation with plugin builds

    Offers a way to test it with an actual build without affecting
    the status quo:
    
    `./gradlew ':modules:lang-painless:integTestRunner' -Dclusterformation=new -s -i`
    
    This won't work with all projects, as a number of features from the old
    cluster formationare not yet supported:
      - installing plugins
      - changing config
      - secure config
      - waiting for cluster to come up with security enabled
    
    It's still useful to make sure that the new plugin can work together
    with the build.
    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    cc66d2f View commit details
    Browse the repository at this point in the history
  20. Add support for windows

    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    6f7d46e View commit details
    Browse the repository at this point in the history
  21. frix rebase

    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    feac1f8 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    28059d8 View commit details
    Browse the repository at this point in the history
  23. Fix blugin build

    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    a39b678 View commit details
    Browse the repository at this point in the history
  24. Rename to testClusters

    alpar-t committed Aug 23, 2018
    Configuration menu
    Copy the full SHA
    594a9de View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2018

  1. Configuration menu
    Copy the full SHA
    b6ead15 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f11fb2f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9bcf35f View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2018

  1. Close all child processes on stop

    cmd.exe on windows does not close it's children, so we clean up
    everything.
    alpar-t committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    9f7352e View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2018

  1. Configuration menu
    Copy the full SHA
    bc8def8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    de13f67 View commit details
    Browse the repository at this point in the history
  3. Rename from clusterformation

    alpar-t committed Aug 30, 2018
    Configuration menu
    Copy the full SHA
    656b155 View commit details
    Browse the repository at this point in the history
  4. self review

    alpar-t committed Aug 30, 2018
    Configuration menu
    Copy the full SHA
    6c87326 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2018

  1. Change runtime to 10

    alpar-t committed Sep 3, 2018
    Configuration menu
    Copy the full SHA
    9ea7d92 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2018

  1. Configuration menu
    Copy the full SHA
    9a98434 View commit details
    Browse the repository at this point in the history