Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow users to explicitly define index management operations #293

Closed
4 tasks done
danielmitterdorfer opened this issue Jul 3, 2017 · 2 comments
Closed
4 tasks done
Labels
enhancement Improves the status quo :Track Management New operations, changes in the track format, track download changes and the like
Milestone

Comments

@danielmitterdorfer
Copy link
Member

danielmitterdorfer commented Jul 3, 2017

At the moment, Rally auto-manages indices, which basically means that it creates and deletes the affected indices at the start of a benchmark. This works fine for our Elasticsearch development benchmarks but there are other situations where users want more explicit control.

Hence, we should provide a couple of index management APIs as Rally operations:

  • Create index (with mappings)
  • Create index templates
  • Delete index
  • Rollover index (obviously this will only work for ES 5 or later)

We should also improve the existing indices stats operation to include data from the response in the meta-data (depending on the performance impact this needs to be enabled with a flag).

Tasks:

  • Establish a notion of an administrative task (executed but not measured) Don't measure every operation #361
  • Rewrite all administrative operations that are currently done implicitly by Rally as custom runners (leveraging Allow to retry operations (internally) #363 for some).
  • Adapt track loading code to amend the track with these implicit operations by default.
  • Have a means to disable this behavior and define track management operations explicitly (per challenge?).
@danielmitterdorfer danielmitterdorfer added :Track Management New operations, changes in the track format, track download changes and the like enhancement Improves the status quo labels Jul 3, 2017
@danielmitterdorfer danielmitterdorfer added this to the 0.6.x milestone Jul 3, 2017
@danielmitterdorfer danielmitterdorfer modified the milestones: 0.6.x, 0.7.x Aug 9, 2017
@danielmitterdorfer danielmitterdorfer modified the milestones: 0.7.x, 0.8.x Oct 11, 2017
@danielmitterdorfer
Copy link
Member Author

As a preparation, we will allow (selected) runners that are defined by Rally core to use retries (either on timeout or application "error") (see #363).

The first operation that will benefit from this change is most likely the cluster health check that is currently hard-coded.

@danielmitterdorfer
Copy link
Member Author

For the migration, we should also keep elastic/rally-tracks#37 in mind: The cluster health check in tracks should take only the track-relevant indices into account.

danielmitterdorfer added a commit to elastic/rally-tracks that referenced this issue Dec 12, 2017
danielmitterdorfer added a commit to elastic/rally-tracks that referenced this issue Dec 12, 2017
danielmitterdorfer added a commit to elastic/rally-tracks that referenced this issue Dec 12, 2017
danielmitterdorfer added a commit to elastic/rally-tracks that referenced this issue Dec 12, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Improves the status quo :Track Management New operations, changes in the track format, track download changes and the like
Projects
None yet
Development

No branches or pull requests

1 participant