Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add tooling support to create bulk data file(s) from existing indices #444

Closed
danielmitterdorfer opened this issue Mar 16, 2018 · 0 comments · Fixed by #970
Closed

Add tooling support to create bulk data file(s) from existing indices #444

danielmitterdorfer opened this issue Mar 16, 2018 · 0 comments · Fixed by #970
Assignees
@danielmitterdorfer
Labels
enhancement Improves the status quo :Track Management New operations, changes in the track format, track download changes and the like
Milestone
2.0.0

Comments

@danielmitterdorfer
Copy link
Member

danielmitterdorfer commented Mar 16, 2018 •
edited
Loading

Similarly to #262 on the query side, we should add some tooling support to create one or more data files from existing indices. See e.g. https://gist.github.com/HonzaKral/0fb3f76da529ee380d08 for an example. Ideally, this tool should create the following output:

  • Data files
  • Mappings / settings for the affected indices
  • A sample track file that contains the necessary index management commands (delete / create) and bulk-indexes the data files

We should add this as a separate binary in the Rally repository.
@danielmitterdorfer danielmitterdorfer added enhancement Improves the status quo :Track Management New operations, changes in the track format, track download changes and the like labels Mar 16, 2018
@danielmitterdorfer danielmitterdorfer added this to the Backlog milestone Mar 16, 2018
@danielmitterdorfer danielmitterdorfer mentioned this issue Mar 16, 2018
Closed
5 tasks
@danielmitterdorfer danielmitterdorfer modified the milestones: Backlog, 1.x Apr 12, 2018
@drawlerr drawlerr mentioned this issue Jan 17, 2020
Closed
@danielmitterdorfer danielmitterdorfer mentioned this issue Apr 21, 2020
Merged
danielmitterdorfer added a commit that referenced this issue Apr 27, 2020
@danielmitterdorfer
Add tooling to create a track from existing data (#970)
ff29cde 
With this commit we introduce a new subcommand `create-track` that allows
users to create a basic Rally track based on data that are already available in
an existing Elasticsearch cluster. Rally will attempt to connect to the target
cluster, extract data and mappings for the specified indices and create a
track that allows to ingest the extract data.

Co-authored-by: Dennis Lawler <[email protected]>

Closes #444
@danielmitterdorfer danielmitterdorfer modified the milestones: 2.x, 2.0.0 May 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@danielmitterdorfer danielmitterdorfer

Labels
enhancement Improves the status quo :Track Management New operations, changes in the track format, track download changes and the like
Projects
None yet
Milestone
2.0.0
Development

Successfully merging a pull request may close this issue.

Add tooling to create a track from existing data danielmitterdorfer/rally
2 participants
@danielmitterdorfer @drawlerr