Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ML] Data frame analytics max_num_threads setting #59254

Merged
merged 6 commits into from
Jul 9, 2020
Merged

[ML] Data frame analytics max_num_threads setting #59254

merged 6 commits into from
Jul 9, 2020

Commits on Jul 9, 2020

  1. [ML] Data frame analytics max_number_threads setting 

    This adds a setting to data frame analytics jobs called
`max_number_threads`. The setting expects a positive integer.
When used the user specifies the max number of threads that may
be used by the analysis. Note that the actual number of threads
used is limited by the number of processors on the node where
the job is assigned. Also, the process may use a couple more threads
for operational functionality that is not the analysis itself.

This setting may also be updated for a stopped job.

More threads may reduce the time it takes to complete the job at the cost
of using more CPU.
    @dimitris-athanasiou
    dimitris-athanasiou committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    e715406 View commit details
    Browse the repository at this point in the history

  2. Fix YAML test and add validation on update

    @dimitris-athanasiou
    dimitris-athanasiou committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    807a53e View commit details
    Browse the repository at this point in the history

  3. Fix doc test

    @dimitris-athanasiou
    dimitris-athanasiou committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    ada72b8 View commit details
    Browse the repository at this point in the history

  4. Docs should have max_num_threads

    @dimitris-athanasiou
    dimitris-athanasiou committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    186c86c View commit details
    Browse the repository at this point in the history

  5. Rename client update to maxNumThreads

    @dimitris-athanasiou
    dimitris-athanasiou committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    e77dae9 View commit details
    Browse the repository at this point in the history

  6. Address more review comments plus add to YAML test

    @dimitris-athanasiou
    dimitris-athanasiou committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    9e5e9b4 View commit details
    Browse the repository at this point in the history