Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

[Close as Dup] assessor is not able to know a trial job is retried or not in PAI mode #863

Closed
QuanluZhang opened this issue Mar 18, 2019 · 1 comment
Assignees
Labels
enhancement New feature or request nnidev

Comments

@QuanluZhang
Copy link
Contributor

Short summary about the issue/question: In PAI mode, a job might be preempted if the job is using bonus quota. In this case, assessor is not able to distinguish this status change, the intermediate results (e.g., learning curve) would become strange.

Brief what process you are following: normal process.

How to reproduce it: always

nni Environment:

  • nni version: 0.5.2
  • nni mode(local|pai|remote): pai
  • OS: ubuntu 16.04
  • python version: 3.6
  • is conda or virtualenv used?: no
  • is running in docker?: no

Anything else we need to know: no

@scarlett2018 scarlett2018 added the enhancement New feature or request label Apr 10, 2019
@scarlett2018 scarlett2018 changed the title assessor is not able to know a trial job is retried or not in PAI mode [Close as Dup] assessor is not able to know a trial job is retried or not in PAI mode Apr 10, 2019
@scarlett2018
Copy link
Member

Close as dup of correctly deal with job retries on openpai #919

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request nnidev
Projects
None yet
Development

No branches or pull requests

3 participants