Merge branch 'worker-node-fo-092 of [email protected]:ray-project/mars.git into 0.9-dev

https://code.alipay.com/ray-project/mars/pull_requests/379

Signed-off-by: 慕白 <[email protected]>

* PullRequest: 366 Add request timeout argument for web api

Merge branch add-request-timeout-for-web-api of [email protected]:ray-project/mars.git into 0.9-dev
https://code.linke.alipay.com/ray-project/mars/pull_requests/366?tab=check

Signed-off-by: 天苍 <[email protected]>

* Add reqeust timeout argument for web api

* Add log for IsolatedSession timeout

* Add __repr__ for SyncSession

* Add log

* Add log

* Add DATA_PREPARE_TIMEOUT

* Remove unused log

* Restore default value of http request timeout to 20

* Add lineage info for subtasks

* Add log for monitor_sub_pools

* Detect error

* Add scheduling to recover failed subtasks

* Fix rescheduling and add some log

* Fix

* Fix

* Remove unused method

* Fix log

* Debug scheduling

* Add log for subtask infos

* Add log

* Add log

* Fix scheduling

* Fix schedulng

* Fix duplicated subtasks and add some log

* Fix scheduler

* Enable set_subtask_result when cur_stage_processor is None

* Disable speculation set_subtask_result

* Debug rescheduler

* Add log

* Workaround to trigger scheduling

* Fix dictionary changed

* Fix duplicated scheduling

* Fix duplicated scheduling

* Fix hang

* Add log

* Add log

* Fix rescheduling

* Refactor set_subtask_result of stage

* Fix stage

* Fix stage

* Fix stage finished state

* Fix stage finished state

* Fix stage error state

* Fix stage state

* Disable schedule next when finished

* Fxi rescheduling when error recovery

* Fxi rescheduling when error recovery

* Add errored state for TaskStatus

* Fix reschduling

* Add balancing switch

* Add rescheduling state

* Revert "Add rescheduling state"

This reverts commit fa80e2b62126a35ae9c381c0c16613236dc7d939.

* Add log

* Fix scheduling

* Remove some log

* Update node info when server closed

* Reassign subtasks of closed node

* Add get_bands for NodeinfoCollectorActor

* Fix get_bands

* Fix reassign

* Add debug log for reassigning subtasks

* Fix reassign_subtasks

* Fix repush item

* Fix unexist band in band_queues

* Optimize balancing

* Remove some debug log

* Add SUBMIT_INTERVAL_SECS

* Optimize log

* Remove balance switch

* Decrease SUBMIT_INTERVAL_SECS

* Restore speculation

* Do not cancel subtask when not finished

* Fix set_subtask_result of executor

* Add debug log

* Fix speculation

* Fix speculation

* Add debug log

* Add some debug log

* Add RepeatedExecutionError

* Remove log

* Simplify update of SubtaskResult

* Add DataNotExist recovery

* Fix lineage store

* Fix duplicated error of recovery

* Fix trigger to dependency subtasks

* Fix set_subtask_result of executor

* Remove debug log

* Fix tests

* Pin sqlalchemy

* Fix tests

* Fix test_optimization

* Reorginize tests and configs

* Remove some log

* Fix and lint

* Optimize failover context

…fails

Merge branch 'fix-worker-node-fo-context-cleanup-090dev of [email protected]:ray-project/mars.git into 0.9-dev

https://code.alipay.com/ray-project/mars/pull_requests/392


Signed-off-by: 慕白 <[email protected]>


* Add cleanup for FailOverContext when error recovery fails

…th-lineage