Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Investigate flaky parallel/test-gc-http-client #22336

Closed
Trott opened this issue Aug 15, 2018 · 16 comments
Closed

Investigate flaky parallel/test-gc-http-client #22336

Trott opened this issue Aug 15, 2018 · 16 comments
Labels
flaky-test Issues and PRs related to the tests with unstable failures on the CI. http Issues or PRs related to the http subsystem. test Issues and PRs related to the tests.

Comments

@Trott
Copy link
Member

Trott commented Aug 15, 2018

  • Version: 11.0.0-pre (master)
  • Platform: freebsd11-x64
  • Subsystem: test

https://ci.nodejs.org/job/node-test-commit-freebsd/19681/nodes=freebsd11-x64/console

00:08:04 not ok 694 parallel/test-gc-http-client
00:08:04   ---
00:08:04   duration_ms: 0.545
00:08:04   severity: fail
00:08:04   exitcode: 1
00:08:04   stack: |-
00:08:04     We should do 500 requests
00:08:04     Done: 0/500
00:08:04     Collected: 0/154
00:08:04     events.js:167
00:08:04           throw er; // Unhandled 'error' event
00:08:04           ^
00:08:04     
00:08:04     Error: connect ECONNRESET 127.0.0.1:15615 - Local (127.0.0.1:27660)
00:08:04         at internalConnect (net.js:933:16)
00:08:04         at defaultTriggerAsyncIdScope (internal/async_hooks.js:294:19)
00:08:04         at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1080:9)
00:08:04         at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:62:10)
00:08:04     Emitted 'error' event at:
00:08:04         at Socket.socketErrorListener (_http_client.js:399:9)
00:08:04         at Socket.emit (events.js:182:13)
00:08:04         at emitErrorNT (internal/streams/destroy.js:82:8)
00:08:04         at emitErrorAndCloseNT (internal/streams/destroy.js:50:3)
00:08:04         at process._tickCallback (internal/process/next_tick.js:63:19)
00:08:04   ...
@joyeecheung
Copy link
Member

This also timeouts from time to time. In the last 100 runs:

Reason     parallel/test-gc-http-client
Type       JS_TEST_FAILURE
Failed PR  5 (#22291, #22289, #22286, #22074, #22152)
Appeared   test-digitalocean-ubuntu1604_sharedlibs_container-x64-10, test-digitalocean-freebsd11-x64-1, test-digitalocean-ubuntu1604_sharedlibs_container-x64-9, test-digitalocean-ubuntu1604_sharedlibs_container-x64-8, test-digitalocean-ubuntu1604_sharedlibs_container-x64-7
First CI   https://ci.nodejs.org/job/node-test-pull-request/16401/
Last CI    https://ci.nodejs.org/job/node-test-pull-request/16420/

Example:

not ok 759 parallel/test-gc-http-client
  ---
  duration_ms: 480.47
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    We should do 500 requests
    Done: 0/500
    Collected: 0/11
    Done: 0/500
    Collected: 0/22
    Done: 0/500
    Collected: 0/33
    Done: 0/500
    Collected: 0/44
    Done: 11/500
    Collected: 0/55
    Done: 22/500
    Collected: 0/66
    Done: 33/500
    Collected: 11/77
    Done: 44/500
    Collected: 22/88
    Done: 55/500
    Collected: 33/99
    Done: 66/500
    Coll...

@joyeecheung joyeecheung mentioned this issue Aug 15, 2018
Closed
@maclover7 maclover7 added test Issues and PRs related to the tests. flaky-test Issues and PRs related to the tests with unstable failures on the CI. labels Aug 15, 2018
@Trott
Copy link
Member Author

Trott commented Aug 16, 2018

Again today: https://ci.nodejs.org/job/node-test-commit-freebsd/19713/nodes=freebsd11-x64/console

03:34:55 not ok 728 parallel/test-gc-http-client
03:34:55   ---
03:34:55   duration_ms: 0.398
03:34:55   severity: fail
03:34:55   exitcode: 1
03:34:55   stack: |-
03:34:55     We should do 500 requests
03:34:55     Done: 0/500
03:34:55     Collected: 0/198
03:34:55     events.js:167
03:34:55           throw er; // Unhandled 'error' event
03:34:55           ^
03:34:55     
03:34:55     Error: connect ECONNRESET 127.0.0.1:65483 - Local (127.0.0.1:10142)
03:34:55         at internalConnect (net.js:933:16)
03:34:55         at defaultTriggerAsyncIdScope (internal/async_hooks.js:294:19)
03:34:55         at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1080:9)
03:34:55         at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:62:10)
03:34:55     Emitted 'error' event at:
03:34:55         at Socket.socketErrorListener (_http_client.js:399:9)
03:34:55         at Socket.emit (events.js:182:13)
03:34:55         at emitErrorNT (internal/streams/destroy.js:82:8)
03:34:55         at emitErrorAndCloseNT (internal/streams/destroy.js:50:3)
03:34:55         at process._tickCallback (internal/process/next_tick.js:63:19)
03:34:55   ...

@BridgeAR BridgeAR added the http Issues or PRs related to the http subsystem. label Aug 17, 2018
@BridgeAR BridgeAR mentioned this issue Aug 17, 2018
Closed
4 tasks
@BridgeAR
Copy link
Member

I just had a look at this one and I opened a PR as fix.

@joyeecheung joyeecheung mentioned this issue Aug 17, 2018
Closed
BridgeAR added a commit to BridgeAR/node that referenced this issue Aug 19, 2018
@BridgeAR
test: harden test-gc-http-client
262fc9f 
This reduces the total number of requests from 500 to 300 and triggers
more requests in parallel. It also moves some function creation out
and waits with the first request until the server is listening.

Fixes: nodejs#22336
targos pushed a commit that referenced this issue Aug 21, 2018
@BridgeAR @targos
test: harden test-gc-http-client
73c9592 
This reduces the total number of requests from 500 to 300 and triggers
more requests in parallel. It also moves some function creation out
and waits with the first request until the server is listening.

PR-URL: #22373
Fixes: #22336
Reviewed-By: Joyee Cheung <[email protected]>
Reviewed-By: Luigi Pinca <[email protected]>
Reviewed-By: James M Snell <[email protected]>
@refack
Copy link
Contributor

refack commented Aug 30, 2018

Still there - https://ci.nodejs.org/job/node-test-commit-freebsd/20132/nodes=freebsd11-x64/testReport/(root)/test/parallel_test_gc_http_client/
host: test-digitalocean-freebsd11-x64-1

not ok 695 parallel/test-gc-http-client
  ---
  duration_ms: 0.559
  severity: fail
  exitcode: 1
  stack: |-
    We should do 300 requests
    Done: 0/300
    Collected: 0/120
    events.js:167
          throw er; // Unhandled 'error' event
          ^
    
    Error: connect ECONNRESET 127.0.0.1:51874 - Local (127.0.0.1:40194)
        at internalConnect (net.js:933:16)
        at defaultTriggerAsyncIdScope (internal/async_hooks.js:295:19)
        at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1080:9)
        at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:63:10)
    Emitted 'error' event at:
        at Socket.socketErrorListener (_http_client.js:400:9)
        at Socket.emit (events.js:182:13)
        at emitErrorNT (internal/streams/destroy.js:82:8)
        at emitErrorAndCloseNT (internal/streams/destroy.js:50:3)
        at process._tickCallback (internal/process/next_tick.js:63:19)
  ...

@refack refack reopened this Aug 30, 2018
@Trott
Copy link
Member Author

Trott commented Sep 1, 2018

This test seems to require more resources than other tests. I start getting timeouts with tools/test.py test/parallel/test-gc-http-client.js -j 32 --repeat 64 on my computer. I wonder if it can be refactored a bit or if it should be moved to sequential.

targos pushed a commit that referenced this issue Sep 3, 2018
@BridgeAR @targos
test: harden test-gc-http-client
149c209 
This reduces the total number of requests from 500 to 300 and triggers
more requests in parallel. It also moves some function creation out
and waits with the first request until the server is listening.

PR-URL: #22373
Fixes: #22336
Reviewed-By: Joyee Cheung <[email protected]>
Reviewed-By: Luigi Pinca <[email protected]>
Reviewed-By: James M Snell <[email protected]>
@Trott
Copy link
Member Author

Trott commented Sep 19, 2018

https://ci.nodejs.org/job/node-test-commit-freebsd/20586/nodes=freebsd11-x64/console

08:08:21 not ok 730 parallel/test-gc-http-client
08:08:21   ---
08:08:21   duration_ms: 0.556
08:08:21   severity: fail
08:08:21   exitcode: 1
08:08:21   stack: |-
08:08:21     We should do 300 requests
08:08:21     Done: 0/300
08:08:21     Collected: 0/105
08:08:21     Done: 0/300
08:08:21     Collected: 0/270
08:08:21     events.js:167
08:08:21           throw er; // Unhandled 'error' event
08:08:21           ^
08:08:21     
08:08:21     Error: connect ECONNRESET 127.0.0.1:39650 - Local (127.0.0.1:53340)
08:08:21         at internalConnect (net.js:886:16)
08:08:21         at defaultTriggerAsyncIdScope (internal/async_hooks.js:295:19)
08:08:21         at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1033:9)
08:08:21         at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:63:10)
08:08:21     Emitted 'error' event at:
08:08:21         at Socket.socketErrorListener (_http_client.js:400:9)
08:08:21         at Socket.emit (events.js:182:13)
08:08:21         at emitErrorNT (internal/streams/destroy.js:82:8)
08:08:21         at emitErrorAndCloseNT (internal/streams/destroy.js:50:3)
08:08:21         at process._tickCallback (internal/process/next_tick.js:63:19)
08:08:21   ...

@Trott
Copy link
Member Author

Trott commented Sep 19, 2018 •
edited
Loading

Stress test with -J --repeat 100: https://ci.nodejs.org/job/node-stress-single-test/2019/

Stress test with -j 1 --repeat 100: https://ci.nodejs.org/job/node-stress-single-test/2020/

If the first stress test shows failures and the second one doesn't, it suggests that a (hopefully temporary) move to sequential might stop the failures in CI.

@Trott
Copy link
Member Author

Trott commented Sep 19, 2018

(Stress test with -J --repeat 100 was looking like there wouldn't be any failures, so I canceled both stress tests.)

@Trott
Copy link
Member Author

Trott commented Sep 24, 2018 •
edited
Loading

EDIT: The below is a different test than the one reported in this issue. Sorry for the mistake.

Timing out on Raspberry Pi:

https://ci.nodejs.org/job/node-test-binary-arm/3570/RUN_SUBSET=2,label=pi2-docker/console

00:13:46 not ok 208 parallel/test-gc-net-timeout
00:13:46   ---
00:13:46   duration_ms: 240.89
00:13:46   severity: fail
00:13:46   exitcode: -15
00:13:46   stack: |-
00:13:46     timeout
00:13:46     We should do 500 requests
00:13:46     Done: 11/500
00:13:46     Collected: 0/22
00:13:46     Done: 31/500
00:13:46     Collected: 11/33
00:13:46     Done: 44/500
00:13:46     Collected: 21/44
00:13:46     Done: 44/500
00:13:46     Collected: 31/55
00:13:46     Done: 64/500
00:13:46     Collected: 44/66
00:13:46     Done: 75/500
00:13:46     Collected: 53/77
00:13:46     Done: 86/500
00:13:46     Collected: 64/88
00:13:46     Done: 96/500
00:13:46     Collected: 75/99
00:13:46     Done: 108/500
00:13:46     Collected: 86/110
00:13:46     Done: 120/500
00:13:46     Collected: 96/121
00:13:46     Done: 130/500
00:13:46     Collected: 108/132
00:13:46     Done: 141/500
00:13:46     Collected: 120/143
00:13:46     Done: 162/500
00:13:46     Collected: 141/165
00:13:46     Done: 174/500
00:13:46     Collected: 152/176
00:13:46     Done: 185/500
00:13:46     Collected: 162/187
00:13:46     Done: 195/500
00:13:46     Collected: 174/198
00:13:46     Done: 206/500
00:13:46     Collected: 185/209
00:13:46     Done: 228/500
00:13:46     Collected: 206/231
00:13:46     Done: 250/500
00:13:46     Collected: 228/253
00:13:46     Done: 261/500
00:13:46     Collected: 239/264
00:13:46     Done: 273/500
00:13:46     Collected: 250/275
00:13:46     Done: 283/500
00:13:46     Collected: 261/286
00:13:46     Done: 295/500
00:13:46     Collected: 273/297
00:13:46     Done: 307/500
00:13:46     Collected: 283/308
00:13:46     Done: 327/500
00:13:46     Collected: 307/330
00:13:46     Done: 338/500
00:13:46     Collected: 316/341
00:13:46     Done: 359/500
00:13:46     Collected: 338/363
00:13:46     Done: 381/500
00:13:46     Collected: 347/385
00:13:46     Done: 404/500
00:13:46     Collected: 347/407
00:13:46     Done: 425/500
00:13:46     Collected: 347/429
00:13:46     Done: 437/500
00:13:46     Collected: 347/440
00:13:46     Done: 449/500
00:13:46     Collected: 347/451
00:13:46     Done: 462/500
00:13:46     Collected: 347/462
00:13:46     Done: 462/500
00:13:46     Collected: 347/473
00:13:46     Done: 482/500
00:13:46     Collected: 347/484
00:13:46     Done: 493/500
00:13:46     Collected: 347/495
00:13:46     Done: 497/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:46     Collected: 347/500
00:13:46     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:47     Collected: 347/500
00:13:47     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500
00:13:48     Done: 500/500
00:13:48     Collected: 347/500

@BridgeAR
Copy link
Member

@Trott the comment is actually about a different test than test-gc-http-client. It is test-gc-net-timeout. I'll add a similar fix to this one like I did with this one already. That should at least fix the timeout.

@Trott
Copy link
Member Author

Trott commented Sep 24, 2018

@BridgeAR Whoops, and thanks!

@Trott
Copy link
Member Author

Trott commented Sep 24, 2018

Looks like test-gc-net-timeout is flaky enough to warrant it's on issue. Opening one...

@refack refack mentioned this issue Sep 25, 2018
Closed
Trott added a commit to Trott/io.js that referenced this issue Sep 25, 2018
@Trott
test: improve reliability of test-gc-http-client
ae20e66 
test-gc-http-client is resource-intensive. It times out a lot on CI.
Move to sequential.

Fixes: nodejs#22336
@Trott Trott mentioned this issue Sep 25, 2018
Closed
2 tasks
@Trott
Copy link
Member Author

Trott commented Sep 25, 2018

PR: #23087

@Trott
Copy link
Member Author

Trott commented Sep 28, 2018

I believe this is fixed by #23145

@Trott Trott mentioned this issue Sep 28, 2018
Closed
2 tasks
Trott added a commit to Trott/io.js that referenced this issue Sep 28, 2018
@Trott
test: fix unreliable test-gc-http-client
8741af6 
Calling `global.gc()` in multiple places leads to unreliability. Call it
in the interval only.

Fixes: nodejs#22336
This was referenced Oct 1, 2018
Merged
Merged
@Trott Trott closed this as completed Oct 26, 2018
@sam-github sam-github reopened this Jun 7, 2019
@sam-github
Copy link
Contributor

This is still marked flaky in test/sequential/sequential.status. Is that not accurate? If it isn't, we should close this issue by PRing removal of the flaky status.

If it is accurate the issue should still be open.

Or perhaps the .status file points to the wrong issue, or something else should be done to reconcile this? @Trott

@Trott
Copy link
Member Author

Trott commented Jun 8, 2019

This is still marked flaky in test/sequential/sequential.status. Is that not accurate? If it isn't, we should close this issue by PRing removal of the flaky status.

If it is accurate the issue should still be open.

Or perhaps the .status file points to the wrong issue, or something else should be done to reconcile this? @Trott

Yup. #28130

@Trott Trott closed this as completed in 64d7056 Jun 10, 2019
BridgeAR pushed a commit that referenced this issue Jun 17, 2019
@Trott @BridgeAR
test: remove test-gc-http-client from status file
d8061dc 
test-gc-http-client is no longer believed to be unreliable. Remove it's
entry indicating it's flaky from the status file.

Closes: #22336

PR-URL: #28130
Reviewed-By: Gireesh Punathil <[email protected]>
Reviewed-By: Sam Roberts <[email protected]>
Reviewed-By: Anto Aravinth <[email protected]>
Reviewed-By: Luigi Pinca <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: Ruben Bridgewater <[email protected]>
Reviewed-By: Trivikram Kamat <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
flaky-test Issues and PRs related to the tests with unstable failures on the CI. http Issues or PRs related to the http subsystem. test Issues and PRs related to the tests.
Projects
None yet
Milestone
No milestone
6 participants
@sam-github @refack @Trott @maclover7 @joyeecheung @BridgeAR