You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I use the treemode to copy a 136MB file to 142 remote nodes with the following command, which took 36 minutes:
clush -o-q -w "node1 node2" --copy test.tar --dest /tmp/
However, when I turn off the treemode, the same copy only took 20 seconds. Sometimes, copying large files may freeze (occasionally), but there are no error messages during the copying process. Could you please explain what protocol treemode uses for large file copying? Is it possible to optimize this feature?
The text was updated successfully, but these errors were encountered:
This is a known limitation that the tree mode has sub-optimal performance. This is more a convenient feature for running commands or copying small files (think configuration files) on nodes that would not be reachable otherwise.
This is not a file transfer feature and does not compare to scp, rsync, etc...
We can keep this ticket open as a request to implement a faster transfer mode, but this is low priority for now.
I use the treemode to copy a 136MB file to 142 remote nodes with the following command, which took 36 minutes:
clush -o-q -w "node1 node2" --copy test.tar --dest /tmp/
However, when I turn off the treemode, the same copy only took 20 seconds. Sometimes, copying large files may freeze (occasionally), but there are no error messages during the copying process. Could you please explain what protocol treemode uses for large file copying? Is it possible to optimize this feature?
The text was updated successfully, but these errors were encountered: