Uploading large files fails with nextcloud 20.0.6 on raspberry pi 2 with 32bit cpu #25782
Labels
Comments
mrkatzo
added
0. Needs triage
|
Closing as duplicate of #16431. |
|
This is not really a duplicate of #16431. The error does not speciffically occures at 2GB+ or 4GB+ files. Nextcloud seems to have a bunch of issues with large files. So have one issue for large-file-problems that can then be fixed sometimes. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Steps to reproduce
Expected behaviour
Uploading large files via nextcloud-webgui should work.
Actual behaviour
Uploading a file of 5GB takes some time.
When all data is transfered to the nextcloud server, the server obvioulsy starts assembling the file from chunks.
Assembling fails and the following error is displayed in the browser:
[webdav] Fatal: Sabre\DAV\Exception: Error while copying file to target location (copied bytes: -1, expected filesize: -1 ) at <>
Messeges from protocol from Nextcloud admin-gui from 2021-02-17T22:58:25+0100:
OC\Log\ErrorHandler::onError(2, "Cannot modify h ... )", "/var/www/html/n ... p", 691, {string: "X-Hash ... "})
header("X-Hash-SHA1: 29 ... b")
OCA\DAV\Connector\Sabre\File->header("X-Hash-SHA1: 29 ... b")
OCA\DAV\Connector\Sabre\File->OCA\DAV\Connector\Sabre{closure}("*** sensitive parameters replaced ***")
call_user_func(Closure {}, "*** sensitive parameter replaced ***")
OC\Files\Stream\HashWrapper->stream_close()
fclose(null)
Icewind\Streams\Wrapper->stream_close()
OC\Files\Stream\HashWrapper->stream_close()
Sabre\DAV\Server->exec()
OCA\DAV\Server->exec()
require_once("/var/www/html/n ... p")
MOVE /nextcloud/remote.php/dav/uploads/walter/web-file-upload-ac54f9335b65f2f7cdefc613ad2a036a-1613594591360/.file
from 192.168.178.38 by walter at 2021-02-17T21:58:25+00:00
[PHP] Error: Error: Cannot modify header information - headers already sent by (output started at /var/www/html/nextcloud/3rdparty/sabre/http/lib/Sapi.php:132) at /var/www/html/nextcloud/apps/dav/lib/Connector/Sabre/File.php#691 at <>
OC\Log\ErrorHandler::onError(2, "Cannot modify h ... )", "/var/www/html/n ... p", 691, {string: "X-Hash ... "})
header("X-Hash-SHA256: ... 3")
OCA\DAV\Connector\Sabre\File->header("X-Hash-SHA256: ... 3")
OCA\DAV\Connector\Sabre\File->OCA\DAV\Connector\Sabre{closure}("*** sensitive parameters replaced ***")
call_user_func(Closure {}, "*** sensitive parameter replaced ***")
OC\Files\Stream\HashWrapper->stream_close()
Sabre\DAV\Server->exec()
OCA\DAV\Server->exec()
require_once("/var/www/html/n ... p")
MOVE /nextcloud/remote.php/dav/uploads/walter/web-file-upload-ac54f9335b65f2f7cdefc613ad2a036a-1613594591360/.file
from 192.168.178.38 by walter at 2021-02-17T21:58:25+00:00
[no app in context] Error: Sabre\DAV\Exception: Error while copying file to target location (copied bytes: -1, expected filesize: -1 ) at <>
OCA\DAV\Connector\Sabre\File->put(null)
OCA\DAV\Connector\Sabre\Directory->createFile("pso-niemals_web.720p.mkv", null)
Sabre\DAV\Tree->copyNode(OCA\DAV\Upload\FutureFile {}, OCA\DAV\Connector\Sabre\Directory {}, "pso-niemals_web.720p.mkv")
Sabre\DAV\Tree->copy("uploads/walter/ ... e", "files/walter/sh ... v")
Sabre\DAV\Tree->move("uploads/walter/ ... e", "files/walter/sh ... v")
OCA\DAV\Upload\ChunkingPlugin->performMove("uploads/walter/ ... e", "files/walter/sh ... v")
OCA\DAV\Upload\ChunkingPlugin->beforeMove("uploads/walter/ ... e", "files/walter/sh ... v")
Sabre\DAV\Server->emit("beforeMove", ["uploads/walter ... "])
Sabre\DAV\CorePlugin->httpMove(Sabre\HTTP\Request {}, Sabre\HTTP\Response {})
Sabre\DAV\Server->emit("method:MOVE", [Sabre\HTTP\Requ ... }])
Sabre\DAV\Server->invokeMethod(Sabre\HTTP\Request {}, Sabre\HTTP\Response {})
Sabre\DAV\Server->start()
Sabre\DAV\Server->exec()
OCA\DAV\Server->exec()
require_once("/var/www/html/n ... p")
MOVE /nextcloud/remote.php/dav/uploads/walter/web-file-upload-ac54f9335b65f2f7cdefc613ad2a036a-1613594591360/.file
from 192.168.178.38 by walter at 2021-02-17T21:58:23+00:00
Prior error-message, but file is ok:
[PHP] Error: Error: file_put_contents(): content truncated from 2539095840 to 2147483647 bytes at /var/www/html/nextcloud/lib/private/Files/Storage/Local.php#559 at <>
OC\Log\ErrorHandler::onError(2, "file_put_conten ... s", "/var/www/html/n ... p", 559, {path: "files/sh ... l})
file_put_contents("/opt/externalhd ... t", null)
OC\Files\Storage\Local->writeStream("files/shared/Un ... t", null, null)
OC\Files\Storage\Wrapper\Wrapper->writeStream("files/shared/Un ... t", null)
OCA\DAV\Connector\Sabre\File->put(null)
OCA\DAV\Connector\Sabre\Directory->createFile("Unser Mann in Amerika 720p.mkv", null)
Sabre\DAV\Tree->copyNode(OCA\DAV\Upload\FutureFile {}, OCA\DAV\Connector\Sabre\Directory {}, "Unser Mann in Amerika 720p.mkv")
Sabre\DAV\Tree->copy("uploads/walter/ ... e", "files/walter/sh ... v")
Sabre\DAV\Tree->move("uploads/walter/ ... e", "files/walter/sh ... v")
OCA\DAV\Upload\ChunkingPlugin->performMove("uploads/walter/ ... e", "files/walter/sh ... v")
OCA\DAV\Upload\ChunkingPlugin->beforeMove("uploads/walter/ ... e", "files/walter/sh ... v")
Sabre\DAV\Server->emit("beforeMove", ["uploads/walter ... "])
Sabre\DAV\CorePlugin->httpMove(Sabre\HTTP\Request {}, Sabre\HTTP\Response {})
Sabre\DAV\Server->emit("method:MOVE", [Sabre\HTTP\Requ ... }])
Sabre\DAV\Server->invokeMethod(Sabre\HTTP\Request {}, Sabre\HTTP\Response {})
Sabre\DAV\Server->start()
Sabre\DAV\Server->exec()
OCA\DAV\Server->exec()
require_once("/var/www/html/n ... p")
MOVE /nextcloud/remote.php/dav/uploads/walter/web-file-upload-797b68e2e43a4df1289f42da62e01670-1613592337334/.file
from 192.168.178.38 by walter at 2021-02-17T20:41:46+00:00
Server configuration
Operating system: Raspbian GNU/Linux 10 (buster)
Web server: apache2 2.4.38-3+deb10u4 armhf
Database: mariadb-server-10.3 1:10.3.27-0+deb10u1 armhf
PHP version: php7.3-common 7.3.19-1~deb10u1 armhf
Nextcloud version: 20.0.6
Updated from an older Nextcloud/ownCloud or fresh install: fresh
Where did you install Nextcloud from: from nextcloud-20.0.6.zip
Signing status: don't know about that
Login as admin user into your Nextcloud and access
http://example.com/index.php/settings/integrity/failed
paste the results here.
No errors have been found.
List of activated apps:
Accessibility
1.6.0
Activity
2.13.4
Brute-force settings
2.0.1
Calendar
2.1.3
Collabora Online
3.7.14
Collaborative tags
1.10.0
Comments
1.10.0
Contacts
3.4.3
Contacts Interaction
1.1.0
Dashboard
7.0.0
Deleted files
1.10.1
Federation
1.10.1
File sharing
1.12.2
First run wizard
2.9.0
Log Reader
2.5.0
Monitoring
1.10.0
Nextcloud announcements
1.9.0
Notifications
2.8.0
Password policy
1.10.1
PDF viewer
2.0.1
Photos
1.2.3
Privacy
1.4.0
Recommendations
0.8.0
Right click
0.17.0
Share by mail
1.10.0
Support
1.3.0
Talk
10.0.5
Text
3.1.0
Theming
1.11.0
Update notification
1.10.0
Usage survey
1.8.0
User status
1.0.1
Versions
1.13.0
Video player
1.9.0
Weather status
1.0.0
App list
If you have access to your command line run e.g.:
sudo -u www-data php occ app:list
from within your Nextcloud installation folder
Enabled:
Disabled:
Nextcloud configuration:
Config report
If you have access to your command line run e.g.:
sudo -u www-data php occ config:list system
from within your Nextcloud installation folder
{
"system": {
"instanceid": "REMOVED SENSITIVE VALUE",
"passwordsalt": "REMOVED SENSITIVE VALUE",
"secret": "REMOVED SENSITIVE VALUE",
"trusted_domains": [
"my.host.net"
],
"datadirectory": "REMOVED SENSITIVE VALUE",
"dbtype": "mysql",
"version": "20.0.6.1",
"overwrite.cli.url": "https://my.host.net/nextcloud",
"dbname": "REMOVED SENSITIVE VALUE",
"dbhost": "REMOVED SENSITIVE VALUE",
"dbport": "",
"dbtableprefix": "oc_",
"mysql.utf8mb4": true,
"dbuser": "REMOVED SENSITIVE VALUE",
"dbpassword": "REMOVED SENSITIVE VALUE",
"installed": true
}
}
or
Insert your config.php content here.
Make sure to remove all sensitive content such as passwords. (e.g. database password, passwordsalt, secret, smtp password, …)
pi@homunculus:/var/www/html/nextcloud/config $ sudo cat config.php
'12345', 'passwordsalt' => 'blah', 'secret' => 'blahblah', 'trusted_domains' => array ( 0 => 'my.host.net', ), 'datadirectory' => '/opt/externalhd/nextclouddata', 'dbtype' => 'mysql', 'version' => '20.0.6.1', 'overwrite.cli.url' => 'https://my.host.net/nextcloud', 'dbname' => 'nextclouddb', 'dbhost' => 'localhost', 'dbport' => '', 'dbtableprefix' => 'oc_', 'mysql.utf8mb4' => true, 'dbuser' => 'nextclouduser', 'dbpassword' => '***************', 'installed' => true, ); pi@homunculus:/var/log/apache2 $ cat /etc/php/7.3/apache2/php.ini | grep "^[^;[]" engine = On short_open_tag = Off precision = 14 output_buffering = Off zlib.output_compression = Off implicit_flush = Off unserialize_callback_func = serialize_precision = -1 disable_functions = pcntl_alarm,pcntl_fork,pcntl_waitpid,pcntl_wait,pcntl_wifexited,pcntl_wifstopped,pcntl_wifsignaled,pcntl_wifcontinued,pcntl_wexitstatus,pcntl_wtermsig,pcntl_wstopsig,pcntl_signal,pcntl_signal_get_handler,pcntl_signal_dispatch,pcntl_get_last_error,pcntl_strerror,pcntl_sigprocmask,pcntl_sigwaitinfo,pcntl_sigtimedwait,pcntl_exec,pcntl_getpriority,pcntl_setpriority,pcntl_async_signals, disable_classes = zend.enable_gc = On expose_php = Off max_execution_time = 3600 max_input_time = 3600 memory_limit = 512M error_reporting = E_ALL display_errors = Off display_startup_errors = Off log_errors = On log_errors_max_len = 1024 ignore_repeated_errors = Off ignore_repeated_source = Off report_memleaks = On html_errors = On error_log = /var/log/php_errors.log variables_order = "GPCS" request_order = "GP" register_argc_argv = Off auto_globals_jit = On post_max_size = 8G auto_prepend_file = auto_append_file = default_mimetype = "text/html" default_charset = "UTF-8" doc_root = user_dir = enable_dl = Off file_uploads = On upload_tmp_dir = /opt/externalhd/tmp upload_max_filesize = 8G max_file_uploads = 20 allow_url_fopen = On allow_url_include = Off default_socket_timeout = 60 cli_server.color = On pdo_mysql.default_socket= SMTP = localhost smtp_port = 25 mail.add_x_header = Off odbc.allow_persistent = On odbc.check_persistent = On odbc.max_persistent = -1 odbc.max_links = -1 odbc.defaultlrl = 4096 odbc.defaultbinmode = 1 ibase.allow_persistent = 1 ibase.max_persistent = -1 ibase.max_links = -1 ibase.timestampformat = "%Y-%m-%d %H:%M:%S" ibase.dateformat = "%Y-%m-%d" ibase.timeformat = "%H:%M:%S" mysqli.max_persistent = -1 mysqli.allow_persistent = On mysqli.max_links = -1 mysqli.default_port = 3306 mysqli.default_socket = mysqli.default_host = mysqli.default_user = mysqli.default_pw = mysqli.reconnect = Off mysqlnd.collect_statistics = On mysqlnd.collect_memory_statistics = Off pgsql.allow_persistent = On pgsql.auto_reset_persistent = Off pgsql.max_persistent = -1 pgsql.max_links = -1 pgsql.ignore_notice = 0 pgsql.log_notice = 0 bcmath.scale = 0 session.save_handler = files session.use_strict_mode = 0 session.use_cookies = 1 session.use_only_cookies = 1 session.name = PHPSESSID session.auto_start = 0 session.cookie_lifetime = 0 session.cookie_path = / session.cookie_domain = session.cookie_httponly = session.cookie_samesite = session.serialize_handler = php session.gc_probability = 0 session.gc_divisor = 1000 session.gc_maxlifetime = 1440 session.referer_check = session.cache_limiter = nocache session.cache_expire = 180 session.use_trans_sid = 0 session.sid_length = 26 session.trans_sid_tags = "a=href,area=href,frame=src,form=" session.sid_bits_per_character = 5 zend.assertions = -1 tidy.clean_output = Off soap.wsdl_cache_enabled=1 soap.wsdl_cache_dir="/tmp" soap.wsdl_cache_ttl=86400 soap.wsdl_cache_limit = 5 ldap.max_links = -1Web server error log
``` Insert your webserver log here ```The text was updated successfully, but these errors were encountered: