-
-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Error while syncing/uploading large files #4392
Comments
Can you provide error logs? Also how large is the file and what filesystem is on your server? |
Error logs, I have provided in the description above. |
You provided server configuration, not logs. |
But on second thought 91 MB is beyond default php configuration. Check php configuration 'upload_max_filesize'. You may not be able to edit this on shared hosting. |
upload_max_filesize = 128MB |
"General error: 2006 MySQL server has gone away" |
from bellow link, I followed instruction by "ManoM" and reduced the OWNCLOUD_CHUNK_SIZE to 512 KB https://forum.owncloud.org/viewtopic.php?t=26712 but still facing some issue while uploading large files. I was continuously monitoring my webserver while uploading cst.mp4 which was of size 91 MB. while syncing the file, chunks of size 512 KB each were getting uploaded one by one. All the 183 chunks got uploaded in the cache folder. After that nextcloud started joining those chunks to one file in webserver. Count of chunks started getting reduced, I think nextcloud was joining them and deleting them from cache folder. after some time, error was shown in desktop client and when I check cache folder in webserver, chunks which were getting deleted were stoped in between. I think issue occuered while joining the chunks back. I am using shared hosting, hence can't change much in the server configuration. I think there should be self healing and recovery machanism in the webserver to handle such cases. so that, It can be resumed later. After this error, this file, "cst.mp4" went to lock state, and I started getting error that file is locked, Then I had to clear Lock table in the mysql db. |
Without the error and the log we can't do much here. Please provide this information first. |
Please click on app list, error logs are hidden beyond it, I don't know how, but they got hidden. |
Ah ... this is a little bit broken syntax. let me fix this. |
Looking at the logs: There are only "Mysql has gone away messages. Could I ask you to open a new ticket. This here is clearly because of the mysql server issue. Please provide new logs where the MySQL server is available. Thanks |
yes, "mysql gone" may be the reason of file upload error but can't be handle such cases in coding, so that file upload resumes if such cases occurs. while uploading large file, chances of mysql or php issues are also large. Can't we handle and resume uploading of such cases. On 20 april, I have mentioned all the steps by which we can replicate the issue please refer below link. |
What? Usually there shouldn't be any such cases.
We go into "server not available" mode once the mysql is gone and then in operation once the mysql is available again. This is more a client issue. In the web UI there is no other way then to ask the user to retry. |
I have not uploaded file using web UI, I am using desktop client. I tried to upload same file several times, more that 20 times. But still there is no success. Every time I am facing similar issues. If you want, I can give you access to my logs and create your account in my nextcloud server. Please provide me email id. you can try to upload large file and check. |
Please ask in the forums for help to make MySQL and PHP more stable. If they fail there is a reason. Nevertheless we will try to make the desktop client more stable, but with mysql failures on every upload we can't do much. |
Steps to reproduce
Expected behaviour
Large file should uploaded and sync properly
Actual behaviour
Error occured
Server configuration
Operating system: Linux uk-m247-web19.main-hosting.eu 2.6.32-673.26.1.lve1.4.20.el6.x86_64 #1 SMP Tue Dec 27 17:42:53 EST 2016 x86_64
Web server: Apache (litespeed)
Database: mysql 10.0.28
PHP version: 7.0.18
Modules loaded: Core, date, libxml, openssl, pcre, sqlite3, zlib, bz2, calendar, ctype, curl, hash, filter, ftp, gettext, gmp, SPL, iconv, pcntl, readline, Reflection, session, standard, shmop, SimpleXML, mbstring, tokenizer, xml, litespeed, bcmath, dom, fileinfo, gd, imagick, imap, intl, Phar, json, exif, mcrypt, mysqlnd, mysqli, PDO, pdo_mysql, pdo_sqlite, posix, pspell, soap, sockets, tidy, wddx, xmlreader, xmlrpc, xmlwriter, xsl, zip, ionCube Loader
Nextcloud version: 11.0.2 (stable) - 11.0.2.7
Updated from an older Nextcloud/ownCloud or fresh install:
Where did you install Nextcloud from:
Signing status:
Signing status
List of activated apps:
App list
The content of config/config.php:
Config report
Are you using external storage, if yes which one: files_external is disabled
Are you using encryption: no
Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
Client configuration
Browser: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36
Operating system:
Logs
Desktop Client Logs
Desktop client log
Nextcloud log (data/nextcloud.log)
Nextcloud log
The text was updated successfully, but these errors were encountered: