+2
Under review

.htm and .html files cannot be synced; e-tag error

ruggiero 11 months ago updated by Vlad R 5 months ago 10

I have several folders of local website development projects that were - until recently - syncing very well to my Filerun instance, using the latest Windows Nextcloud client.  Now, any files ending in .htm or html throw an error by Nextcloud, No e-tag received from server, check proxy/gateway.

I have already installed the replacement download.php suggested in a previous thread concerning the e-tag issue, but it has not fixed the problem.  I think either Filerun or Nextcloud is trying to treat the HTML pages like they are part of an active website that is being served, and while that is true on my local machine, it should not be the case here. 

PS:  I am also getting the occasional error 500 when syncing text files.  Yes, I removed and re-added my sync connection.

Under review

Are you using a reverse proxy, or some type of cache, cloudflare?

Any PHP errors logged on the server?

No proxy, and host has turned of NGINX caching; first thing I thought of.  No errors logged either.


It would help if you could include some of the Nextcloud log (F12 from Settings panel of the sync app)

Hi,

Apologies, I did find a relevant error log entry, on the server:

[Fri Mar 25 04:00:58.300340 2022] [cgi:error] [pid 3093492] [client X.X.X.X:44786] AH01215: #4 /home/ustorage/fstore.ruggieroav.net/system/modules/fileman/sections/default/php/webdav.php(5): FileRun\\Web in /home/ustorage/fstore.ruggieroav.net/system/classes/vendor/FileRun/Files/Actions/Upload/PUT/Upload.php on line 36: /usr/local/cpanel/cgi-sys/ea-php74

I'll post the relevant error logs from Nextcloud when I am back on my home PC.

The Nextcloud logs are verbose, but I think this represents an error:
2022-03-25 17:17:42:020 [ debug nextcloud.sync.statustracker C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\libsync\syncfilestatustracker.cpp:274 ] [ OCC::SyncFileStatusTracker::slotItemCompleted ]: Item completed "Benassi Bros/No Matter What I Do/AlbumArt_{B5020207-474E-4720-7F59-D82DF3F26200}_Large.jpg" OCC::SyncFileItem::NoStatus CSyncEnums::CSYNC_INSTRUCTION_UPDATE_METADATA

(note that these AlbumArt files are another item that Nextcloud has always had issue with)

I have the same issue after multiple installs over the months/years. I had reported the issue before, but I didn't provide adequate information for an investigation. I didn't notice the file types causing the e-tag error until it was pointed out above, it does seem consistent with the file type.

I have hundreds of these errors and it does seem to be almost all.html files in my case. Here's a snippet of an example.

I'm on FileRun server 20220519 via Docker on Unraid with NextCloud client 3.4.2 with Windows 10 Pro. I use Nginx Proxy Manager for my reverse proxy.

2022-06-23 10:19:48:593 [ info nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\libsync\owncloudpropagator.cpp:1161 ]:    PropagateDirectory::slotSubJobsFinished emit finished OCC::SyncFileItem::BlacklistedError
2022-06-23 10:19:48:598 [ info nextcloud.sync.propagator.root.directory C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\libsync\owncloudpropagator.cpp:1214 ]:    scheduleSelfOrChild OCC::PropagatorJob::Running pending uploads 0 subjobs state OCC::PropagatorJob::Running
2022-06-23 10:19:48:598 [ info nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\libsync\owncloudpropagator.h:212 ]:    Starting CSyncEnums::CSYNC_INSTRUCTION_IGNORE propagation of "Apps/winMd5SumPortable/help.html" by OCC::PropagateIgnoreJob(0x253786fe0c0)
2022-06-23 10:19:48:598 [ warning nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\libsync\owncloudpropagator.cpp:281 ]:    Could not complete propagation of "Apps/winMd5SumPortable/help.html" by OCC::PropagateIgnoreJob(0x253786fe0c0) with status OCC::SyncFileItem::BlacklistedError and error: "No E-Tag received from server, check Proxy/Gateway (skipped due to earlier error, trying again in 56 second(s))"
2022-06-23 10:19:48:598 [ debug nextcloud.sync.statustracker C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\libsync\syncfilestatustracker.cpp:274 ]    [ OCC::SyncFileStatusTracker::slotItemCompleted ]:    Item completed "Apps/winMd5SumPortable/help.html" OCC::SyncFileItem::BlacklistedError CSyncEnums::CSYNC_INSTRUCTION_IGNORE
2022-06-23 10:19:48:598 [ debug nextcloud.gui.socketapi C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\gui\socketapi\socketapi.cpp:205 ]    [ OCC::SocketListener::sendMessage ]:    Sending SocketAPI message --> "STATUS:SYNC:C:\\Users\\Folder\\Cloud Sync" to QLocalSocket(0x2537801c110)
2022-06-23 10:19:48:598 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\common/ownsql.h:145 ]    [ OCC::SqlQuery::bindValue ]:    SQL bind 1 -6321123259699561044
2022-06-23 10:19:48:598 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\common\ownsql.cpp:295 ]    [ OCC::SqlQuery::exec ]:    SQL exec "SELECT path, inode, modtime, type, md5, fileid, remotePerm, filesize,  ignoredChildrenRemote, contentchecksumtype.name || ':' || contentChecksum, e2eMangledName, isE2eEncrypted  FROM metadata  LEFT JOIN checksumtype as contentchecksumtype ON metadata.contentChecksumTypeId == contentchecksumtype.id WHERE phash=?1"
2022-06-23 10:19:48:598 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\common/ownsql.h:145 ]    [ OCC::SqlQuery::bindValue ]:    SQL bind 1 6082860974143060839
2022-06-23 10:19:48:598 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\common\ownsql.cpp:295 ]    [ OCC::SqlQuery::exec ]:    SQL exec "SELECT path, inode, modtime, type, md5, fileid, remotePerm, filesize,  ignoredChildrenRemote, contentchecksumtype.name || ':' || contentChecksum, e2eMangledName, isE2eEncrypted  FROM metadata  LEFT JOIN checksumtype as contentchecksumtype ON metadata.contentChecksumTypeId == contentchecksumtype.id WHERE phash=?1"
2022-06-23 10:19:48:599 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-9041\client-building\desktop\src\gui\tray\usermodel.cpp:561 ]:    Item  "Apps/winMd5SumPortable/help.html"  retrieved resulted in  "No E-Tag received from server, check Proxy/Gateway (skipped due to earlier error, trying again in 56 second(s))"

Just checking if there is more information I can provide to help understand the issue above

I also have this problem. My configuration is FileRun version 20220519 via Docker on QNAP NAS client 3.5.4 on Windows 11. I use Cloudflare Argo Tunneling service (another docker on my NAS)

2022-09-04 16:04:56:943 [ info sync.discovery C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\libsync\discovery.cpp:354 ]:    Processing "Zhuangzi/innersix.html" | valid: false/false/true | mtime: 0/0/1656431358 | size: 0/0/13539 | etag: ""//"72e165cdfe7221d43afee9afa00870b5" | checksum: ""//"" | perm: ""//"WDNVCKR" | fileid: ""//"00191500" | inode: 0/0/ | type: CSyncEnums::ItemTypeSkip/CSyncEnums::ItemTypeSkip/CSyncEnums::ItemTypeFile | e2ee: false/false | e2eeMangledName: ""/"" | file lock: not locked//not locked
2022-09-04 16:04:56:943 [ info sync.discovery C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\libsync\discovery.cpp:482 ]:    OCC::SyncFileItem::LockStatus::UnlockedItem "" "" OCC::SyncFileItem::LockOwnerType::UserLock "" 0 0
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common/ownsql.h:151 ]    [ OCC::SqlQuery::bindValue ]:    SQL bind 1 "00191500"
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common\ownsql.cpp:295 ]    [ OCC::SqlQuery::exec ]:    SQL exec "SELECT path, inode, modtime, type, md5, fileid, remotePerm, filesize,  ignoredChildrenRemote, contentchecksumtype.name || ':' || contentChecksum, e2eMangledName, isE2eEncrypted,   lock, lockOwnerDisplayName, lockOwnerId, lockType, lockOwnerEditor, lockTime, lockTimeout  FROM metadata  LEFT JOIN checksumtype as contentchecksumtype ON metadata.contentChecksumTypeId == contentchecksumtype.id WHERE fileid=?1"
2022-09-04 16:04:56:943 [ info sync.discovery C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\libsync\discovery.cpp:1425 ]:    Discovered "Zhuangzi/innersix.html" CSyncEnums::CSYNC_INSTRUCTION_NEW OCC::SyncFileItem::Down CSyncEnums::ItemTypeFile
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common/ownsql.h:145 ]    [ OCC::SqlQuery::bindValue ]:    SQL bind 1 "Zhuangzi/innersix.html"
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common\ownsql.cpp:295 ]    [ OCC::SqlQuery::exec ]:    SQL exec "SELECT lastTryEtag, lastTryModtime, retrycount, errorstring, lastTryTime, ignoreDuration, renameTarget, errorCategory, requestId FROM blacklist WHERE path=?1 COLLATE NOCASE"
2022-09-04 16:04:56:943 [ info sync.discovery C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\libsync\discovery.cpp:354 ]:    Processing "Zhuangzi/innerthree.html" | valid: false/false/true | mtime: 0/0/1659434058 | size: 0/0/8812 | etag: ""//"9fe69d872cc8436fa1df13283fabdeb9" | checksum: ""//"" | perm: ""//"WDNVCKR" | fileid: ""//"00191501" | inode: 0/0/ | type: CSyncEnums::ItemTypeSkip/CSyncEnums::ItemTypeSkip/CSyncEnums::ItemTypeFile | e2ee: false/false | e2eeMangledName: ""/"" | file lock: not locked//not locked
2022-09-04 16:04:56:943 [ info sync.discovery C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\libsync\discovery.cpp:482 ]:    OCC::SyncFileItem::LockStatus::UnlockedItem "" "" OCC::SyncFileItem::LockOwnerType::UserLock "" 0 0
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common/ownsql.h:151 ]    [ OCC::SqlQuery::bindValue ]:    SQL bind 1 "00191501"
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common\ownsql.cpp:295 ]    [ OCC::SqlQuery::exec ]:    SQL exec "SELECT path, inode, modtime, type, md5, fileid, remotePerm, filesize,  ignoredChildrenRemote, contentchecksumtype.name || ':' || contentChecksum, e2eMangledName, isE2eEncrypted,   lock, lockOwnerDisplayName, lockOwnerId, lockType, lockOwnerEditor, lockTime, lockTimeout  FROM metadata  LEFT JOIN checksumtype as contentchecksumtype ON metadata.contentChecksumTypeId == contentchecksumtype.id WHERE fileid=?1"
2022-09-04 16:04:56:943 [ info sync.discovery C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\libsync\discovery.cpp:1425 ]:    Discovered "Zhuangzi/innerthree.html" CSyncEnums::CSYNC_INSTRUCTION_NEW OCC::SyncFileItem::Down CSyncEnums::ItemTypeFile
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common/ownsql.h:145 ]    [ OCC::SqlQuery::bindValue ]:    SQL bind 1 "Zhuangzi/innerthree.html"
2022-09-04 16:04:56:943 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-11185\client-building\desktop\src\common\ownsql.cpp:295 ]    [ OCC::SqlQuery::exec ]:    SQL exec "SELECT lastTryEtag, lastTryModtime, retrycount, errorstring, lastTryTime, ignoreDuration, renameTarget, errorCategory, requestId FROM blacklist WHERE path=?1 COLLATE NOCASE"

I will look into this shortly. (Though I don't see an actual error message in @dwong's log.)