Nextcloud desktop client conflict without a reason

vbspam commented 5 years ago

Nextcloud desktop client conflict without a reason.

Expected behaviour

Updates from the single client should be sent to the server. If files change, new versions should be sent to the server.

Actual behaviour

Initial synchronization works. The subsequent synchronizations fails with "Conflict: Server version downloaded, local copy renamed and not uploaded."

Steps to reproduce

Setup Nextcloud server
Install Nextcloud client 2.5.1 on Ubuntu 18.04
Let it synchronize your ~/.mozilla or ~/.thunderbird folder

Client configuration

Client version:2.5.1

Operating system: Ubuntu 18.04 Neon flavour

OS language: English

Qt version used by client package (Linux only, see also Settings dialog): no QT info in settings dialog

Client package (From Nextcloud or distro) (Linux only): http://ppa.launchpad.net/nextcloud-devs/client/ubuntu

Installation path of client: /usr/bin/nextcloud

Req commented 5 years ago

I manage a nextcloud and this has happened multiple times to two of my users too. The fles have all been Excel files. There is nothing in the log. Only one user using the system at the time and continuous online connection, so an actual conflict not possible, file marked as conflicted after saving.

jirislav commented 5 years ago

I got into this problem too. It's really annoying.

I know I'm the only one person, who make changes to the file about to be synced with Nextcloud, but for some reason, the conflicted copy file is created, resulting in refusal of successful upload.

Maybe it's some kind of race condition?

How else would Nextcloud have newer version of the file than me? I'm absolutely 100% sure I'm the only one editor of the file.

jirislav commented 5 years ago

Okay, it happened again yesterday. I'm seriously thinking about migrating to Dropbox or something, it's taking too much effort, to find out which of the copies are latest, in large files especially.

vbspam commented 5 years ago

I still have the same issue. I tried server 13.x to 15.0.7 with desktop clients up to recent version 2.5.2git.

Yahku commented 5 years ago

Same problem here, i get it on windows 10 with .pptx and .docx files, also sure that i am the only one editing the files.

walec51 commented 5 years ago

I regret jumping from owncloud to nextcloud... every upgrade since then is horrible and now we have a 2.5 client which is unusable for half a year now

Ezwen commented 5 years ago

I believe I have the same problem: one of my user keeps having conflicts on the file he is working on, for no reason as he is the only owner of the file and the only one editing it. More precisely, his text editing software keeps telling him something like "the file has changed on the disk, do you want to reload it?", because nextcloud keeps undoing his changes. This is a really big problem, he cannot work anymore.

colttt commented 5 years ago

We've a similar issue here. On one client it was edited and on the other client we got a conflct

fhennig commented 5 years ago

I have the same issues, even with the 2.6 client on linux. I have only a single client in use, and I keep getting conflicts. Please let me know how I can help to get this fixed!

bambita commented 5 years ago

I have the same problem too. Windows client 2.6. Every time I am editing MS Office or Libreoffice document and do "Save as" previous version gets conflicted copy. Sever is v 17 on docker. Any help idea? Thanks.

thoro commented 5 years ago

Seems I also run into this issue:

Nextcloud Server 16.0.5 Groupfolders Plugin 4.0.5 (higher version has a serious bug) Client 2.6.0

User is the only one editing a file, it's a xlsx file, instantly there's a conflict, no one else touched the file.

kermit-frog commented 5 years ago

Same problem here. I work exclusively on the files alone. For docx files I regularly get conflicted copies.

Nextcloud Desktop Client Version 2.6.0stable-Win64 (build 20190927) on Windows 10

RedKage commented 4 years ago

Potentially related

Germano0 commented 4 years ago

nextcloud client package maintainer on Fedora/EPEL here. I am getting a lot of conflicts on files contained in directories that I have not touched for years Can we better investigate @rullzer @misch7 ? As far I know there are no a debugging infos about why a file conflicts, and how this can happen

Example of conflict

-rw-r--r--.  1 user user   36423 27 feb  2019 'ARTICOLI ABC_conflict-20140924-171344'
-rw-r--r--.  1 user user   40622 27 feb  2019 'ARTICOLI ABC'

RedKage commented 4 years ago

I'm gonna give my personal feedback as I'm suffering from this since years. Since owncloud 9 or something.

I have the PortableApp launcher installed on my nextcloud folder. I have 2 nextcloud clients. One at work, and the other at home. Clients are both running on Win 10 machines, the server is on an Gentoo box

Both client are not live at necessarily the same time. My work client is almost alway running, but I turn on my home machine when I arrive home the evening. So only during the evenings are both clients up and running.

For instance, I regularly have the following conflicts:

When I update a PortabeApps app, it creates conflicts with the App/AppInfo/pac_installer_log.ini of the updated app folder
When I use PuTTYPortable, very often the PUTTY.RND files gets conflicted
More rarely, files I haven't touched ever which randomly pop, like people report in this thread here

Screenshot_1

Anyway there's never been an edit of these files on both clients at the same time: as I stated above, I turn on my home machine after my work client has done the updates, so the update path is very clear, it should go from work -> home, and the file timestamp are definitely not ambiguous. Both machines share the same timezone.

Also, one last thing: the file with the 'conflict' in its name is always a previous version or something older. I now usually search+delete all the 'conflicted copy' files to get rid of the conflicts warnings.

Larsene commented 4 years ago

I've the same problem, synchronizing a developpement folder with Wing / Wingware. And this is really, really annoying !

bjoern-tantau commented 4 years ago

I have the problem when working on a Godot project in a synchronized folder. Unfortunately Godot will just silently accept external changes. So a fixed bug will suddenly reappear without much warning.

When it happens the timestamp of the downloaded file from the server is older than of the conflict file.

Larsene commented 4 years ago

When it happens the timestamp of the downloaded file from the server is older than of the conflict file.

The same problem here. Nextcloud Desktop is finally dangerous to use ! This is incredible, how can the client replacing local more recent file with older network file ?

bambita commented 4 years ago

Is there any response from Nextcloud team? Thanks.

bnoagt commented 4 years ago

It's happening the same here, today my client is downloading 40GB of "conflicted files" he never touched for years.

misch7 commented 4 years ago

Hey all,

I'd like to reproduce the issue but it's quite hard to reproduce it. Could anyone try to provide a reproducible pattern? For example and test file / some test server config hints?

And does this also occur with our 2.7 Beta 1? Just to be sure that we didn't miss a fix from master in our 2.6 branch: https://github.com/nextcloud/desktop/releases/tag/v2.7.0-beta1

Thanks!

jirislav commented 4 years ago

Hey all,

I'd like to reproduce the issue but it's quite hard to reproduce it. Could anyone try to provide a reproducible pattern? For example and test file / some test server config hints?

And does this also occur with our 2.7 Beta 1? Just to be sure that we didn't miss a fix from master in our 2.6 branch: https://github.com/nextcloud/desktop/releases/tag/v2.7.0-beta1

Thanks!

I've seen many people complaining while editing .xlsx document or similar Word/LibreOffice document.

Orm1server commented 4 years ago

New the the GitHub support but I have the same issue on the latest android app with a txt file I upload of sms and call logs everynight and one of my clients has the issue with Outlook pst and QuickBooks files. I don't know if that's all there is. I'm on 18.0.3 but the issue started some time around upgrading to nc18.0.1 or later

michaelstingl commented 4 years ago

same issue on the latest android app

@Orm1server this is the issue tracker of the desktop sync client. For Android issues, please check here: https://github.com/nextcloud/android/issues

Orm1server commented 4 years ago

Hello sorry if I wasn't clear, my issue is the Android client, my customers issue is 2.6.4 windows 10 client.

crone123 commented 4 years ago

Hello, We have the same problem with LibreOffice .odt files. On Ubuntu 19.10 with Client 2.5.3git (packaged by the distribution) and Nextcloud Server 18.0.4.

The client conflicts the opened libreoffice files, when we save the file, and sometimes even when we don't do anything.

It seems the conflicts are produced every 15min, problem with crontab job? It's a relatively recent bug, I don't know the reason. I switched from MySQL to Postgres some weeks ago, problem with this db?

westy commented 4 years ago

This happens ALL THE TIME with my keepass database, it's infuriating!

There is only one client running. That said, that should not matter anyway! This is THE job for Nextcloud. It's literally it's reason for being, and it cannot do it reliably.

Looking at this thread and how long it has been going on I am stunned. Going to look for other self-hosted alternatives, since this is simply amazing that it's gone on so long. If you cannot trust your cloud sync then all is lost.

RedKage commented 4 years ago

That's kinda funny as I also use keepass (windows version) along with databases on a nextcloud folder as well. I used to have conflicts on the kdbx files. But it's been a while and I don't have any anymore...

Though I have weird conflicts for other stuff, I don't have any for keepass anymore. Strange.

------ Original Message ------ From: "westy" notifications@github.com To: "nextcloud/desktop" desktop@noreply.github.com Cc: "TacticalFreak" RedKage@gmail.com; "Manual" manual@noreply.github.com Sent: 5/11/2020 5:57:27 PM Subject: Re: [nextcloud/desktop] Nextcloud desktop client conflict without a reason (#943)

This happens ALL THE TIME with my keepass database, it's infuriating!

There is only one client running. That said, that should not matter anyway! This is THE job for Nextcloud. It's literally it's reason for being, and it cannot do it reliably.

Looking at this thread and how long it has been going on I am stunned. Going to look for other self-hosted alternatives, since this is simply amazing that it's gone on so long. If you cannot trust your cloud sync then all is lost.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/nextcloud/desktop/issues/943#issuecomment-626792073, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC2RIIEWUUGHMDXGI3SQHJTRRAN6PANCNFSM4GKD6X6A.

westy commented 4 years ago

That's kinda funny as I also use keepass (windows version) along with databases on a nextcloud folder as well. I used to have conflicts on the kdbx files. But it's been a while and I don't have any anymore... Though I have weird conflicts for other stuff, I don't have any for keepass anymore. Strange. … ------ Original Message ------ From: "westy" notifications@github.com To: "nextcloud/desktop" desktop@noreply.github.com Cc: "TacticalFreak" RedKage@gmail.com; "Manual" manual@noreply.github.com Sent: 5/11/2020 5:57:27 PM Subject: Re: [nextcloud/desktop] Nextcloud desktop client conflict without a reason (#943) This happens ALL THE TIME with my keepass database, it's infuriating! There is only one client running. That said, that should not matter anyway! This is THE job for Nextcloud. It's literally it's reason for being, and it cannot do it reliably. Looking at this thread and how long it has been going on I am stunned. Going to look for other self-hosted alternatives, since this is simply amazing that it's gone on so long. If you cannot trust your cloud sync then all is lost. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#943 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC2RIIEWUUGHMDXGI3SQHJTRRAN6PANCNFSM4GKD6X6A.

Hmm, that's interesting. What client do you use? I'm using KeePassXC.

Just looking at the options, and I have unchecked 'Safely save database files (may be incompatible with Dropbox, etc.)'. Reading it again, does having it on or off make is possibly incompatible?! I'll try and find out.

Anyway, I notice another option to backup before saving, so will enable that to prevent me losing a new password again (that has happened twice today!).

Also looking at other sync options... syncthing looks interesting, but doesn't look like has any iPhone support as such.

RedKage commented 4 years ago

Indeed I'm using a different build, I'm on KeePass 2.44 right now. Was using 2.40 for a while before upgrading.

------ Original Message ------ From: "westy" notifications@github.com To: "nextcloud/desktop" desktop@noreply.github.com Cc: "TacticalFreak" RedKage@gmail.com; "Manual" manual@noreply.github.com Sent: 5/11/2020 6:13:48 PM Subject: Re: [nextcloud/desktop] Nextcloud desktop client conflict without a reason (#943)

That's kinda funny as I also use keepass (windows version) along with databases on a nextcloud folder as well. I used to have conflicts on the kdbx files. But it's been a while and I don't have any anymore... Though I have weird conflicts for other stuff, I don't have any for keepass anymore. Strange. … <#> ------ Original Message ------ From: "westy" notifications@github.com To: "nextcloud/desktop" desktop@noreply.github.com Cc: "TacticalFreak" RedKage@gmail.com; "Manual" manual@noreply.github.com Sent: 5/11/2020 5:57:27 PM Subject: Re: [nextcloud/desktop] Nextcloud desktop client conflict without a reason (#943 https://github.com/nextcloud/desktop/issues/943) This happens ALL THE TIME with my keepass database, it's infuriating! There is only one client running. That said, that should not matter anyway! This is THE job for Nextcloud. It's literally it's reason for being, and it cannot do it reliably. Looking at this thread and how long it has been going on I am stunned. Going to look for other self-hosted alternatives, since this is simply amazing that it's gone on so long. If you cannot trust your cloud sync then all is lost. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#943 (comment) https://github.com/nextcloud/desktop/issues/943#issuecomment-626792073>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC2RIIEWUUGHMDXGI3SQHJTRRAN6PANCNFSM4GKD6X6A.

Hmm, that's interesting. What client do you use? I'm using KeePassXC.

Just looking at the options, and I have unchecked 'Safely save database files (may be incompatible with Dropbox, etc.)'. Reading it again, does having it on or off make is possibly incompatible?! I'll try and find out.

Anyway, I notice another option to backup before saving, so will enable that to prevent me losing a new password again (that has happened twice today!).

Also looking at other sync options... syncthing looks interesting, but doesn't look like has any iPhone support as such.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/nextcloud/desktop/issues/943#issuecomment-626801536, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC2RIIBPZUY5KW4LZV2G2FTRRAP3ZANCNFSM4GKD6X6A.

crone123 commented 4 years ago

In my case, the problem was solved by deleting the local Nextcloud client database (.db in the Nextcloud folder) and make a re-synchronisation. Maybe in some case, the local database is corrupted, that produce conflicts.

westy commented 4 years ago

Well, that concerns me even more!!

HobbledGrubs commented 4 years ago

I am having exactly the same issue especially with Photo directories that are uploaded from iOS Nextcloud backup and downloaded to a desktop. The files are never touched on the desktop but i have hundreds of these errors. It seems to happen if the desktop client downloads at the same time as the iOS client is uploading new files.
Aside from all that we are running S3 style storage for Nextcloud.... which to have many issues under Nextcloud.

westy commented 4 years ago

I am only using Nextcloud for photo backup from my phone now, and not syncing it to anywhere. I have uninstalled all client software.

I'm using Syncthing for everything now, and even have a syncthing folder that exposes the Nextcloud photos folder. It works very well.

A little bit of hassle exposing via SFTP so can access my KeePass DB on the iPhone, but that's working seamlessly now too.

gustavohw commented 4 years ago

I'm also having this issue recurrently when using the auto-sync from Android.

For information purposes my DCIM folder is quite large, 50gb+ and has a lot of files.

Samsung S10e Android 9 Android Client: 3.11.1 NextCloud Server: 18.0.4

bnoagt commented 4 years ago

This needs to be addressed as soon as possible. Nextcloud is not reliable until they fix this.

Have some* clients who download files instead of upload, overwriting the local updated file.

FDVCZ commented 4 years ago

I'd like to reproduce the issue but it's quite hard to reproduce it. Could anyone try to provide a reproducible pattern? For example and test file / some test server config hints?

You can find reproducible pattern here: #1928: "Conflict: Server version downloaded, local copy renamed and not uploaded"

RazielleS commented 4 years ago

This happens quite often for one particular log file (Player.log, which is a plaintext file) for me. I am syncing a game save folder from Oxygen not Included to Nextcloud. This folder contains said file. I think it is getting overwritten on each launch of the game.

There is only one user account, and (as of now) only one PC to sync this folder. So it is basically impossible that this file got changed from another device, hence a conflict should also be impossible.

I am happy to help with any debug information or logs, if you can tell me how to get them.

Software: Nextcloud Server 19.0.0 Nextcloud Linux client 2.6.4git (commit b45f5f)

RedKage commented 4 years ago

Guys, I'm not sure if this will help. I pretty much can't see any conflicts now, it's been like this for a couple months I think. Not sure if that's a client update, or something I did.

Just in case, here is what I did a few months back:

I switched to FTTH at home, before this I was using xDSL
I removed all the conflicted files I could find
I shutdown the client on all my machines, and removed the .db files
I opened the client, and then I re-synced the right folders
I did this again on each machine, one after another

Now I don't seem to experience any conflicts anymore. I have a hunch that maybe, it was switching to FTTH which did the trick. I was something like 1 mbps upload and 20 download. Now I'm symmetric 300 mbps. I'm thinking file upload were slow, maybe this would create conflicts when on another machine there was an edit as well? I dunno.

westy commented 4 years ago

Glad it's working for you. I'd be very surprised if it was your fibre connection though, since I was seeing this all the time on a gigabit LAN with only one client up at a time.

I have no idea whether it's now better, since I'm only using Nextcloud for photos backup from my phone now. It's not robust enough to use as cloud storage for me.

crone123 commented 4 years ago

Guys, I'm not sure if this will help. I pretty much can't see any conflicts now, it's been like this for a couple months I think. Not sure if that's a client update, or something I did.

Just in case, here is what I did a few months back:
* I switched to FTTH at home, before this I was using xDSL

* I removed all the conflicted files I could find

* I shutdown the client on all my machines, and removed the .db files

* I opened the client, and then I re-synced the right folders

* I did this again on each machine, one after another
Now I don't seem to experience any conflicts anymore. I have a hunch that maybe, it was switching to FTTH which did the trick. I was something like 1 mbps upload and 20 download. Now I'm symmetric 300 mbps. I'm thinking file upload were slow, maybe this would create conflicts when on another machine there was an edit as well? I dunno.

With clients on gigabit fiber (download) and 400mbps (upload), and even in gigabit lan, I have the problem. I don't think the speed of the network affect anything.

I saw that removing the local client database fix the problem, so it's probably a database corruption. And maybe the corruption is caused by client disconnection, I experienced many problems like "the host was disconnected" or "the host was not found", but there is no problem with the host, only with the nextcloud client. Or maybe it's the consequence of the crash of the client when it quits (sometimes, I don't know why).

er-vin commented 4 years ago

This indeed sounds like the journal db containing some corrupted information if removing it puts the sync back on its feet. Finding out exactly when that happens with debug logs around the time of the events would go a long way hunting this one down.

Edit: Ideally using 2.6.5 or up, we did improvements to the logging facilities. Expect the debug logs to be more chatty though.

bnoagt commented 4 years ago

Definitely is not .db file here. Soon as conflicted files started to show up, I've tried to resolve conflicts and remove .db file - with a brand new .db file, conflicted files started to show up again - not in the same files, though. Conflicts seems to be completely random here. Even after a successful sync, just running sync again would bring conflicts.

crone123 commented 4 years ago

Did you close the client before removing the .db file?

bnoagt commented 4 years ago

I'm using nextcloud in a linux server without graphical interface. I made a script which runs once a day. So, nextcloudcmd wasn't running when I deleted .db file.

crone123 commented 4 years ago

Ok, so it seems that removing local database isn't the ultimate workaround for this problem...

er-vin commented 4 years ago

The need for debug logs using 2.6.5 still stands though to get this one to go forward.

iagopinal commented 4 years ago

I am having the same issue with unexpected conflicts. As the server and the local files have different modification dates I wrote a short python script to solve the conflicts in the local NextCloud folder by selecting the most recent version of the file: https://github.com/iagopinal/nextcloud_solve_conflicts

rickygm commented 4 years ago

I am having the same issue with unexpected conflicts. As the server and the local files have different modification dates I wrote a short python script to solve the conflicts in the local NextCloud folder by selecting the most recent version of the file: https://github.com/iagopinal/nextcloud_solve_conflicts

Hi , I have the same problem with the latest version of nextcloud 19, how do you use your script?

iagopinal commented 4 years ago

I am having the same issue with unexpected conflicts. As the server and the local files have different modification dates I wrote a short python script to solve the conflicts in the local NextCloud folder by selecting the most recent version of the file: https://github.com/iagopinal/nextcloud_solve_conflicts

Hi , I have the same problem with the latest version of nextcloud 19, how do you use your script?

It is a python script. You just execute it with python. It is written so the Nextcloud folder is in your home directory, you can modify this to fit your particular settings.