Child Item

Dropbox re-syncs 10,000+ files after every reboot

Dropbox re-syncs 10,000+ files after every reboot - files that I haven't touched, and it always looks to be the same directories affected, not the whole Dropbox.

This also seems to happen after I pause Dropbox for even 10 minutes, work on a handful of files (like literally 5 files), then un-pause - it needs to re-sync thousands of files.

Any suggestiongs as to how to fix/troubleshoot?

Find more posts tagged with

Desktop

Sync

Insightful

Closed - Partially Delivered

Accepted answers

Elixir

I am not sure what types of files you have, and how they are being modified, but I have seen posts where people had problems using Github and Dropbox together. In principle, if a file is not modified, it does not require to be re-indexed/re-uploaded by Dropbox. Note that even if you are not making any changes to those files, but some other program may be changing some meta information (like time/date stamp etc.) on those files. Are there symlinks present in your Dropbox directory? FYI, Dropbox does not support symlinks. Also, note that if you have more than 300,000 files, the performance of your Desktop app may degrade. I think it is better to move your working project directory out of Dropbox, and make manual backup (by copying, also you can reduce the file number by creating single zip of the whole folder having 40k+ files) in Dropbox if that is a viable option for you.

All comments

Elixir

Hi @andyyy, Is it possible that those files are being used/modified by another program (including antivirus programs)? If the files are not being modified, Dropbox won't sync them. Can you please check what are those files that are constantly or so often syncing? It sounds like you have put some application or system files/folder in your Dropbox folder, and whenever that application or system is running they are being modified.

andyyy

Hi Elixir,

Thanks for you reply. I would have thought that if the file had changed, it would say 'Uploading' in the Dropbox status bar - but it just says 'Syncing'. I also checked the Created, Modified, and Accessed attributes on a file that 'needed' re-syncing, and these had not changed after the reboot, so not sure why they would need to sync again?

The problem folders look to be where I store my projects - code, etc. The node_modules folder for each project can contain upwards of 40,000+ files. Does Dropbox need to re-sync / re-index all these files on a reboot? Even if they haven't changed?

Is there a way to tell Dropbox to permanently ignore certain folder names? (I realise this can manually be done using Selective Sync).

Elixir

andyyy

Hi Elixir,

I don't have any symlinks, and I have around 60,000 files all up. But I think you're right about the Git thing - it was only directories with .git folders there were re-syncing. I'm running Windows Subsystem for Linux, so I'm thinking after a reboot the Linux/Git side was maybe 'touching' these files causing them to re-sync. After deleting the .git folders, the re-syncing after reboot stopped.

So, atleast I know why it's happening now... Thanks for your help.

andyyy

Hi there,

It looks like the propblem is still happening - I just rebooted after having not changed any files, and Dropbox is stuck 'Syncing' thousands of files. I don't have any .git folders, and only one project/folder with node_modules - this node_modules folder is the only one 'Syncing'.

If I perform a Windows search on that folder and select only files modified 'today', no results are found. Can you tell me how Dropbox decides if the file has changed or not? Because Windows is saying that it hasn't changed.

I only have 111,091 files selectively synced to my PC (there are much more in my online Dropbox). The problematic folder has 29,940 files in 4990 folders - far less than the 300,000 file limit recommendation. Could the problem be that Dropbox is struggling to traverse the node_modules folder structure?

Jane

Hey @andyyy, apologies for the tardy reply. Are you still facing this issue?

andyyy

Hey Jane, yes, issues still apparent as described.

Jane

Thanks for your swift update here Andy (@andyyy) & I hope you have a wonderful October ahead! ☂️

As you & @Elixir have tried some troubleshooting on this thread, let me have a closer look on your setup through our Official channel. In order to investigate having all our tools available, I’ve made sure to reach out to you directly via email on my end.

Whenever you find some time, please check your inbox for my email & I’ll make sure to promptly get back in touch with you asap. Thanks for reaching out on our Community & I’ll be awaiting your next reply!

andyyy

To those that stumble upon this - I didn't realise I had symlinks in my node_modules folders, and it is most likely these causing the issues - as Elixir mentioned, symlinks aren't officially supported by Dropbox, and I can't do without the symlinks, so we are not troubleshooting any further.

Jeff G.14

I'm having this problem but I can't figure out why. Can you help me debug?

1-how do I figure out where the 18,000 files are that Dropbox is trying to sync?

2-is there a way to search for simlinks in my dropbox folder?

We use git but I didn't think I had any git work in my Dropbox folder...maybe it was shared with me...I need help to find it.

Jane

Hey Jeff (@Jeff G.14), let me follow-up in a bit more depth on this issue; thanks for the nudge!

For starters, can you confirm whether you’re facing this issue upon startup? Does the issue you’re experiencing match andyyy’s (meaning the OP's) description by any chance or is it different?

If you’re seeing that the application on your system tray is syncing a large number of files without your input Jeff, then your best course of action would be cross-checking your syncing icons :arrows_counterclockwise:/ :white_check_mark: (i.e. the files/ folders with the blue arrow should be the ones syncing to your account online), as maybe an accidental drag & drop is the culprit.

From there, if you suspect that the app has been stuck on one filename or it’s not syncing as it should, I’d suggest unlinking & relinking your account on your desktop & rebooting once, as it recreates the local database.

Following, please have a look at this resource to generate a list of any existing Symlinks in your Dropbox folder Jeff. Kindly bear in mind we’d recommend avoiding their usage, as we’ve noticed performance discrepancies.

Once you find the time to check back on how these pointers work for you, please let me know of the outcome on this discussion here & I’ll make sure to check back with you asap. Thanks & happy Friday!

Martha R.9

20200415. Macmini

I'm having this issue in 2020, I don't have other processes using the files, they are all OFFICE documents and JPGs, nothing else.

160,000 files and it says it will tke 27 hours. I have not been able to work all day (I'm on a laptop).

I can't figure out why it's happening.

Lusil

Hi there @Martha R.9, thanks for nudging us on this thread.

It might be worth checking this article out which suggests a few reasons and ways to tackle what you describe.

Let me know how it goes or if this helps, and I'll make sure to get back to you as soon as possible. Thanks!

Mandy Xie

Hi Macmini,

Did you fix the issue? I have the same issue as you described. I have tried all kinds of different things, however, nothing worked.