Child Item

Syncing 45,000k Files Indefinitely.

I have a business account, with just over 4TB of data being sync'd. I have several computers of various ages. All my computers are downloading the entire data set locally to each computer, since each computer is backing up the data to a local storage in each location. This workflow works on all my computers, except on one machine about 10 years old. The majority of the files do sync, but eventually, the sync just stays in some amount of files 15-45k files, and they simply will not sync.

I have tried pausing the sync until task manager shows no CPU resources. When I resume Dropbox, the sync just stays in that high number of files that don't sync.

Ironically, some files do sync, but the sync is no longer reliable.

Anyone have any idea how to fix this? Dropbox's official position is that I have too many files, and that they don't support local storage of too many files. Not sure what too many is, but I officially have too many per support comments over the past several months.

Any help is appreciated.

Find more posts tagged with

Desktop

Download

Insightful

Comments

Hi @mikeshick, thanks for posting here!

I'm in agreement with what Support already mentioned.

We're talking about a 10 year old device, that's been strained with the size of 4TB synced locally. It'd make sense that the app wouldn't handle that.

However, as a few small checks: can you let me know the app's syncing status, and version just to clarify if you're using our latest stable version?

Also, if you locate the Dropbox folder in your File Explorer, and then right click on it, and check Properties, how many files do you have there?

Keep me posted!

I guess i've got the same problem (syncing 13000 files indefinitely)...

I don't understand. When you say taxed, I have generally no more than 50% CPU use, 45% memory use, 2% Disk....not the greatest. But that doesn't seem to taxed.

Syncing 46,146 files 19.6 GB (2+days)

File count...I'll let you know in a few hours. I suspect over 2-4 Million.

Thanks,

Hi @mikeshick, thanks for letting me know.

Well, the performance of the Dropbox application starts to decline after reaching about 300,000 files.

If you have around 2-4 million locally, then it's expected that it's not going to work the way it's indented to.

Hi @eduard5, I hope you're doing well!

Would you be able to share some additional info with me, such as the device's OS, syncing status and when did you notice this behavior?

If you could also let me know how many files you have syncing locally inside your Dropbox folder, that'd be amazing.

I was wrong. I only have 979,278 files. I'm surprised. Anyhow, you mentioned degrades after 300,000. Too bad that isn't advertised along with Dropbox Business accounts where far more data storage is available. Nonetheless, every other one of my computers does fine with it. Zero issues as all with the exact same data set. You mentioned that my computer is taxed, yet it's resources consumed tell another story.

Can you be more specific or clarify what's already been commented?

Furthermore, I don't know if the community has a solution for this, so hoping for that as Dropbox support has already said what you said to me as stated earlier in my post. What would be especially helpful is to have a means or be given a solution that while being able to keep everything in Dropbox Cloud, that there is also a way for me to backup everything in the cloud to a local device...which is what you're saying is a limitation. I don't necessarily need everything on this problematic computer except so that I can back all my cloud data up to a NAS for security and access purposes. Unfortunately, my NAS can definitely not handle syncing all these files directly from Dropbox....which is why I've used my computer. Then, Dropbox just allows me to use with teams across the world, of course.

Thanks,

Hey @mikeshick, sorry to jump in here.

I understand that your other computers are not having this issue and we do appreciate your feedback, but if you remove some folders from your Dropbox folder using selective sync, enough to get your file count down to about 300K, does it help with the issue at all?

Unfortunately, that ignores my need to back up the data locally and not only leave data available in the cloud.

I understand where you're coming from, Mike, and I will make sure your comments are passed along to our team.

Just wanted you to check if removing folders through selective sync, does actually help or not.

I don't know. I wouldn't be able to back up my files locally if I tried.

Hi @mikeshick, while we're at it, would you mind also clarifying the version of the app you're using on your end?

Just want to make sure you're using a stable one, and not the beta version.

Also, could you try fixing your hardlinks and permissions as outlined here and let us know if syncing gets stuck at the exact same number of files again?

v185.4.6054

I have reset hardlinks and permissions many times to no avail.

Hey @mikeshick - sorry to jump in here, but could you let us know if the app is still stuck at the exact same number of files?

In that case, could you click on your account's picture in the app and click on the view sync issues button? Is anything showing there perhaps?

Also, I know you might have already given this a go, but have you tried adjusting your bandwidth settings to see if that makes a difference?

For some reason, today I have 97, 436 with 356GB to sync. Way more than the past several weeks.

Yes, this computer has persisted in this matter as well. I often have the following error. However, this my main folder....it does say read onlhy. but this is the same as all my computers.

I don't understand it. Any ideas?

Does changing this setting in the folder's properties make any difference, though, @mikeshick?

Unchecking read only has never worked. When I come back a little later, the folder will say read only again, just like all the other working computers. I don't understand read only setting with regard to the Dropbox app....but, no matter.

Interestingly, though, I did investigate advanced properties on the folder...to check that the owner of the folder and other user properties of the non-working machine matched the working machines. In doing so, I accidently gave full properties to authenticated users (I though I chose Administrators), and when I realized it, went back and took off full control. When I did that, my syncing went all the way down to 5,327 files and 20GB. And, it seems that new files from non-working machine or files from other machines are syncing much more in line with how the app usually works.

All of this is very confusing, and makes me wonder if there were some permission settings that simply needed to be cleaned up on the local drive.

At any rate, the problem is perfectly fixed yet, as I still have the remaining files that appear to not be syncing. I also was doing a massive amount of photo cleanup on the non-working machine, moving files and renaming folders for about 100GB. So, this morning, unsyncd files was around 100K with 200GB and all of that is syncd by early morning.

Hi @mikeshick, can you send me another screenshot of the app's current syncing status, please?

Please see attached

I will say, since I accidently messed with those file permissions, the files are syncing between any computer and the non-working computer very quickly...almost seamlessly as it should. Just curious why I cannot get rid of those last "5327 files" syncing.

Do you see the number decrease at all @mikeshick, or is it stuck like that for a while?

Thanks. I think I started out around 15K....which was like that for more than a week or so, maybe several weeks....then, with some modifying files/folders and then later DB folder property permissions, the number went all the way up to 97K....and then dropped to 5,327 this morning...and has not changed one bit. Since the DB folder permission modification, DB showed some majorly quick syncing.....and continues to syncing to/from that computer immediately.

All day since early this morning.

Can you try a restart as a last step @mikeshick?

If this doesn't work, let me know and I'll be happy to open a ticket on my end for you.

Restart what, please?

Hi @mikeshick, your device, if possible.

I can do it again. I don't think this has any bearing. 1 day later, still same exact number of files syncing as yesterday.

I restarted....same number of files. 5327 syncing. Weird.

Thanks for your help.

Hi @mikeshick, I just sent you an email, I'll see you there!

Thank you. got it.

Featured Links

Tags

Child Item