Child Item

Having Trouble Moving Files Out of Dropbox With rclone

Hello community,

My team has ~115 TB of data stored in Dropbox. Last week, I abruptly received word that the unlimited storage option for the plan we've been using is being "sunsetted", effective Nov 27th. It feels like we are being evicted with ~1 month's notice. Not fun.

I have obtained a large NAS to replace the role Dropbox is currently playing for my team, but the issue is that we have a lot of subdirectories that are either very large, contain large numbers of files, or both.

Generally speaking, my rclone commands look like this:

rclone copy --progress --transfers=10 --copy-links ${REMOTE}:${DIR} ${LOCAL}/${DIR}

The program works for a while, but then I start getting errors like this:

2023-10-30 13:20:26 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.

Does anyone have suggestions on how to avoid these errors?

Patrick

Find more posts tagged with

API

Abuse

Comments

Здравко

Hi @pmjboyle,

Unfortunately, Dropbox doesn't allow unlimited transfer rate (or if allow it's for limited period only). That's why you're receiving such error. Instead of increasing parallelism, better limit explicitly to one download at a time. Would works much more stable in spite slower.

Hope this helps.

pmjboyle

So far, this is working out better:

rclone copy --progress --transfers=40 --copy-links --tpslimit 10 ${REMOTE}:${DIR} ${LOCAL}/${DIR}