Child Item

Help with python script uploading images to already created folders

DeeG2009

I am looking for some assistance with a script i am trying to get to work to transfer images from a windows server to a dropbox account. For the life of me i cannot get it to stop creating new folders. I am trying to get it to upload to existing folders using the destination folder that appears in the browser url string of the desired folder. Anyone willing to help me out on this ill be glad to share the script, i am very green to all of this so i am hoping it is just something silly i am overlooking. Thanks in advance.

Find more posts tagged with

Developers

Comments

Здравко

Hi @DeeG2009,

There is a similar question here. You can take some idea out from there. 😉

@DeeG2009 wrote:
... For the life of me i cannot get it to stop creating new folders. . ...

If the folder you are going to upload to is there, no other will be created. If such a folder is missing, it's gonna created automatic.

Hope this helps.

DeeG2009

The folder is there, just say its like this, /images/state/city, i will put that directory into my script, and run it. When running it will create a new folder called images with state/city inside of it instead of uploading to the existing.

DeeG2009

from PIL import Image, ImageDraw, ImageFont

import csv

import os

import dropbox

import piexif

# Read configuration from CSV

with open('C:/Program Files/Python310/Scripts/config.csv', 'r') as f:

reader = csv.DictReader(f)

config = next(reader)

# Dropbox access token

access_token = config['access_token']

# Connect to Dropbox

dbx = dropbox.Dropbox(access_token)

# Windows server folder path

windows_server_folder = config['windows_server_folder']

# Dropbox destination folder

destination_folder = config['destination_folder']

# Desired image size

size = tuple(map(int, config['size'].split('x')))

# Text to use as watermark

text = config['text']

# Font and size to use for the watermark text

font = ImageFont.truetype(config['font'], int(config['font_size']))

# List of images in the Windows server folder

images = [f for f in os.listdir(windows_server_folder) if f.endswith(".jpg")]

# Counter for naming images with the same name

counter = 1

# Loop through each image

for image in images:

try:

# Open the image

with Image.open(os.path.join(windows_server_folder, image)) as img:

# Resize the image

img = img.resize(size, resample=Image.LANCZOS)

# Create an ImageDraw object

draw = ImageDraw.Draw(img)

# Get the size of the image

image_width, image_height = img.size

# Get the size of the text

text_width, text_height = draw.textsize(text, font=font)

# Calculate x and y positions for the text

x = (image_width - text_width) / 2

y = (image_height - text_height) / 2

# Draw the text on the image

draw.text((x, y), text, font=font, fill=(255, 255, 255, 128))

# Name the image with SEO keywords

name = f"{config['name_prefix']}{counter}.jpg"

img.save(os.path.join(windows_server_folder, name), quality=75)

counter += 1

except Exception as e:

print(f"Error processing {image}: {e}")

continue

# Modify the EXIF data

try:

exif_dict = {

'GPSLatitudeRef': b'N',

'GPSLatitude': [(float(config['latitude']))],

'GPSLongitudeRef': b'W',

'GPSLongitude': [(float(config['longitude']))],

}

exif_bytes = piexif.dump(exif_dict)

piexif.insert(exif_bytes, os.path.join(windows_server_folder, name))

except Exception as e:

print(f"Error adding EXIF data to {name}: {e}")

continue

# Upload the image to Dropbox

try:

with open(os.path.join(windows_server_folder, name), "rb") as f:

dbx.files_upload(f.read(), os.path.join(destination_folder, name))

except Exception as e:

print(f"Error uploading {name} to Dropbox: {e}")

continue

# Remove the original image from the Windows server folder

try:

os.remove(os.path.join(windows_server_folder, image))

except Exception as e:

print(f"Error removing {image} from Windows server: {e}")

continue

print(f"{image} resized, watermarked, Geo Tagged, Keyword Embedded and uploaded successfully.")

This is what i am currently running, but like i said it always creates a new folder instead of uploading to the existing folder. maybe i am not getting the path to the folder in dropbox right?

Здравко

@DeeG2009 wrote:
...
# Upload the image to Dropbox
try:
with open(os.path.join(windows_server_folder, name), "rb") as f:
dbx.files_upload(f.read(), os.path.join(destination_folder, name))
except Exception as e:
print(f"Error uploading {name} to Dropbox: {e}")
continue

... maybe i am not getting the path to the folder in dropbox right?

@DeeG2009, How the path, you are passing as destination (second argument) to 'files_upload', looks like? 🤔 Don't suppose, check it! Does it match to the expected format?

Again, take a look on 'upload' function in referred thread above. 😉

Good luck.

Greg-DB

[Cross-linking for reference: https://stackoverflow.com/questions/75513737/assistance-with-python-script-uploading-images-to-already-created-folders ]

@DeeG2009 As Здравко said, a good way to start troubleshooting this would be to check the actual path value you're using, as that will determine where the file is uploaded. If you still need help, please share that value as well as the output of that files_upload call.

DeeG2009

/JD%20Byrd/CPGC/Akron/ - this is where i am sending the images.

this is the folder directory

This is the output from upload to dropbox.

Здравко

@DeeG2009 wrote:
...
This is the output from upload to dropbox.

@DeeG2009, Greg asked you for dump of the result from 'dbx.files_upload'. Post it.

@DeeG2009 wrote:
/JD%20Byrd/CPGC/Akron/ - this is where i am sending the images.
...

Are you sure? 🤔 How you got to it? Did you check/dump it?

Greg-DB

@DeeG2009 Thanks for the additional information. In this case, "JD Byrd" is the name of your member folder. API calls already default to operating inside your member folder (check out the Team Files Guide for more information), so you shouldn't include that component in the path you supply in API calls. That is, the path you specify for that example should start with "/CPGC/Akron".

(Also, for reference, the "%20" is how a space, i.e., " ", is encoded for URLs. You wouldn't include those URL encodings in the path values you supply to a Dropbox API method like files_upload.)

DeeG2009

Wooowww. i feel like such a idiot now haha, ive been messing with this for almost a week now, and thats all it was. "/CPGC/Akron/" is working just fine to the existing folder. (like i said, totally new to anything coding, self teaching and sponging off others knowledge" ; now a new concern, when script is stopped and started again, i get an error: Error uploading Gutter_Cleaning_Akron1.jpg to Dropbox: ApiError('d', UploadError('path', UploadWriteFailed(reason=WriteError('conflict', WriteConflictError('file', None)), upload_session_id='pid_upload_session:

I am assuming it is because when my script runs it will name the images, example: image1.jpg,image2.jpg, etc... and once stopped and started again it starts at 1 again and will not overwrite, Could a timestamp always keep the naming unique ?

My ultimate goal is to be able to have the script run down a list of lines in a csv instead of just one line, each line in the csv would be for different folders and corresponding data for each image to be uploaded to, but i cant figure out how to have the script run each line in the csv say 10 times, then move on to the next and so on...

Greg-DB

@DeeG2009 A 'path/conflict/file' error indicates that the upload failed because there is already a file at the specified path. If you did want it to overwrite an existing file at the specified path, you can set the write mode accordingly, like in the example that Здравко linked to earlier. Otherwise, yes, you would need to use a unique name. Exactly what filenames you use and the logic you use in your code is up to you.

Здравко

@DeeG2009 wrote:
..., ive been messing with this for almost a week now, and thats all it was. "/CPGC/Akron/" is working just fine to the existing folder. ...

As Greg correctly supposed and you skipped to say, you are running team account, not personal. Your initial path is correct and would work for personal account. By default upload path starts from your home folder; for personal account home folder and account root is the same thing, but for team account it's not (and that's where your issue comes from).

@DeeG2009 wrote:
...
I am assuming it is because when my script runs it will name the images, example: image1.jpg,image2.jpg, etc... and once stopped and started again it starts at 1 again and will not overwrite, Could a timestamp always keep the naming unique ?
...

If you want to overwrite, you have to specify it explicitly. Auto-rename should be specified if desirable too.

@DeeG2009 wrote:
...
My ultimate goal is to be able to have the script run down a list of lines in a csv instead of just one line, each line in the csv would be for different folders and corresponding data for each image to be uploaded to, but i cant figure out how to have the script run each line in the csv say 10 times, then move on to the next and so on...

As far as I can see, you want to append line(s) to a csv file. Unfortunately, Dropbox doesn't provide such a feature. You have to upload entire file. 🤷 That's it.

DeeG2009

"As far as I can see, you want to append line(s) to a csv file. Unfortunately, Dropbox doesn't provide such a feature. You have to upload entire file. 🤷 That's it."

so i cannot have 50 lines in the csv file to upload to 50 different folders 1 by one, or 10 by 10, etc...? that seems like it is up to the code not drop box. if it can upload to one dropbox folder, it should be able to read a list of destinations right?

Здравко

That what I said is you can't append to a file, nothing more. You can have whatever you want wherever you want. Just every next version should be uploaded anew.

DeeG2009

I apologize, i am just not understanding what it is you are trying to say. You have to act like you are talking to a child with me haha.

Greg-DB

@DeeG2009 Здравко was pointing out that the Dropbox API does not offer functionality for just appending additional data to an existing file on Dropbox. For example, if there's an existing files uploaded on Dropbox that is 5 bytes long, there isn't a way for your app to upload just an additional 1 byte to make the resulting file 6 bytes long. You would need to upload the whole 6 bytes.

It's not clear to me if you necessarily need such a feature but regardless you of course control the execution flow of the logic in your code. You can write logic to issue 1 or 10 or however many calls to the Dropbox API as/when you need, in whatever order.