mosqueteiro / scalable_DS_envs

Building scalable data science environments using Docker and other tools
MIT License
0 stars 0 forks source link

Image download pipeline #2

Closed mosqueteiro closed 5 years ago

mosqueteiro commented 5 years ago
mosqueteiro commented 5 years ago

pycocotools demo

mosqueteiro commented 5 years ago

plotting image with bbox is written

mosqueteiro commented 5 years ago

load_sql function written, This was helpful which used psycopg2 execute_batch and SQL string composition.

anecdotally tested on categories table

need to run on full database

mosqueteiro commented 5 years ago

all but annotations are working.

after talking with Bob, usually constraints aren't added until the database is populated. He doesn't think this is the issue though...

mosqueteiro commented 5 years ago

re-writing functions into classes for easier use

mosqueteiro commented 5 years ago

Multidimensional arrays in PostgreSQL

mosqueteiro commented 5 years ago

saving images

import requests

img_data = requests.get(image_url).content
with open('image_name.jpg', 'wb') as handler:
    handler.write(img_data)
mosqueteiro commented 5 years ago

initial query method written

mosqueteiro commented 5 years ago

DONE! (?)