search

WestonV / RJI-Image-Classifier

Machine Learning Image Classifier Designed to Help Journalists and Photographers
MIT License
2 stars 0 forks source link

FEATURE: Get a queue going for classifying the images #8

Open WestonV opened 5 years ago

WestonV commented 5 years ago

After we had fixed the issue of not getting the classifier to run we have run into another problem. Classifying the photos after uploading them overloads our server incredibly easily. In fact, we seemed to have tested it's limit when we could only classify 5 photos in one batch.

After we sought some help from Chase from RJI group 1, he told us that they are using a queue system. Furthermore, they are also separating the uploading and classifying of the photos. We currently rank the photos immediately after we upload them, and this may not be the best case scenario.

The queue system seems to be much more efficient, and something that we want to add to our system. They're using a php framework called Laravel, so that is something that we would need to look into.

antoniomv3 commented 5 years ago

We were unable to get a queue running due to complications with understanding PHP. We also ran into an issue with the web page being unable to upload more than 10 photos without crashing, even after changing all the configuration files we could find, so we decided a queue wouldn't be necessary after all. After increasing the size of our ec2 instance, the system could easily and quickly rank 10 photos at a time.