Markomrnkvc / Image_recommender_Big_Data

University project for 'Big Data'
1 stars 0 forks source link

Id marko #7

Closed Markomrnkvc closed 3 months ago

Markomrnkvc commented 3 months ago

changed structure of code:

added pickle file for saving data (embeddings, ID, colors, etc)

Improvements to the generator :

          -trakcing of files: s´generator starts loading images and getting data only for new images (ones that are not already loaded into the csv) --> improved this with latest commit too

          -imageIDs: 
                    - count starts at 0
                    - if generator gets interrupted: starting ID count at highest ID +1 (so no IDs will be unique)

         - images that are unable to be loaded will get skipped by generator