Scraping memo

[bird0401]

• [x] use db to prevent from requesting to the urls that I have requested and stored its images
• [x] rewrite the part of related path absolute path
• [x] review the approach to get data using Beautiful soup
• [x] retry
• [x] 0 padding to image fies
• [x] split function
• [x] instance to entity
• [x] exception handling
• [x] store entity seeking results to DB
• [x] O(n) -> O(log n) by converting list to set searched every iteration

[bird0401]

Categories

• dog | Dog breeds by name
• actors | Actors by name
• car | Honda automobiles by model
• aircraft | Aircraft by popular name
• furniture | Furniture by type
• instruments | Orchestral instruments
• fruit | Fruit as food
• clothing | Clothing by name