Finish the categories

[ArtemKech]

CHANGES:

Fixed: BBC & CNN spiders

• BBC - added categories to the spider. It fetches them all now.
• CNN - added categories to the spider. Fixed some of the fields that were not retrieving data. Time is in UTC format

Made spiders to fetch the categories that only exist in the db. I also merged some of the categories into big ones so that we would not end up having 100500+ different categories.

Added some new categories into db. Let me know if you are happy about these new categories.

Found a fix to get links from the a tags. Bug fixed

EXTRA:

Increased the value for the following fields as requested:

• name from 128 to 256
• author from 128 to 256
• publication_date from 24 to 32

---

Closed issues:

• ( #44 )
• ( #33 )
• ( #40 )
• ( #54 )

---

NOTE: Do we want to keep food category?

[aardhyn]

@ArtemKech, Cant get scrappy to work from polytech today. I'll have a look this evening.

What categories are you using currently, I dont see the categories changed in the database.

[ArtemKech]

@AardhynLavender. I made sure that the categories that are not in db not going to be scraped. Should work fine now