mintproject / MINT-Data-Sync

Scripts to download new datasets as it becomes available and register them in MINT Data Catalog
1 stars 1 forks source link

Complete the information about the Item #4

Open mosoriob opened 2 years ago

mosoriob commented 2 years ago

Scrapy defines an Item as python object that define key-value pairs.

For example, a product

class Product(scrapy.Item):
    name = scrapy.Field()
    price = scrapy.Field()
    stock = scrapy.Field()
    tags = scrapy.Field()
    last_updated = scrapy.Field(serializer=str)

I have defined a new item called: ResourceItem

class ResourceItem(scrapy.Item):
    url = scrapy.Field()
    #title = scrapy.Field()
    start_date = scrapy.Field()
    end_date = scrapy.Field()
    last_updated = scrapy.Field()

Your job is: