search

bgabor99 / News_crawler

0 stars 0 forks source link

Only save new articles from pipeline #9

Closed bgabor99 closed 1 year ago

bgabor99 commented 1 year ago

Now: Warning because of unique Article_ID So working well, just with warnings, but there is a possibility in scrapy just to save detected new articles //changes

bgabor99 commented 1 year ago

PR: #31