Add duplicate filtering - Githubissues

danielacraciun / scrape-rec

Real estate data gathering and notification

4 stars 2 forks source link

Add duplicate filtering #7

Closed danielacraciun closed 5 years ago

dariuschira commented 5 years ago

Done, now checking fingerprint https://github.com/danielacraciun/scrape-rec/blob/df6b7446689ee48ef399f9de72fb530a27283c4f/scrape_rec/pipelines.py#L75