search

tomleibo / distributedSystems

0 stars 1 forks source link

How to handle 404s and more unexpected behaviour? #31

Closed hagai-lvi closed 8 years ago

hagai-lvi commented 8 years ago

for example that url https://twitter.com/Perspective_pic/status/711393371181486080 doesn't exist. What should happen when the worker is analysing it?

hagai-lvi commented 8 years ago

Suggested implementation is to add an error field to the Tweet class, and set it in case of an error.
Then the manager just skips this url