MusicConnectionMachine / UnstructuredData

In this project we will be scanning unstructured online resources such as the common crawl data set
GNU General Public License v3.0
3 stars 1 forks source link

Increased the speed of populating the queue #211

Closed felixschorer closed 7 years ago

felixschorer commented 7 years ago

Sometimes we'll get a timeout error despite Azure already having pushed the path to the queue. This will result in a duplicate path in the queue. This is very rare though <<1%.