Closed Eik-S closed 5 years ago
Resolves #103 Epic: #84
Don't merge before #102
priority_writer
writer
The code is deployed and running fine, i would recommend you to just have a look at the changes in the files:
queueManager.py
databaseWriter.py
twitterCrawler.py
Please keep in mind that prints are outdated and need to be changed to python3 logging soon, thats why i didn't put too much effort in changing them.
Resolves #103 Epic: #84
Don't merge before #102
Important changes
priority_writeris locking as long as there are users in its queuewriteris acquiring lock before and releasing it after each database request, for thepriority_writerto claim the lock.Review hints
The code is deployed and running fine, i would recommend you to just have a look at the changes in the files:
queueManager.pydatabaseWriter.pytwitterCrawler.pyPlease keep in mind that prints are outdated and need to be changed to python3 logging soon, thats why i didn't put too much effort in changing them.