search

KarinaBunyik / Twitter_hidden_topics

Finding those twitter topics that do not appear in another news media
3 stars 1 forks source link

Splitting limits hardcoded #37

Open KarinaBunyik opened 10 years ago

KarinaBunyik commented 10 years ago

Splitting limits for multithreaded version of the save_to_db.py function is splitting files based on a hard coded number. This number should be relative to the file size.

KarinaBunyik commented 10 years ago

Use modulo to split users

Neppord commented 10 years ago

I think you should look into using the map method of a process or thread pool.