hashview / hashview-old

A web front-end for password cracking and analytics
http://www.hashview.io
GNU General Public License v3.0
619 stars 134 forks source link

Slow hashlist processing speeds #366

Open JormungandrYggdrasil opened 6 years ago

JormungandrYggdrasil commented 6 years ago

Upload speeds are slow. At about 500/second this makes me sad.

Big hashlists take days to upload at this speed. I recommend looking at this as other (distributed) hash managers handle this a lot faster on identical hardware.

i128 commented 6 years ago

What hashes are you uploading? How did you get that metric? We're open to options on how to tackle the issue.

On Nov 11, 2017 10:32 AM, "JormungandrYggdrasil" notifications@github.com wrote:

Upload speeds are slow. At about 500/second this makes me sad.

Big hashlists take days to upload at this speed. I recommend looking at this as other (distributed) hash managers handle this a lot faster.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/hashview/hashview/issues/366, or mute the thread https://github.com/notifications/unsubscribe-auth/ACTh68EaAAVfX1I4jIgAIyvmUNr532slks5s1cwXgaJpZM4Qai_A .

JormungandrYggdrasil commented 6 years ago

10M of the MySpace data breach to stress test performance.

i128 commented 6 years ago

Hm, running similar test i can confirm... really slow. I wonder if this would be improved by switching to different backend DB.