search

twisterarmy / twister-data-guard

Auto-following/reading bot written in Python 2 has a mission to safe all distributed data shared in the twister network.
MIT License
1 stars 0 forks source link

Performance optiomization #1

Open ghost opened 3 years ago

ghost commented 3 years ago

Obtaining a lot of the public keys requires an expensive server. I'm not familiar in Python language but the scripts should be improved by the partial/queue algorithms to parse the data fragmentally, step by step using the crontab schedule.

ghost commented 3 years ago

By this experiment, I've a conclusion, that is not possible to follow all the nodes, this task requires something like supercomputer to decode all the potential keys. That concept is not works in the distributed paradigm. Or work on the power machines as a temporarily solution.

People should follow the nodes by their choices. The data may be dumped only. But seeding all the DHT data in the node format - not easy without a power servers than usually needed for these data volumes.

ghost commented 3 years ago

Forgot to relate this commit af19e973beefafab31d742c93b5554cfcd4dda3e