search

will-hart / blitz

An open source data acquisition system in Python
http://will-hart.github.io/blitz/
GNU Affero General Public License v3.0
0 stars 1 forks source link

[CORE] Large datasets are extremely slow to download #63

Open will-hart opened 10 years ago

will-hart commented 10 years ago

Downloading 768 extended messages each with 16 8 bit floats took several minutes. Parsing the messages seemed to take quite a while and each transmission is parsed before the next one is parsed .

Consider downloading all the messages at once then queuing messages for parsing on a background thread.