Change method of sending/improve sending time - Githubissues

GoelBiju / Visualising-Optimisation-Data

COMP3000 Final Year Project - Visualising Optimisation Data

0 stars 0 forks source link

Change method of sending/improve sending time #24

Open GoelBiju opened 3 years ago

GoelBiju commented 3 years ago

Description:

The server running out of memory was due to the concurrent writes to the MongoDB and the saves would accumulate a lot of memory until the server runs out of heap memory to allocate.

We need to either change the way we send (currently in batches with the size according to the population size) or improve the time it takes to send all the data to the server.

Acceptance criteria:

[ ] Improve the time it takes to send the data
[x] The server does not run out of memory or crash due to writing to the database.

GoelBiju commented 3 years ago

I have changed to using MongooseMap in #36 to allow for data to be easily indexed and not stored as a huge array.