search

Doveps / mono

Code for Doveps projects
http://doveps.com
MIT License
0 stars 0 forks source link

Speed up flavor creation #39

Closed greenmoss closed 7 years ago

greenmoss commented 7 years ago

Objective: reduce flavor import to under one second

From the demo, it appears that flavor imports take quite a while. These are pretty small files, so we will need better performance. Look at python profiling tools to get you started.

Let me know if you have worked with profilers before. If not, figuring out how to profile can be a separate ticket.

JosiahRegencia commented 7 years ago

Just realized that what makes the flavor creation slow is the insertion of the data to the database. Not yet sure what to do but I'll find a way.

zerstoeren commented 7 years ago

I would be curious what could be causing this slowness. Hopefully it isn't disk i/o, but i'm curious if a MQ system might be beneficial if the problem is hardware over DB or code optimization.

On Thu, Oct 5, 2017 at 10:48 AM, Josiah Eleazar T. Regencia < notifications@github.com> wrote:

Just realized that what makes the flavor creation slow is the insertion of the data to the database. Not yet sure what to do but I'll find a way.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/Doveps/mono/issues/39#issuecomment-334540888, or mute the thread https://github.com/notifications/unsubscribe-auth/AGbogkey0y1cc_sT6fN3EpF9yc_jZ2mBks5spRZhgaJpZM4PLOV- .

JosiahRegencia commented 7 years ago

Currently finding a way to commit all data just once. It commits for every insertion making it super slow