WIP: Multithreaded with Fabric2

klahnakoski / SpotManager

Find cheapest spot instance prices, bid, use, and teardown when done

Mozilla Public License 2.0

17 stars 3 forks source link

WIP: Multithreaded with Fabric2 #22

Closed klahnakoski closed 5 years ago

klahnakoski commented 6 years ago

The new setup rate can now be seen:

The sample interval on the chart is every 5min, and the SpotManager is run every 10min. You can see the 30 processes setup when the SpotManager is run. The effective setup rate is 180/hour compared to the 30/hour of the single threaded version.

This 180/hour rate can be increased by increasing the "max_new_utility": 30, or increasing the interval the SpotManager is run.

klahnakoski commented 6 years ago

this is being used on the manager-etl branch