search

fat-whale / tectonicdb

High Performance Datastore for Order Book data
Other
2 stars 1 forks source link

Bulk create database command #17

Open Ameobea opened 6 years ago

0b01 commented 6 years ago

Is this really necessary?

Ameobea commented 6 years ago

It takes a good 15 seconds to create all of the databases for a new exchange aggregator we're adding even when running on a local connection, so I figured it would be a nice item for the wish list. Necessary, no.

0b01 commented 6 years ago

How many exchanges? Is this for coinapi?

On Tue, Apr 24, 2018, 11:31 PM Casey Primozic notifications@github.com wrote:

It takes a good 15 seconds to create all of the databases for a new exchange aggregator we're adding even when running on a local connection, so I figured it would be a nice item for the wish list. Necessary, no.

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/fat-whale/tectonicdb/issues/17#issuecomment-384150324, or mute the thread https://github.com/notifications/unsubscribe-auth/ABr8UE6MhtSs_ChPgFkpNSxTO9n3kDBXks5tr-4cgaJpZM4Titpn .

Ameobea commented 6 years ago

Yeah, CoinAPI. They're listing 14711 individual symbols.

0b01 commented 6 years ago

And all the connections are live? That's actually very impressive.

On Tue, Apr 24, 2018, 11:45 PM Casey Primozic notifications@github.com wrote:

Yeah, CoinAPI. They're listing 14711 individual symbols.

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/fat-whale/tectonicdb/issues/17#issuecomment-384152044, or mute the thread https://github.com/notifications/unsubscribe-auth/ABr8UJX6msCvcjt0_QeH-XjfuONKxLNKks5tr_FGgaJpZM4Titpn .

Ameobea commented 6 years ago

Yeah, I was impressed. Their firehose feed was topping out at 7500 insertions/second and 9mbps of network traffic. Not sure if that's compressed or not.