search

thbar / kiba

Data processing & ETL framework for Ruby
https://www.kiba-etl.org
Other
1.75k stars 87 forks source link

Multithreaded #19

Closed bufordtaylor closed 8 years ago

bufordtaylor commented 9 years ago

Currently a kiba job takes hours. It would be nice to reduce that with threading.

thbar commented 9 years ago

Hello @bufordtaylor!

As announced on my blog here, multi-threading is planned in the upcoming Kiba Pro offering.

I could even go as far as to develop a multi-machines version at some point.

You can read more about Kiba Pro here, where I outlined the potential feature set and subscription.

Do you think your company could be interested?

I would love to hear your thoughts on this, either here of via email.

Thanks!

thbar commented 8 years ago

Closing this one in favor of #20 - I have an alpha quality multi-threaded runner, soon available via private gem hosting.