yandexmobile / appmetrica-logsapi-loader

A tool for automatic data loading from AppMetrica LogsAPI into (local) ClickHouse
https://hub.docker.com/r/yandex/appmetrica-logsapi-loader/
22 stars 11 forks source link

Loading data with appmetrica-logsapi-loader takes a lot of time. #7

Open MaryamJFard opened 3 years ago

MaryamJFard commented 3 years ago

I have used this code to load events data, unfortunately, it takes a long time to load events of one day, 7 hours! (7 hours with having updater._ensure_types commented). Also update feature is deactivated. what should I do to make it faster? Since AppMetrica queues the requests I can not run multiple instances of the code.