kimschreuders[CodePlex] I am loading about 76K data points each day into an ODM with about 112M data points as a scheduled task and it takes about 7 hours to run. From looking at the log file, it seems that the actual data loading only takes about an hour and the rest of the
time is spent updating the series catalog. When I run the spUpdateSeriesCatalog stored procedure, it takes less than 2 hours to completely rebuild the SeriesCatalog table. I also noticed that the log file shows that some of the series are being updated multiple
times. I have attached a copy of the log file. It seems that it should not take this long to update the series catalog and complete the data loading task. I am using version 1.1.2.2 of the ODM Streaming Data Loader.
kimschreuders[CodePlex]
I am loading about 76K data points each day into an ODM with about 112M data points as a scheduled task and it takes about 7 hours to run. From looking at the log file, it seems that the actual data loading only takes about an hour and the rest of the time is spent updating the series catalog. When I run the spUpdateSeriesCatalog stored procedure, it takes less than 2 hours to completely rebuild the SeriesCatalog table. I also noticed that the log file shows that some of the series are being updated multiple times. I have attached a copy of the log file. It seems that it should not take this long to update the series catalog and complete the data loading task. I am using version 1.1.2.2 of the ODM Streaming Data Loader.