When beginning to integrate siteinfo reloading into the etl_worker I discovered two things:
the log message from sites.go is confusing b/c it was reporting the total number of networks as sites.
the empty siteinfo URLs caused a segfault when trying to read them during loading.
This change adds site counting during load and updates the log message to report on site count and network counts.
This change also adds default values for the siteinfo URLs using the production URLs. This is almost always the value we want, and the site package unit tests override these values already.
When beginning to integrate siteinfo reloading into the
etl_worker
I discovered two things:This change adds site counting during load and updates the log message to report on site count and network counts. This change also adds default values for the siteinfo URLs using the production URLs. This is almost always the value we want, and the site package unit tests override these values already.
This change is