Describe the bug
While using mode parallel the settings specified while switching on the celery workers is used to perform sync. This is not a desired behaviour since this might cause several errors.
Either use a common configuration file or stop scraping if the settings varibles beteen the two processes are not same.
To Reproduce
Steps to reproduce the behavior:
Start celery with default settings
ether_sql celery start -c2
Start the scraping with non default settings
ether_sql --settings=PersonalSettings scrape_block_range --end_block_number=100 --mode=parallel
The scraping will be performed using the default settings and not the setting specified during second command.
Expected behavior
We expect the same setting to be used for both celery and scraping
Describe the bug While using mode parallel the settings specified while switching on the celery workers is used to perform sync. This is not a desired behaviour since this might cause several errors.
Either use a common configuration file or stop scraping if the settings varibles beteen the two processes are not same.
To Reproduce Steps to reproduce the behavior: Start celery with default settings
ether_sql celery start -c2Start the scraping with non default settings
ether_sql --settings=PersonalSettings scrape_block_range --end_block_number=100 --mode=parallelThe scraping will be performed using the default settings and not the setting specified during second command.
Expected behavior We expect the same setting to be used for both celery and scraping