Enhance validate_data() functionality to also check if there are records in final dataframe, which only differ in their serviceSummary field and hence can be combined. If yes we can throw an error and leave it upto the writer of the individual scraper to specify group_by_column list which will do the work in aggregate_service_summary(df) method of BaseScraper.py
Enhance validate_data() functionality to also check if there are records in final dataframe, which only differ in their serviceSummary field and hence can be combined. If yes we can throw an error and leave it upto the writer of the individual scraper to specify
group_by_columnlist which will do the work inaggregate_service_summary(df)method of BaseScraper.pyThis is requirement number 4 on issue number 58.