search

nansencenter / django-geo-spaas-harvesting

Harvest data into a GeoSPaaS catalog
GNU General Public License v3.0
1 stars 1 forks source link

Add base API crawler class #60

Closed aperrin66 closed 3 years ago

aperrin66 commented 3 years ago

This is preparation to adding support for Creodias (#57). The code which is common to paginated API crawlers has been moved to a new HTTPPaginatedAPICrawler class.

aperrin66 commented 3 years ago

Can you explain what is the difference between the test file for this PR? You have removed two data test file and some modifications in the test

I moved common functionalities from the Copernicus crawler to the HTTPPaginatedAPICrawler base class, and I did the same in the tests: I moved the tests dealing with functionalities from the base class to a new TestCase. In so doing, some of the test data became useless, which is why the files were removed.