issues
search
surfedushare
/
harvester
ETL pipeline and search engine for Edusources and Publinova
MIT License
2
stars
0
forks
source link
Remove old harvester code
#232
Open
fako
opened
10 months ago
fako
commented
10 months ago
Code that can be removed:
[x] HarvestHttpResource class
[x] core/models/legacy/*
[x] core/models/search/index.py
[x] All core commands except clean_data and
[x] Remove compatibility with core for promote_dataset_version
[x] core/tasks/open_search.py
[x] core/views/legacy/*
[x] core/utils/harvest.py
[x] Sharekit app except SharekitMetadataHarvest (and test_models.py as well as test_product_webhook.py still have some valid tests)
[x] SeedExtractionTestCase class
[x] harvester/utils/extraction.py
[x] core/models/resources/* (except matomo.py)
[x] resources in files/models/resources/* no longer need abstract base classes to provide backward compatibility
[x] core/models/ims.py and core/models/choices.py
[x] EdurepJSONSearch in sources app
[x] remove HAN OAI-PMH, they will use Sharekit instead
[ ] django-json-field package
[x] prune core.constants
[x] remove core/fixtures/* where no longer needed
Other tasks:
[x] remove core and thumbnails/core from both S3 harvest content buckets
[x] delete HAN and Edurep JSON fixtures from sources
fako
commented
6 months ago
Waiting for Publinova release
fako
commented
3 months ago
Legacy webhooks: 2.300
Legacy commands: 11.500
Resources refactor: 4.600
Code that can be removed:
Other tasks: