Summary of changes
Added functionality for using automated LLM scraping and metadata processing
Motivation and context
Robustness, metadata parsing, (potential) deduplication, collection management
Checklist
[x] I have read and followed the CONTRIBUTING guide.
[x] I confirm that I have the authority necessary to make this contribution on behalf of its copyright owner and agree
to license it to the TeSS codebase under the
BSD license.
Summary of changes Added functionality for using automated LLM scraping and metadata processing
Motivation and context Robustness, metadata parsing, (potential) deduplication, collection management
Checklist