Open tokee opened 4 years ago
The extraction rules for links to resources in https://github.com/netarchivesuite/webarchive-discovery/blob/some/warc-indexer/src/main/java/uk/bl/wa/analyser/payload/TwitterAnalyser.java should be synchronized to the resource getter for harvests.
The resource URL extractor has been expanded with embedded videos. This does not fully close this issue.
The extraction rules for links to resources in https://github.com/netarchivesuite/webarchive-discovery/blob/some/warc-indexer/src/main/java/uk/bl/wa/analyser/payload/TwitterAnalyser.java should be synchronized to the resource getter for harvests.