CDXIndexer.filterRecord should filter `metadata` records

webrecorder / warcio.js

JS Streaming WARC IO optimized for Browser and Node

MIT License

30 stars 6 forks source link

Closed matteocargnelutti closed 1 year ago

matteocargnelutti commented 1 year ago

As discussed w/ @ikreymer:

Edit to CDXIndexer.filterRecord() so it filters out WARC-Type: metadata and WARC-Type: resource when Content-Type: application/warc-fields.
This matches the behavior of cdxj-indexer and wabac.js
Added a test entry to example.warc