webrecorder / warcio.js

JS Streaming WARC IO optimized for Browser and Node
MIT License
30 stars 6 forks source link

Standardize POST canonicalization query strings with pywb #68

Open tw4l opened 3 months ago

tw4l commented 3 months ago

Fixes #58

This PR modifies canonicalization of non-GET request bodies into query strings to be consistent across Webrecorder projects. It introduces a new test case that is also in pywb to help ensure parity.

This is part of a cross-repo effort to standardize how POST canonicalization works in Webrecorder tools, and document this in a Webrecorder specfiication.

Todo

Still needs testing against fuzzy matching to ensure that there aren't unintended side effects to the change.