[Bug] Publications not loading

[BenShelton]

Packages & versions

Library Media 0.11

Describe the bug

Recent weeks do not load either the watchtower or oclm.

Reproduction steps

N/A

Expected behavior

N/A

Additional context

N/A

[BenShelton]

So they've changed the implementation yet again. It looks like the current steps are now needed in addition to the downloading of the catalog itself:

• Download the JSON from https://app.jw-cdn.org/catalogs/publications/v4/manifest.json
• Extract the current key which is some uuid
  • If uuid already exists in downloaded info then stop here
• Download the current delta JSON from https://app.jw-cdn.org/catalogs/publications/v4/{uuid}/signed-delta.info.json.gz, extract it
• Loop through the keys, the JSON is an object with keys like:

  "1941978": {
  "created": "2021-05-19T05:20:33+00:00",
  "nameFragment": "delta.1941978.jwl.zip",
  "signature": "76de376b5e4159066fb0771f102870a12498e37e8ee4db89d7d486674a278d76",
  "size": 23287
  },

• For each file, if it is downloaded then skip
• Download the delta from https://app.jw-cdn.org/catalogs/publications/v4/{uuid}/{nameFragment}, extract it
• Delta is a list of SQL commands, run each command sequentially on the media catalog

Hopefully that will result in all the necessary publications being available.