adobe / helix-cli

Command-line tools for developing with AEM
Apache License 2.0
51 stars 64 forks source link

hlx admin #1973

Open kptdobe opened 2 years ago

kptdobe commented 2 years ago

As part of the import process, there is the need to bulk preview / publish a lot of pages. Ideally we could do:

hlx admin --preview urls.xlsx // preview all urls from the URL column of the spreadsheet
hlx admin --preview --publish urls.xlsx // preview and publish all urls from the URL column of the spreadsheet
hlx admin --index 450 --preview --publish urls.xlsx // preview and publish all urls from the URL column of the spreadsheet starting at row 451 (row 1 = heading)

The cli would then deal with the concurrency (run 8 in parallel ?).

catalan-adobe commented 1 year ago

Hello, as a follow-up to a Slack thread about issues with https://thinktanked.org/tools/bulk/bulk.html (where too many API requests were done in parallel, causing 503s) I started working on some scripting for bulk preview/live operations and I ended up doing a node.js CLI: franklin-bulk.

Here is a demo:

https://user-images.githubusercontent.com/40354404/224563540-13ccd22a-02a8-47e5-b4fc-efb44f3a0edb.mp4

Would there be an interest to get this feature contributed as new commands of the helix-cli?

Remark:

tripodsan commented 1 year ago

Concurrency is implemented using Node.js native threads

wow...looks complicated for something that is anyways async ;-) you could use https://github.com/adobe/helix-shared/tree/main/packages/helix-shared-process-queue, which is a bit simpler to use ;-)

ghost commented 11 months ago

What is the meaning of all this I don't really get it

tripodsan commented 10 months ago

in the meantime we have the admin bulk api: https://www.aem.live/docs/admin.html#tag/preview/operation/bulkPreview

@catalan-adobe I suggest you improve your tool to use that api. it drastically reduces the load on sharepoint