Update Migrator to latest API and fix multiple issues

james-world commented 1 month ago

This change updates the migrator to use the latest LD API version (20240415) making several changes:

The source command now handles any number of flags, not up to 20
The source command outputs an array of flag keys to flags.json
Json files output are indented for easier inspection
The source command outputs each flag individually to a flags subfolder and names them <flagkey>.json
The above has the side-effect of fixing retrieval of environment settings for flags, which no longer happens by default in the newer API version for the Get Flag List endpoint, and is limited to just 3 environments even when they are specified. By using the individual Get Flag API, all environment details are retrieved.
The rate limiting code has been fixed to respect the global and IP based rate limit headers, and it waits the appropriate amount of time.
The migrate command outputs more detail on progress
Several migrate steps were running concurrently causing potential race conditions, this has been changed to a fully sequential process
Fix a bug where clientSideAvailability and includeInSnippet weren't being migrated.

james-world commented 1 month ago

Thanks for the review @cgreenld - how do we get this merged? It would be good if we could point at this repo in my docs rather than maintain my fork.

cgreenld commented 1 month ago

@james-world totally agree - I had a recent role change internally, so working on getting my writer back

Else, let me see if I can get someone still on this team to merge it in

james-world commented 1 month ago

Thanks LD team.

launchdarkly-labs / project-migrator-script