Partition Documentation hard to understand without an example

[MeltyBot]

Migrated from GitLab: https://gitlab.com/meltano/sdk/-/issues/275

Originally created by @vischous on 2021-11-18 21:14:30

---

https://sdk.meltano.com/en/latest/partitioning.html?highlight=partition#if-you-do-want-to-utilize-partitioning

I had a really hard time understanding how Partitions worked with state. Specifically :

1. Understanding that each partition has it's own state tied to it was confusing for me. I think an example would be very helpful.
2. I didn't understand what the list of dicts in the example actually did. I didn't realize that each item in the list was passed as a context to the record itself.
3. I got the "lightbulb" moment after making a list of 5 dicts and running a connector printing what the current context/partition state was

[MeltyBot]

View 2 previous comments from the original issue on GitLab

[stale[bot]]

This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.

[edgarrmondragon]

Still relevant

[stale[bot]]

This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.

[edgarrmondragon]

Still relevant

[edgarrmondragon]

There's https://sdk.meltano.com/en/latest/implementation/state.html#partitioned-state-example, so I'm actually happy to close this.