Melvillian / roam_2_notion

A personal script for converting all literal [[...]] text in my personal Notion to true @... backlinks
1 stars 1 forks source link

Can't get past certain pages #2

Open addtheegg opened 4 weeks ago

addtheegg commented 4 weeks ago

Thanks for making this script. I'm running into the issue where the program just stops after a while as noted here. But, when I re-run the script it starts in the same place – where the cursor_metadata file is – and stops a few pages later, in the same spot every time. I'm assuming it's related to the pagination you mentioned, but I can't get it to move on. Do I need to clear something to keep it running? Any ideas?

Melvillian commented 3 weeks ago

I suspect it's something going wrong with the API requests, but if you want to figure it out you'll need to debug it.

I just pushed this PR to main https://github.com/Melvillian/roam_2_notion/pull/3 so that if you set the DEBUG env var to some non-empty string it will log A BUNCH of HTTP request + header + json body info, and you can see what's happening.

I'm kinda surprised it's not bubbling an error up here and printing something for you. Maybe you're getting rate limited, even though I automatically throttle the request rate here to account for rate limiting... 🤷.

Let me know any useful info you find and I can help debug.