search

nanos / FediFetcher

FediFetcher is a tool for Mastodon that automatically fetches missing replies and posts from other fediverse instances, and adds them to your own Mastodon instance.
https://blog.thms.uk/fedifetcher?utm_source=github
MIT License
309 stars 232 forks source link

Can I make it do less? #41

Closed quicoto closed 1 year ago

quicoto commented 1 year ago

The GitHub actions take too long and they get cancelled over and over https://github.com/quicoto/mastodon-get-replies/actions

I've set HOME_TIMELINE_LENGTH to 10 but that doesn't help either.

Is there a config I can use to fetch less stuff? At the beginning it used to work just fine. Can I skip profile fetching? I'm mainly interested in threads

Thank you

nanos commented 1 year ago

Yes, there is. This almost certainly related to the option to fetch loads of profiles released with v4.1.9.

These can be disabled by setting the BACKFILL_MENTIONED_USERS to 0 ( See https://github.com/nanos/FediFetcher/releases/tag/v4.1.9 for more info).

However, this should be a temporary pain. Once it’s caught up (after around 24 hours or so, I imagine) it’ll be back at it’s normal speed - mine currently takes < 5 min per run, when fetching 200 posts from the timeline (and I’ve got most other options enabled, too, but > 90% of time is spent on the home timeline for me).

nanos commented 1 year ago

Alternatively you might want to try just disabling BACKFILL_WITH_CONTEXT which should speed up the process a lot as well.

quicoto commented 1 year ago

Thank you for the fast reply, @nanos !