prathercc / discrub-ext

Message manipulation and export tool for Discord. (Chrome Extension)
https://www.reddit.com/r/discrub/
91 stars 13 forks source link

Slow thread compressing #124

Open ReaLadge opened 1 month ago

ReaLadge commented 1 month ago

I've noticed recently when exporting a server it takes a while to compress all the threads which I've left my machine on for over 24 hours running it and it's still taking a while. I don't remember this happening previously on this specific server and I do this every 2 weeks, I usually . Just wondering if this is abnormal or not. I've tried turning off the 'Downloading Media' option off and it's still slow. The threads are not at all complex, there's only a a few lines of messages of each.

https://github.com/user-attachments/assets/dde5e44d-a1d6-48a5-8f98-87dc6ee92bb1

image

the-overdriven commented 1 month ago

It is slow, but not that slow. For me it was like 1 page per few seconds. Something must be off with the messages you're exporting.

Edit: you're talking about threads, not pages, so ignore :)

prathercc commented 1 month ago

This is due to the Foldering Threads export option being toggled, each thread is being stored in their own file. Creating new files takes a slightly longer time, I’m not sure that there is much to be done to improve that, but i can take a look and see still

ReaLadge commented 2 weeks ago

Testing again today and it seems to be much quicker so far.