steveseguin / social_stream

Consolidate your live social messaging streams and much more
http://socialstream.ninja/
GNU General Public License v3.0
643 stars 94 forks source link

Social Stream Ninja Crashes while Exporting Chat #240

Open Novalion21 opened 5 months ago

Novalion21 commented 5 months ago

Hi, so last night I enabled the following options:

Save all messages to 📗 Excel file Save all names seen in chat to a simple file

in the "Global settings and tools" under "Export/Import"

After 12 hours of exporting the chat of a livestream (16,000 comments), it crashed the plugin. Is there a way to maybe split it up the exported files into smaller chunks at set intervals (e.g. every 2 hours) or comment numbers (every 5,000), so the plugin does not crash?

steveseguin commented 5 months ago

One immediate option might be to stop and then re-start the Excel export procedure every couple hours

I can't automate the change to a new file with a user specifying the file manually, but I could create a pop up warning the user to stop/restart the saving, but the user would still need to confirm the the new file.

In browsers it's normally possible to let a user specify a folder to save into, rather than single file, which would let me create new files automatically, but this functionality is bugged in Chrome/Chromium. It doesn't seem like the Chrome team are in a hurry to fix it, so I imagine it won't ever be fixed. See: https://issues.chromium.org/issues/40240444

There might be some other ways I could save the file, but it would make the experience worse overall I think.

I can at least perhaps just catch that the file size has hit 16,000 lines, and then stop saving, to avoid a crash entirely. Hrm. I'm not really sure what's best here.