search

gildas-lormeau / SingleFile

Web Extension for saving a faithful copy of a complete web page in a single HTML file
GNU Affero General Public License v3.0
15.83k stars 1.02k forks source link

SingleFile Crash / Freeze on saving "Twitter.com" WebPage which has thousands of tweets, likes etc.. #1190

Open nataleeonajourney opened 1 year ago

nataleeonajourney commented 1 year ago

Dear Gildas Lormeau, Thank You for this amazing extension, can you please help here : 

            "    SingleFile Crash / Freeze on saving "Twitter.com" WebPage which has thousands of tweets, likes. "

After scrolling from top to bottom of one of twitter's public profile having 1000s+ tweets, i let all the contents fully load then when pressed "SAVE" after some time it either " Crashes or Freezes " Tried the same on different browsers like : ( Google Chrome, Firefox, Microsoft Edge, Opera ) but all leads to the same problem. Tried changing option settings of extension many many times including loading the extension directly from local file instead of browser store but the result is same. Can you please check the attached images below. Please help as i have no other hope left !

System Used: Mac OSX Catalina

crash 12 12 34 AM crash setting crash error

gildas-lormeau commented 1 year ago

I'll try to do some tests but this might be due to the fact that the page is too large and I cannot really fix this.

keli6 commented 1 year ago

This also happens in my use case (e.g. downloading all posts from https://www.zhihu.com/question/60199335 which contains more than 1000 images) but I found a temporary solution. I noticed that when the page uses more than 3.5 GB of JS heap, the plugin cannot open the Save As dialog. But if you disable this option, you have a 50% chance saving it. @nataleeonajourney @gildas-lormeau

nataleeonajourney commented 1 year ago

This also happens in my use case (e.g. downloading all posts from https://www.zhihu.com/question/60199335 which contains more than 1000 images) but I found a temporary solution. I noticed that when the page uses more than 3.5 GB of JS heap, the plugin cannot open the Save As dialog. But if you disable this option, you have a 50% chance saving it. @nataleeonajourney @gildas-lormeau

How to do that ? can you please walk me through the process ? thanks in advance

nataleeonajourney commented 1 year ago

i cannot find a solution to this problem while downloading very long big scrolled pages due to size limit. May be

please help guys

qingchunnh commented 5 months ago

I suggest you can use https://github.com/prinsss/twitter-web-exporter