search

kickscondor / fraidycat

Follow blogs, wikis, YouTube channels, as well as accounts on Twitter, Instagram, etc. from a single page.
Other
1.76k stars 56 forks source link

data loss? #187

Open antoine3000 opened 4 years ago

antoine3000 commented 4 years ago

Before you start.

Desktop (please complete the following information):

Describe the bug Today is the second time I have no data, no feed in Fraidycat. Last time, I thought I had lost everything, but a day or two after my feeds came back. I have no idea what happened. Today, it happened again. Where is the data stored?

Thank you!

medicinecal commented 4 years ago

The vital data is stored in browser sync. Not all of the data, but your master follow list is. And follow histories and cached statuses are stored in local storage for the extension. The resetting of the data can happen for several reasons: disabling the extension, upgrading it, browser upgrade.

It's for this reason that Fraidycat 2 will no longer use the browser extension. This way we can move to a proper database. The Fraidycat 1 extension will continue to receive bugfixes however.

blipdrifter commented 4 years ago

"It's for this reason that Fraidycat 2 will no longer use the browser extension." Wait, if this is the case, then will there still be a way to easily add feeds to Fraidycat by easily clicking a button on the browser, like you can now?

medicinecal commented 4 years ago

Well, we'll be offering a small extension that integrates with Fraidycat 2 for stuff like that. But it will be very minimal by comparison.

HagaiHargil commented 4 years ago

Fraidycat 2 sounds exciting, but is there a way to resolve this data loss issue right now? I don't think I did any of the three actions you mentioned in the past two-three days, but my data is gone regardless.

Thanks.

medicinecal commented 4 years ago

@HagaiHargil Can you give me more to go on? Are you in the extension? Are you on the desktop? What OS?

If you are on the extension, your follows should still be present in the sync. Open and close your browser and it should repopulate.

If you are on the desktop, then I have not heard of this problem. I wonder if you are experiencing some data corruption or something. We'll have to look in your Fraidycat folder and see what's there.

HagaiHargil commented 4 years ago

Hi, all technical details are similar to the OP.

Indeed after closing all open Firefox instances and re-opening it my list of subscriptions came back. I haven't encountered this issue yet and it was quite stressful at first, that's why I jumped in here. Thanks for the quick reply!

medicinecal commented 4 years ago

@HagaiHargil I absolutely agree that this is a very big problem - and I'm very sorry that you've had to deal with this. Hopefully we can get through our remaining work on Fraidycat 2 - because the extension is not a great experience right now. Thanks for hanging in there with us, despite all the troubles!

antoine3000 commented 4 years ago

Thank you, I now have a better understanding of what's going on. And thanks again for Fraidycat <3

kiddailey commented 4 years ago

I'm running the desktop version of the app (not browser) on Windows 10.

Just a few days ago, it was fine. Today when I launched the app, everything was gone with no indication of any issue/error/otherwise :(

FWIW, the FraidyCat folder has a ton of stuff in it. There are a a bunch of json files in File Storage > Feeds but follows.json in File Storage is empty. Is there something in particular I should look for to see if I can retrieve the data?

Edit: The follows.json in File Storage > Sync appears to have my follows in it still. Haven't figured out if I can restore from that yet tho.

Edit: I should clarify that these are in AppData/Roaming.

Edit: I also now notice that I cannot add new items in the app to start over fresh. I get a "Couldn't connect - check your spelling, be sure this URL really exists." I am copy/pasting links for RSS feeds.

kiddailey commented 4 years ago

Discovered a resolution after noticing that I couldn't add new follows.

It dawned on me from working with other Electron apps that I have seen an issue where Electron processes fail to shut down when apps are quit. Sure enough, when I launched the task manager there were a handful of FraidyCat processes running even though I had quit the app.

I force quit these processes and restarted the app and all my feed are back and I am able to add new feeds again.

It appears (at least in my case), that something happened on app startup, the files became "locked," FraidyCat couldn't read them and therefore it looked as if everything went missing. Quitting and relaunching only made the issue worse until the processes were forcibly shut down.

Edit: I've noticed now a few times now after originally posting the above that there are always FraidyCat processes left running whenever I close the application.

tricky-labyrinth commented 4 years ago

@medicinecal Is there a way to export just all of the vital data in browser sync from the extension? When I do Settings -> Json -> Full Export in the middle of resetting the browser, it seems that I only get those sites that have been contacted since the browser was opened.

kickscondor commented 3 years ago

@tricky-labyrinth So, yeah, it looks like the three exports will only load follows that have been completely processed.

I think the JSON export should definitely change to work more like what you suggest.