search

beakerbrowser / beaker

An experimental peer-to-peer Web browser
https://beakerbrowser.com/
MIT License
6.75k stars 548 forks source link

150 GB Hyperdrive fails to index properly #1581

Open tiotrom opened 4 years ago

tiotrom commented 4 years ago

I have tried Beaker since earlier versions and I was egger to try this new release. Super excited and thank you for this. However when I try to index 150GB of files Beaker loads and loads and at times I cannot see any hyperdrive in the library tab. After a while I can see them. But the folder is not indexed in its entirety. I restarted Beaker several times but the folder is still incomplete. I see no progress bar or anything to show me the indexing state. This was an issue before with Beaker.

We produce a lot of educational materials, from books to videos and more, so we want to be able to share all of our work via the DAT network- However we seem not to be able to.

Therefore, I think there's an issue with indexing a lot of files and the fact that there is no progress bar you are left in darkness not knowing how much it was indexed.

Cheers!

pfrazee commented 4 years ago

@tiotrom Thanks for filing! A couple questions to help me figure out what all we need to fix:

  1. How did you import all the files? (Which tool)
  2. Could you share what the file structure of the drive looks like?
  3. About the incomplete folder: do you have any evidence that maybe the import didn't finish? (The lack of feedback about import-progress might have led the import to not complete, maybe?)
tiotrom commented 4 years ago
  1. I simply clicked new Hyperdrive and chose "from folder".
  2. It looks like this hyper://dff8efbc5b4357a5ec594d99c53ace6fbdd1ce43a7a8e08e474c39c9630d70d7/ and it is missing a lot of files. I kept Beaker open for the past days and it sill fails to index all of teh files
  3. It could be I waited 30 minutes or more and then I shut down Beaker and reopened it again since I could not even access my Library in Beaker. It was blank.

I liked how the old beaker browser at least showed how many files are synced or not. This version seems to give you no info in regards to the progress.

pfrazee commented 4 years ago

Okay thanks for the answers. We definitely need to give better feedback on progress.

tiotrom commented 4 years ago

Please do so! When sharing such big folders you are left in the dark when it comes with the progress. But I am wondering if I would let it go index in the background now, without any progress visualization, will it index it all? Or is this a deeper issue?

pfrazee commented 4 years ago

There may be a deeper issue as well. We're looking into it.