UI for indicating a big, sharded directories

[Helletons]

Describe the bug I am trying to upload 6666 files. There should be a link for every file once the upload has completed but only 256 are appearing every time. When I open the folder itself all 6666 png files are there. I have tried gradually uploading the files into the folder as well as uploading the folder all at once.

To Reproduce Steps to reproduce the behavior:

1. Go to Files

2. Click on Import > New Folder. Gradually drag png files into the folder.

3. Once finished, click on the three dots next to the folder and "Inspect"

4. See only 256 links instead of the thousands that should have generated.

5. Go to Files

6. Click on Import > Folder. Add chosen folder

7. Once finished, click on three dots next to the folder and "Inspect"

8. See only 256 links instead of the thousands that should have generated.

Expected behavior What I expect to happen is that when I import 6666 files (or however many thousand) that I see 6666 links in the Inspect screen

Desktop (please complete the following information):

• OS: Mac OS Big Sur 11.6.1
• Browser n/a
• Version IPFS Desktop 0.20.3

[welcome[bot]]

Thank you for submitting your first issue to this repository! A maintainer will be here shortly to triage and review. In the meantime, please double-check that you have provided all the necessary information to make this process easy! Any information that can help save additional round trips is useful! We currently aim to give initial feedback within two business days. If this does not happen, feel free to leave a comment. Please keep an eye on how this issue will be labeled, as labels give an overview of priorities, assignments and additional actions requested by the maintainers:

• "Priority" labels will show how urgent this is for the team.
• "Status" labels will show if this is ready to be worked on, blocked, or in progress.
• "Need" labels will indicate if additional input or analysis is required.

Finally, remember to use https://discuss.ipfs.io if you just need general support.

[lidel]

My guess is that the manifest of the directory you create gets bigger than the maximum block limit in IPFS, and that forces it to be automatically sharded.

The 256 children you see is only the first level of HAMT shard.

Can you confirm the directory you open in IPLD Explorer has hamt-sharded type as seen below?

normal dir	sharded dir

If so, this works as expected – Inspect view gives you an insight into real, low-level representation of a big directory. To see the actual files, you need to go two or more levels deep.

[SgtPooki]

@Helletons we'll leave this issue open just in case the community wants to add this support. If you're still blocked please reach out.

[Helletons]

Hi

Sorry for the slow response. Yes you were correct. It was sharded and actually all fine. The tutorial I had watched suggested it would show a long list of every file immediately instead of this sharded version. All fine

Thanks for getting back to me :)

April 11, 2022 8:59:09 PM CEST Marcin Rataj @.***> wrote:

My guess is that the manifest of the directory you create gets bigger than the maximum block limit in IPFS, and that forces it to be automatically sharded. The 256 children you see is only the first level of HAMT shard. Can you confirm the directory you open in IPLD Explorer has hamt-sharded type as seen below?normal dirsharded dir If so, this works as expected – Inspect view gives you an insight into real, low-level representation of a big directory. To see the actual files, you need to go two or more levels deep. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***> -- Sent with https://mailfence.com Secure and private email

[tinytb]

Last message from reporter indicates it's actually all fine. Closing.