Side Pane Tool category not organized || Need more subfolders

data-engineering-community / data-engineering-wiki

The best place to learn data engineering. Built and maintained by the data engineering community.

https://dataengineering.wiki

Creative Commons Zero v1.0 Universal

1.21k stars 120 forks source link

Side Pane Tool category not organized || Need more subfolders #53

Closed Ravikumar10593-hub closed 5 months ago

Ravikumar10593-hub commented 5 months ago

When you expand the Tools sections on the sidebar you get options for Data Ingestion ....... Workflow Orchestrators and after that, all the tools are floating outside without any category:

Can't we add some more folders like the AWS Cloud tool with subfolders like storage and put S3 inside that and the same case with all other tools?

Or to make it simple Put all AWS tools inside one AWS folder, all Azure-related stuff inside the Azure folder, and so on.

To recreate this issue:

Go to https://dataengineering.wiki/Index and expand the Tools sidebar

Click on this link

If possible you can assign me this task and I can help you guys to organize this.

JPHaus commented 5 months ago

We want to limit the number of nested folders as much as possible so I think folders by tool type instead of cloud/vendor would be better. With that in mind, what are some folders you think you would add?

Ravikumar10593-hub commented 5 months ago

Hey @JPHaus , Some of the categories I can think of on top of my mind is:

Folder name Data Acquisition: Items Inside this folder: Postman etc.. (we can add many more)
Folder name Data Processing: Items inside this folder: Apache Kafka (Not yet part of this documentation), Apache Spark, Hadoop MapReduce, etc..
Folder name Data Visualization & Analysis: Items inside this folder: Power BI, QlikView, QlikSense, Tableau, Looker
Folder name AWS Specific Tool: Items inside this folder: All the AWS-specific tools
Folder name Azure Specific Tool: Items inside this folder: All the Azure-specific tools
Folder name GCP Specific Tool: Items inside this folder: All the GCP-specific tools
Folder name General Purpose tool: Items inside this folder: Python, R, Java, SQL, etc

This is something that I can think of, please let me know if this makes sense or we can have some more brainstorming.

Open to suggestions😊.

Ravikumar10593-hub commented 5 months ago

Should I go ahead and do it , or how do you want to go about this. Please let me know

JPHaus commented 5 months ago

We have to add aliases to all of the files moved so they redirect if someone goes to the old url. I can get to it later today but if you want to take a shot at it go for it.

https://help.obsidian.md/Obsidian+Publish/Redirect+old+notes

JPHaus commented 5 months ago

I added some subfolders but haven't updated the links yet. I also did not make folders for the cloud provider notes because there are only 3 so I don't believe it needs a subfolder yet. Other things that aren't in subfolders yet are things related to metadata/metrics.

Ravikumar10593-hub commented 5 months ago

Oh cool, I see you have already created a PR for this, let me know if you need any help.

I am happy to help 😊