marmust / internet-scanner

see the internet as a physical network of web pages
281 stars 33 forks source link

A lot of ideas :-) #3

Open Benkex opened 11 months ago

Benkex commented 11 months ago

This awesome project really got my imagination going, because I've been thinking about something very similar for a while. I am particularly excited to take this idea to a level, where using it to find a webpage becomes faster than clicking through a website. So the practical use of the idea:) If you like this approach, great, maybe we could even work together on this!:) If not really, or you don't have enough energy & time for it, then please just read it as a ramble:) I don't think that I'd start implementing these on my own, but if you're in, I'm in.

Here's what I think would take the idea closer to practicality:

  1. [Search] It would be cool to be able to filter the nodes by a text entry:) It's as simple as filtering the HTML text of the node. The nodes not containing the text could stay there with a much lower opacity or even disappear? One could also navigate to the "next node/website", like when you search in text, and you can "jump to the next found word".
  2. [Title] One could see the title of the nodes, maybe the ones being close to you with a higher opacity, and all titles could remain relatively small to avoid madness.
  3. [Auto-Discovery] One could automatically let the algorithm discover N "layers" of websites, so that it's ensured, that all websites that are N clicks away, are included in the graph.
  4. [Webpage name] The webpage name could appear among / above the nodes, so that you can see, from which website the nodes are coming from. "Coloring by webpage" would also look nice:)
  5. [Keywords] If a keyword is frequent among some nodes, it could appear among / above the nodes, just like the Webpage name, so that it becomes intuitive, what the websites are about. E.g. the word "video" on YouTube pages etc.

I have also asked ChatGPT and it pointed out some great things:

  1. [User Annotations] Allow users to leave notes or comments on nodes, which could be saved for future reference.
  2. [History Tracking] A history feature to keep track of nodes visited, allowing users to navigate back to previously explored sites.
  3. [Bookmarking System] Users can bookmark nodes to create a personalized map of frequently accessed or important websites.

Special remark: [Colors & Style] This is just an opportunity space opener remark, but colors & shapes could be used in so many ways:) Using colors for search (word frequency), for history, for bookmarks... And the style of the connection could also be dotted, dashed, and the nodes could have different shapes depending on some criteria... One could set, by which criteria is the map being colored / "shaped"...

At the end, the goal would be to have a better overview and to find things faster...

Like I said, if you like any of this, let's take it to the next level!:) All the best!

marmust commented 11 months ago

read everything, pretty much what i was thinking, make it easier to navigate + make sense of the network. the search by keywords is a really neat idea! i will try implementing it. another cool thing that ill maybe add is colored nodes, so the root node gets some kind of color, then it gives all of its children a mutated version of that color, so every branch gets its own color theme or something

Inertia-Squared commented 11 months ago

Will look into helping implement this in my free time too! <3