search

lindylearn / aboutideasnow

Find people to talk to or collaborate with by searching across the /about, /ideas and /now pages of 1000s of personal websites.
https://aboutideasnow.com
MIT License
192 stars 6 forks source link

/about pages never linked to from website - is this intentional or a bug? #10

Open lordmatt opened 6 months ago

lordmatt commented 6 months ago

On the website, the .about pages link to the domain, not domain/about and results show text from the front page too.

Is this a bug or intended behaviour?

phgn0 commented 6 months ago

It's intentional. If a website doesn't have a /about page the scraper tries / instead. For example my own personal website is so simple that I put all about information on the home page, and I wanted to handle that.

Do you have an idea of how we can make this less confusing?