search

StractOrg / stract

web search done right
https://stract.com
GNU Affero General Public License v3.0
2.15k stars 49 forks source link

Domain age #177

Open RasheedAZ opened 8 months ago

RasheedAZ commented 8 months ago

Hi. Is there any possibility of having the ability to show the domain age or at least mark very new domain?

Thanks.

mikkeldenker commented 8 months ago

This is a very nice idea! We don't have that data in the index yet so it's not something we can easily add, but I agree it would be very useful and something we should definitely have.

RasheedAZ commented 8 months ago

Thanks for considering this.

I think with the ad driven websites we've already had, copycat scraped low quality websites increased dramatically since the Covid lockdowns I feel and now with AI generated websites by spammers and hackers, I don't know why things like domain plus website age verification is not built in to the browser or even available through plugins/addons...

In the meantime, if you learn any other solution please share with me.

Currently the only thing I know is NextDNS option to block newly registered domains, I think registered within the last 30 days or so.

aaferrari commented 5 months ago

I don't know why things like domain plus website age verification is not built in to the browser or even available through plugins/addons...

One way to determine that would be with a whois request, but it is not completely foolproof since the creation/registration date is reset when a domain expires and is acquired by someone else (or when the domain expires and the same owner renews it after a long time), besides that in some cases the information is not directly accessible (for example, if you try to do a whois to a Spain domain, it returns a message saying that you must check that through nic.es). The ideal would be to have access to the records history of a domain, but as far as I have seen it is usually something of payment.

Another option would be to check the oldest snapshot of a site with Wayback Machine like this: http://web.archive.org/web/1/example.com and see where it redirects to. Although some sites are blocked, plus it doesn't take into account if a legitimate site that existed a long time ago from ends up in the hands of a spammer.

RasheedAZ commented 5 months ago

It's not meant as a final decision on the safety of a domain, just some info (which I think web browsers should display by default) that will reduce the number of manual steps that the user has to take...