search

weppos / publicsuffix-ruby

Domain name parser for Ruby based on the Public Suffix List.
https://simonecarletti.com/code/publicsuffix
MIT License
619 stars 109 forks source link

Similar list than publicsuffix, but for path #184

Closed lwouis closed 3 years ago

lwouis commented 3 years ago

Hi,

We use this gem to discriminate regular subdomains (e.g. mail.google.com) from platforms providing subdomains for their user (e.g. my-great-blog.blogspot.com). This gem is great for that task.

Some large platforms don't use subdomains, but instead use the path to host contents from their users (e.g. instagram.com/deliveroo, facebook.com/deliveroo.uk, twitter.com/Deliveroo).

Another use-case for the path is URL shorteners (e.g. goo.gl, bit.ly). For these, I found this list, but it doesn't have serious backing like publicsuffix.

Are you aware of a list similar to what publicsuffix is providing, but for domains hosting user-content using the path instead of subdomains?

Thank you!

weppos commented 3 years ago

Hi @lwouis, I am sorry, but I am not aware of any project for path-based recognition. The scope of the PSL is based on the fact domains have a special name and treatment in browsers and clients, therefore the PSL has a use case. I can't foresee how it would be done the same for paths.