Currently the crawler seems to treat links as different if the query parameters are different. In some cases (e.g. utm_ trackers, Notions' pvs junk, and crap like that), the links should be cleaned up.
One way to address this would be to have an array of URL params in config.ts that should be removed in order to obtain the canonical URL for a page.
Currently the crawler seems to treat links as different if the query parameters are different. In some cases (e.g.
utm_
trackers, Notions' pvs junk, and crap like that), the links should be cleaned up.One way to address this would be to have an array of URL params in
config.ts
that should be removed in order to obtain the canonical URL for a page.