Umlauts and special characters in URLs

dantleech / fink

PHP Link Checker

MIT License

204 stars 25 forks source link

Umlauts and special characters in URLs #127

Open nockenfell opened 11 months ago

nockenfell commented 11 months ago

If a page contains links with umlauts like ä ü ö or special characters like e.g. ß, this leads to misrecognitions because the URLs are not saved correctly.

Which charset is used for crawling? In the output via Json/Csv, umlauts are displayed incorrectly.

Example for crawling: ihr-anwalt-hamburg.de

dantleech commented 11 months ago

I haven't worked on this for years, feel free to investigate I'm happy to review any PR