google / corpuscrawler

Crawler for linguistic corpora
Other
190 stars 56 forks source link

Add Norwegian language #48

Open Orekhov opened 5 years ago

Orekhov commented 5 years ago

Norwegian language is currently not present. It would be great to have it added too.

mahalisyarifuddin commented 4 years ago

Just to make sure that Norwegian has two official versions, so I went ahead to make two crawlers.

I don't speak Norwegian, idk how to differentiate those versions, and idk any sites that utilize the language, so I just took the UDHR pages.

If there's anyone who speak the language, any help is welcome!