Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.
I am new to Norconex. I am writing a web crowler that commit the results in elasticsearch as link. but i am getting non utf-8 characters in the result. my text is in Persian.
ohtwadi
commented
9 months ago
Hi everybody.
I am new to Norconex. I am writing a web crowler that commit the results in elasticsearch as link. but i am getting non utf-8 characters in the result. my text is in Persian.