search

Vimlesh2414 / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 1 forks source link

Grab the TLD list from the online URL #293

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
That way it will always be updated.

Use the offline list as backup

Original issue reported on code.google.com by avrah...@gmail.com on 24 Aug 2014 at 6:01

GoogleCodeExporter commented 9 years ago 
https://publicsuffix.org/list/effective_tld_names.dat

Original comment by avrah...@gmail.com on 24 Aug 2014 at 6:01

GoogleCodeExporter commented 9 years ago 
Tries to get the list from online.

If not successful then goes to the compressed list in the resources folder

If fails it exits.

Fixed in revision: 41244315b65c

Original comment by avrah...@gmail.com on 24 Aug 2014 at 1:54