mohankreddy / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

can I delete the jdb files in folder frontier while the crawler is running? #64

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
The jdb files in frontier are too many, can I delete them when the crawler is 
running? Is there a problem with that? 

Original issue reported on code.google.com by jiansong.chao@gmail.com on 29 Jul 2011 at 6:00

GoogleCodeExporter commented 9 years ago
jdb files contain the list of the URLs that should be crawled and other needed 
stuff. They should not be deleted during the running of the crawler. But after 
that and if you don't need to resume the crawl, they can be deleted.

-Yasser

Original comment by ganjisaffar@gmail.com on 29 Jul 2011 at 6:06

GoogleCodeExporter commented 9 years ago
hi Yasser, 

I am using Eclipse n Jboss. The crawling process completes properly. Once this 
is over, i need to delete the frontier folder and its content. I tried to do 
this using code and manual delete (go to the location, select the folder and 
delete). But neither the code nor the manual delete process delete the frontier 
folder as long as the Jboss server is on.

I am able to do so, after stopping the server. Can you explain why this happens 
to me and how i can overcome it?

Original comment by divakar....@gmail.com on 10 Dec 2012 at 6:37