mohankreddy crawler4j issues

mohankreddy / crawler4j

Automatically exported from code.google.com/p/crawler4j

0 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Multithreading and protection against duplicates

#49 GoogleCodeExporter closed 9 years ago
1
Make cookie policy configurable

#48 GoogleCodeExporter opened 9 years ago
5
are there any plans to move to maven?

#47 GoogleCodeExporter closed 9 years ago
10
All the seeds are crawled before the in depth crawl starts

#46 GoogleCodeExporter closed 9 years ago
1
All the seeds are crawled before the in depth crawl starts

#45 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#44 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#43 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#42 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#41 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#40 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#39 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#38 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#37 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#36 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#35 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#34 GoogleCodeExporter closed 9 years ago
1
All the seeds get crawled or visited before any further depth is crawled

#33 GoogleCodeExporter closed 9 years ago
1
What is the maximum number of seeds that can be given?

#32 GoogleCodeExporter closed 9 years ago
1
'Depth' parameter doesn't work. Also can't "resume" crawling. Seems that sources don't match binary classes in version 2.6.1

#31 GoogleCodeExporter closed 9 years ago
4
How to get original links in html

#30 GoogleCodeExporter closed 9 years ago
5
how to incremental crawler a site?

#29 GoogleCodeExporter closed 9 years ago
2
download mp3 file as NON binary file

#28 GoogleCodeExporter closed 9 years ago
5
Processing of robots.txt causes java.lang.StringIndexOutOfBoundsException: String index out of range: -3

#27 GoogleCodeExporter closed 9 years ago
1
How to force crawler4j to stay within initial domain

#26 GoogleCodeExporter closed 9 years ago
7
Image func. broken in 2.2 - what was 2.1's bug?

#25 GoogleCodeExporter closed 9 years ago
2
Errornous link URL extraction if the HTML contains <base href="...">

#24 GoogleCodeExporter closed 9 years ago
1
Provide depth of crawling.

#23 GoogleCodeExporter closed 9 years ago
5
How to Stop crawler and then restarting web crawler with different seeds

#22 GoogleCodeExporter closed 9 years ago
12
Add JavaDocs

#21 GoogleCodeExporter closed 9 years ago
2
IdleConnectionMonitorThread is never end

#20 GoogleCodeExporter closed 9 years ago
1
Add build.xml

#19 GoogleCodeExporter closed 9 years ago
1
Crawler doesn't follow relative links correctly

#18 GoogleCodeExporter closed 9 years ago
1
Resume Crawl - Enhancement

#17 GoogleCodeExporter closed 9 years ago
5
Exception in thread "main" : com.sleepycat.je.EnvironmentLockedException

#16 GoogleCodeExporter closed 9 years ago
3
Exception While Crawling !!

#15 GoogleCodeExporter closed 9 years ago
5
efficiency suggestion

#14 GoogleCodeExporter closed 9 years ago
5
Silent stop of the crawler

#13 GoogleCodeExporter closed 9 years ago
1
Errornous link url extraction from a html

#12 GoogleCodeExporter closed 9 years ago
2
Graceful stop/abort - good to have

#11 GoogleCodeExporter closed 9 years ago
10
How to run the crawl process

#10 GoogleCodeExporter closed 9 years ago
1
NoHttpResponseException

#9 GoogleCodeExporter closed 9 years ago
1
How do we dynamically set the websites that the crawler should visit

#8 GoogleCodeExporter closed 9 years ago
1
Failure on Non-UTF-8 pages

#7 GoogleCodeExporter closed 9 years ago
11
crawl to infinity

#6 GoogleCodeExporter closed 9 years ago
2
Exception after replacing v1.7

#5 GoogleCodeExporter closed 9 years ago
1
Not an issue but something that would be nice to add

#4 GoogleCodeExporter closed 9 years ago
2
Notification of crawl finish

#3 GoogleCodeExporter closed 9 years ago
2
support for robots.txt

#2 GoogleCodeExporter closed 9 years ago
5
Retrieving time information about a request

#1 GoogleCodeExporter closed 9 years ago
2