issues
search
tasfe
/
crawler4j
Automatically exported from code.google.com/p/crawler4j
0
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Patch for /src/test/java/edu/uci/ics/crawler4j/examples/basic/BasicCrawler.java
#315
GoogleCodeExporter
closed
9 years ago
0
Crawl Site Maps
#314
GoogleCodeExporter
closed
9 years ago
1
Waiting 30sec before cleaning everything
#313
GoogleCodeExporter
opened
9 years ago
1
Crawler should follow links in plain text files
#312
GoogleCodeExporter
closed
9 years ago
1
Add functionality to retrieve links from binary and text only files
#311
GoogleCodeExporter
closed
9 years ago
1
How Can I download the entire html code for a page in .html file?
#310
GoogleCodeExporter
closed
9 years ago
2
Adding seeds to crawler4j at runtime
#309
GoogleCodeExporter
opened
9 years ago
0
Remove the Language Identifier
#308
GoogleCodeExporter
closed
9 years ago
1
Does it crawl every site only site? My crawler is not crwaling after 355 sites
#307
GoogleCodeExporter
closed
9 years ago
11
The method shouldVisit(Page, WebURL) of type BasicCrawler must override or implement a supertype method
#306
GoogleCodeExporter
closed
9 years ago
3
Count of crawl cycles
#305
GoogleCodeExporter
closed
9 years ago
6
Crawl Site Maps
#304
GoogleCodeExporter
closed
9 years ago
4
Create a log configuration file default
#303
GoogleCodeExporter
closed
9 years ago
2
Update deprecated methods/classes in PageFetcher
#302
GoogleCodeExporter
closed
9 years ago
2
Upgrade the Pattern constant on the crawler examples
#301
GoogleCodeExporter
closed
9 years ago
3
Resumable deletes all folder content not databases
#300
GoogleCodeExporter
closed
9 years ago
3
NullPointerException when trying to crawl different URLs
#299
GoogleCodeExporter
closed
9 years ago
1
Fatal Transport Error when crawling robots.txt
#298
GoogleCodeExporter
closed
9 years ago
2
Add tag name to WebUrl
#297
GoogleCodeExporter
closed
9 years ago
1
Threads not being killed in graceful shutdown
#296
GoogleCodeExporter
closed
9 years ago
13
Add meta tags into the parsed html object
#295
GoogleCodeExporter
closed
9 years ago
1
Save the TLD list as a compressed file
#294
GoogleCodeExporter
closed
9 years ago
1
Grab the TLD list from the online URL
#293
GoogleCodeExporter
closed
9 years ago
2
Optimize the TLD list
#292
GoogleCodeExporter
closed
9 years ago
1
HtmlParseData should hold a unique list of URLs
#291
GoogleCodeExporter
closed
9 years ago
2
We should support all redirect status codes
#290
GoogleCodeExporter
closed
9 years ago
1
Parsing a binary content shouldn't throw a general parsing error
#289
GoogleCodeExporter
closed
9 years ago
1
Upgrade Unit Tests to v4
#288
GoogleCodeExporter
closed
9 years ago
1
Webcrawler freeze when server is not available
#287
GoogleCodeExporter
closed
9 years ago
7
Disable Robots not working correclty?
#286
GoogleCodeExporter
opened
9 years ago
8
WebURL.java causes IndexOutOfBoundException
#285
GoogleCodeExporter
closed
9 years ago
3
Cathing any exception and hidding the log.
#284
GoogleCodeExporter
closed
9 years ago
7
Refresh Interval
#283
GoogleCodeExporter
closed
9 years ago
2
Add CHANGES.TXT with the changelog to the root
#282
GoogleCodeExporter
closed
9 years ago
1
Upgrade try-catch to java7 "try with resources"
#281
GoogleCodeExporter
closed
9 years ago
2
Use Tika's MediaTypes instead of self parsing strings
#280
GoogleCodeExporter
opened
9 years ago
1
TikaException is thrown while crawling several PDFs in a row
#279
GoogleCodeExporter
closed
9 years ago
1
Add hooks in the webcrawler for better error handling
#278
GoogleCodeExporter
closed
9 years ago
2
Update/Delete URLs, functionality
#277
GoogleCodeExporter
closed
9 years ago
3
Don't let a crawled URL to be dropped without proper logging
#276
GoogleCodeExporter
closed
9 years ago
1
Crawl Duplicate URLs
#275
GoogleCodeExporter
closed
9 years ago
8
[deleted issue]
#274
GoogleCodeExporter
closed
9 years ago
0
Tabbing looks messed up in several places
#273
GoogleCodeExporter
closed
9 years ago
2
Parse Binary Content
#272
GoogleCodeExporter
closed
9 years ago
0
Huge throughput improvement
#271
GoogleCodeExporter
opened
9 years ago
2
Crowler doesn't crawl some page.
#270
GoogleCodeExporter
closed
9 years ago
5
spacing removed after htmlParseData.getText();
#269
GoogleCodeExporter
opened
9 years ago
1
Fatal transport error when using a proxy
#268
GoogleCodeExporter
opened
9 years ago
1
Anchor Text still null
#267
GoogleCodeExporter
closed
9 years ago
2
How to calculate url pagerank
#266
GoogleCodeExporter
closed
9 years ago
2
Next