issues
search
KadekM
/
scrawler
Scala web crawling and scraping using fs2 streams
MIT License
15
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Support state inbetween calls
#35
KadekM
opened
7 years ago
0
parallelCrawl emits visits/stream-results in one chunk
#34
visox
opened
7 years ago
0
extend JsoupBrowser settings for more advanced crawling
#33
visox
closed
7 years ago
1
Htmlunit
#32
KadekM
closed
8 years ago
0
basic readme
#31
KadekM
closed
8 years ago
0
use different site for checking ip
#30
KadekM
closed
8 years ago
1
upgrade sbt to 0.13.13
#29
KadekM
closed
8 years ago
1
async typeclass only when truly required
#28
KadekM
closed
8 years ago
1
Spurious proxy tests
#27
KadekM
opened
8 years ago
0
selection of browser during crawling
#26
KadekM
closed
8 years ago
0
gives ability to configure browser with more options
#25
KadekM
closed
8 years ago
0
scalafmt 0.4.8
#24
KadekM
closed
8 years ago
1
preparation for tests
#23
KadekM
closed
8 years ago
0
Handling errors during connection in browser
#22
KadekM
opened
8 years ago
1
Code coverage
#21
KadekM
opened
8 years ago
0
Telnet into running crawler
#20
KadekM
opened
8 years ago
0
Retrying
#19
KadekM
opened
8 years ago
0
Scaladocs
#18
KadekM
opened
8 years ago
0
Suggestion: add support for changing IP address
#17
visox
closed
8 years ago
1
Readme basic usage
#16
KadekM
opened
8 years ago
6
Tutorial / Docs
#15
KadekM
opened
8 years ago
0
XPath selectors
#14
KadekM
opened
8 years ago
0
Typed CSS selectors
#13
KadekM
opened
8 years ago
0
Unit tests
#12
KadekM
opened
8 years ago
0
Performance tests
#11
KadekM
opened
8 years ago
0
enable effectful streams in onDocument method
#10
KadekM
closed
8 years ago
1
Prepare for release
#9
KadekM
closed
8 years ago
0
Compiling for Scala 2.12-RC2
#8
KadekM
closed
8 years ago
0
crawling with both capabilities
#7
KadekM
closed
8 years ago
0
Install wartremover & ammonite
#6
KadekM
closed
8 years ago
0
Proxy settings applied per request
#5
KadekM
closed
8 years ago
0
Parallel crawler, scalafmt
#4
KadekM
closed
8 years ago
0
implement simpler crawling
#3
KadekM
closed
8 years ago
0
fix hardcoded max connections
#2
KadekM
closed
8 years ago
0
Crawler draft
#1
KadekM
closed
8 years ago
0