issues
search
elixir-crawly
/
crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
965
stars
113
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
`Could not start application crawly` when trying to enter IEx
#187
thiagomajesk
closed
1 year ago
2
[question] scrapping dynamic urls
#186
mario-mazo
closed
1 year ago
1
Generic `Pipeline crash` error
#185
thiagomajesk
closed
1 year ago
4
Observed crash of Genserver
#184
bapti
opened
3 years ago
1
Suggestion for nameing of closespider_timeout in config
#183
EdmondFrank
closed
1 year ago
2
Typespecs for crawly splash fetcher options are wrong
#182
Ziinc
closed
1 year ago
0
curl fetcher
#181
dkuku
closed
3 years ago
1
Pluggable fetchers improvement, closes #43
#180
oshosanya
closed
3 years ago
2
Advice wanted, usage with oban
#179
bapti
closed
3 years ago
6
Use keyword list for options
#178
spectator
closed
3 years ago
0
fix some test error & compile time warning
#177
feng19
closed
3 years ago
0
Provide more examples / detailed docs on custom request header override per spider
#176
DaniruKun
opened
3 years ago
3
Change elixir UUID name
#175
rootkc
closed
3 years ago
3
Improve documentation by linking from source docs to guides
#174
Ziinc
opened
3 years ago
1
Update readme with example of usage
#173
vermaxik
closed
3 years ago
0
Make :logger_file_backend an opt-in dependency
#172
oshosanya
closed
3 years ago
3
Merge pull request #1 from oltarasenko/master
#171
oshosanya
closed
3 years ago
0
File logging improvements
#170
oshosanya
closed
3 years ago
1
Fix typo in splash.ex
#168
mgibowski
closed
3 years ago
0
Improve on_spider_closed_callback
#167
oltarasenko
closed
3 years ago
1
Move TestSpider definition from manager_test module
#166
oltarasenko
closed
1 year ago
0
Start with parameters
#165
oltarasenko
closed
3 years ago
0
Add general purpose link extractor
#164
oltarasenko
closed
3 years ago
7
Improvements to file logging
#163
Ziinc
opened
3 years ago
1
[Draft] Add ui module retrival from config
#162
FrancescoZ
closed
3 years ago
5
Simplify manager init function
#161
oltarasenko
closed
3 years ago
2
any way to skip certificate validation?
#160
dkuku
closed
3 years ago
1
Remove CrawlyUI screenshots
#159
oltarasenko
closed
3 years ago
0
Update README.md
#158
oltarasenko
closed
3 years ago
0
Send logs module, from send_to_ui_backend
#157
oltarasenko
closed
3 years ago
0
Trying to make tests more stable
#156
oltarasenko
closed
3 years ago
1
Split logs
#155
oltarasenko
closed
3 years ago
6
Add meck
#154
oltarasenko
closed
3 years ago
0
How to wait for running spiders to finish?
#153
phortx
closed
3 years ago
10
Configurable SendToUI Pipeline
#152
FrancescoZ
closed
1 year ago
4
Bugfix for Manager timing out on high intial url/request count
#151
Ziinc
closed
3 years ago
1
Parse pipelines
#150
Ziinc
closed
3 years ago
9
Telemetry metrics support
#149
Ziinc
closed
1 year ago
2
Runtime spider creation
#148
Ziinc
closed
1 year ago
1
Question: Chat for crawly users
#147
oltarasenko
closed
3 years ago
1
Filter out requests when popping from request storage
#146
tanguilp
closed
1 year ago
2
Feature request: make request storage configurable and pluggable
#145
tanguilp
opened
3 years ago
1
Remove URL fragment before storing in `Crawly.Middlewares.UniqueRequest`
#144
tanguilp
closed
1 year ago
3
Use tiny hash in `Crawly.Middlewares.UniqueRequest`
#143
tanguilp
closed
1 year ago
3
Add visited URLs in `Crawly.Response.t`
#142
tanguilp
closed
1 year ago
4
Announcement: Now it's possible to create a spider in UI
#141
oltarasenko
closed
3 years ago
29
Switch travis to circleci
#140
oltarasenko
closed
3 years ago
0
Update gollum so we can use new HTTPoison
#139
oltarasenko
closed
3 years ago
0
[Help] Middlewares not being overridden on a Spider level
#138
jfmlima
closed
1 year ago
16
Formatted the code
#137
oltarasenko
closed
3 years ago
1
Previous
Next