issues
search
elixir-crawly
/
crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
988
stars
116
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
remove circleci badge
#308
lbellomo
closed
2 months ago
0
Clean up tests from un needed log messages
#307
oltarasenko
closed
2 months ago
1
Simplify Crawly.fetch/2 function
#306
oltarasenko
closed
2 months ago
1
Fix very basic credo errors
#305
oltarasenko
closed
2 months ago
1
Fixed typo request_options.ex
#304
RicoTrevisan
closed
3 months ago
0
Update ex_doc
#303
oltarasenko
closed
3 months ago
1
Updating ex_doc to the latest version
#302
malinowskip
closed
3 months ago
1
failed to run quickstart: Could not classify module <xxxxxxx> as spider
#301
shuiRong
closed
4 months ago
1
Fix Crawly.Utils.list_spiders/0
#300
oltarasenko
closed
4 months ago
1
Fix Crawly interactive shell start for Elixir 1.17
#299
oltarasenko
closed
4 months ago
1
mix project crawly prevent `iex -S mix` to give me the interactive console
#298
xward
closed
3 months ago
8
Set base_url in init options instead of callback
#296
adonig
closed
6 months ago
1
Add normalise_url parameter to Crawly.Middlewares.UniqueRequest
#295
adonig
opened
6 months ago
4
Take the RobotsTxt User-Agent from the Request
#294
adonig
closed
6 months ago
2
Update HTTPoison to 2.2
#293
oltarasenko
closed
7 months ago
1
Automatically start HTTP api when crawly starts
#292
oltarasenko
closed
7 months ago
1
Use Crawly.Engine.list_know_spiders instead of Crowly.running_spiders…
#291
oltarasenko
closed
7 months ago
1
Pick the user agent from the request.
#290
adonig
closed
7 months ago
1
Use GH actions
#289
oltarasenko
closed
7 months ago
1
CI issue: Failed to upload the report to 'https://coveralls.io', Couldn't find a repository matching this job.
#288
OldhamMade
closed
7 months ago
1
[Fix] Resolve Protocol.UndefinedError by using fallback
#287
OldhamMade
closed
7 months ago
1
Update returned value to avoid VSCode ElixirLS warning
#284
arobie1992
closed
7 months ago
0
Crawly compilation warnings, undefined Floki functions
#283
dogweather
closed
11 months ago
1
Increase the error level of some messages
#282
dogweather
closed
11 months ago
1
Does Crawly support requests using the POST method?
#281
oallanmendes
closed
7 months ago
1
Fix javascript variable type
#280
cmnstmntmn
closed
1 year ago
0
Use Crawly.Engine.list_know_spiders instead of Crowly.running_spiders
#279
cmnstmntmn
closed
7 months ago
3
management Web UI on localhost:4001 is not working
#278
cmnstmntmn
closed
7 months ago
4
Logger.warn is deprecated
#277
ydlr
closed
11 months ago
5
Upgrade to `httpoison` 2.x?
#276
samrat
closed
7 months ago
3
Encountering Complications with Forwarding to Crawly.API.Router
#275
oallanmendes
closed
7 months ago
1
[error] Pipeline crash by call: Crawly.Middlewares.UniqueRequest.run
#274
PotentSoftware
opened
1 year ago
0
A new fetcher for Puppeteer based JS rendering
#272
oltarasenko
closed
7 months ago
1
Error: Could not load spiders.
#271
3even
closed
7 months ago
5
Change two logging calls to debug level
#268
dogweather
closed
1 year ago
0
Fix issue in the spider generator
#267
Rukomoynikov
closed
1 year ago
2
Fix spider_template.ex missing comma
#266
cmnstmntmn
closed
1 year ago
0
Make HTTP API togglable
#265
oltarasenko
closed
1 year ago
0
Q: Can the spider "fan out" on a website? (multiple next items)
#263
larshei
closed
1 year ago
1
Make the management tool opt-in by default
#262
aej
closed
7 months ago
5
Let Management Tool run in any place
#261
aej
closed
1 year ago
2
Update engine.ex
#260
maltekrupa
closed
1 year ago
0
Tutorial2
#258
oltarasenko
closed
1 year ago
0
Refactoring
#257
oltarasenko
closed
1 year ago
0
Improve UniqueRequest
#256
serpent213
closed
1 year ago
4
Running many instances of one spider
#255
serpent213
opened
1 year ago
3
robots.txt matching is pretty buggy
#254
serpent213
closed
7 months ago
10
Implement spiders preview
#253
oltarasenko
closed
1 year ago
0
Spider preview
#252
oltarasenko
closed
1 year ago
0
Refactor Jobs History
#251
oltarasenko
closed
1 year ago
0
Next