issues
search
elixir-crawly
/
crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
965
stars
113
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Clean up tests from un needed log messages
#307
oltarasenko
closed
1 week ago
1
Simplify Crawly.fetch/2 function
#306
oltarasenko
closed
1 week ago
1
Fix very basic credo errors
#305
oltarasenko
closed
1 week ago
1
Fixed typo request_options.ex
#304
RicoTrevisan
closed
3 weeks ago
0
Update ex_doc
#303
oltarasenko
closed
3 weeks ago
1
Updating ex_doc to the latest version
#302
malinowskip
closed
3 weeks ago
1
failed to run quickstart: Could not classify module <xxxxxxx> as spider
#301
shuiRong
closed
1 month ago
1
Fix Crawly.Utils.list_spiders/0
#300
oltarasenko
closed
2 months ago
1
Fix Crawly interactive shell start for Elixir 1.17
#299
oltarasenko
closed
2 months ago
1
mix project crawly prevent `iex -S mix` to give me the interactive console
#298
xward
closed
3 weeks ago
8
Set base_url in init options instead of callback
#296
adonig
closed
4 months ago
1
Add normalise_url parameter to Crawly.Middlewares.UniqueRequest
#295
adonig
opened
4 months ago
4
Take the RobotsTxt User-Agent from the Request
#294
adonig
closed
4 months ago
2
Update HTTPoison to 2.2
#293
oltarasenko
closed
5 months ago
1
Automatically start HTTP api when crawly starts
#292
oltarasenko
closed
5 months ago
1
Use Crawly.Engine.list_know_spiders instead of Crowly.running_spiders…
#291
oltarasenko
closed
5 months ago
1
Pick the user agent from the request.
#290
adonig
closed
5 months ago
1
Use GH actions
#289
oltarasenko
closed
5 months ago
1
CI issue: Failed to upload the report to 'https://coveralls.io', Couldn't find a repository matching this job.
#288
OldhamMade
closed
5 months ago
1
[Fix] Resolve Protocol.UndefinedError by using fallback
#287
OldhamMade
closed
4 months ago
1
Update returned value to avoid VSCode ElixirLS warning
#284
arobie1992
closed
5 months ago
0
Crawly compilation warnings, undefined Floki functions
#283
dogweather
closed
8 months ago
1
Increase the error level of some messages
#282
dogweather
closed
9 months ago
1
Does Crawly support requests using the POST method?
#281
oallanmendes
closed
5 months ago
1
Fix javascript variable type
#280
cmnstmntmn
closed
9 months ago
0
Use Crawly.Engine.list_know_spiders instead of Crowly.running_spiders
#279
cmnstmntmn
closed
5 months ago
3
management Web UI on localhost:4001 is not working
#278
cmnstmntmn
closed
5 months ago
4
Logger.warn is deprecated
#277
ydlr
closed
8 months ago
5
Upgrade to `httpoison` 2.x?
#276
samrat
closed
5 months ago
3
Encountering Complications with Forwarding to Crawly.API.Router
#275
oallanmendes
closed
5 months ago
1
[error] Pipeline crash by call: Crawly.Middlewares.UniqueRequest.run
#274
PotentSoftware
opened
11 months ago
0
A new fetcher for Puppeteer based JS rendering
#272
oltarasenko
closed
5 months ago
1
Error: Could not load spiders.
#271
3even
closed
5 months ago
5
Change two logging calls to debug level
#268
dogweather
closed
1 year ago
0
Fix issue in the spider generator
#267
Rukomoynikov
closed
1 year ago
2
Fix spider_template.ex missing comma
#266
cmnstmntmn
closed
1 year ago
0
Make HTTP API togglable
#265
oltarasenko
closed
1 year ago
0
Q: Can the spider "fan out" on a website? (multiple next items)
#263
larshei
closed
1 year ago
1
Make the management tool opt-in by default
#262
aej
closed
5 months ago
5
Let Management Tool run in any place
#261
aej
closed
1 year ago
2
Update engine.ex
#260
maltekrupa
closed
1 year ago
0
Tutorial2
#258
oltarasenko
closed
1 year ago
0
Refactoring
#257
oltarasenko
closed
1 year ago
0
Improve UniqueRequest
#256
serpent213
closed
1 year ago
4
Running many instances of one spider
#255
serpent213
opened
1 year ago
3
robots.txt matching is pretty buggy
#254
serpent213
closed
5 months ago
10
Implement spiders preview
#253
oltarasenko
closed
1 year ago
0
Spider preview
#252
oltarasenko
closed
1 year ago
0
Refactor Jobs History
#251
oltarasenko
closed
1 year ago
0
Refactored Spiders storage in more general SimpleStorage for crawly
#250
oltarasenko
closed
1 year ago
0
Next