issues
search
elixir-crawly
/
crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
944
stars
110
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Fix Crawly.Utils.list_spiders/0
#300
oltarasenko
closed
6 days ago
1
Fix Crawly interactive shell start for Elixir 1.17
#299
oltarasenko
closed
1 week ago
1
mix project crawly prevent `iex -S mix` to give me the interactive console
#298
xward
opened
3 weeks ago
8
Set base_url in init options instead of callback
#296
adonig
closed
2 months ago
1
Add normalise_url parameter to Crawly.Middlewares.UniqueRequest
#295
adonig
opened
2 months ago
4
Take the RobotsTxt User-Agent from the Request
#294
adonig
closed
2 months ago
2
Update HTTPoison to 2.2
#293
oltarasenko
closed
3 months ago
1
Automatically start HTTP api when crawly starts
#292
oltarasenko
closed
3 months ago
1
Use Crawly.Engine.list_know_spiders instead of Crowly.running_spiders…
#291
oltarasenko
closed
3 months ago
1
Pick the user agent from the request.
#290
adonig
closed
3 months ago
1
Use GH actions
#289
oltarasenko
closed
3 months ago
1
CI issue: Failed to upload the report to 'https://coveralls.io', Couldn't find a repository matching this job.
#288
OldhamMade
closed
3 months ago
1
[Fix] Resolve Protocol.UndefinedError by using fallback
#287
OldhamMade
closed
2 months ago
1
Update returned value to avoid VSCode ElixirLS warning
#284
arobie1992
closed
3 months ago
0
Crawly compilation warnings, undefined Floki functions
#283
dogweather
closed
6 months ago
1
Increase the error level of some messages
#282
dogweather
closed
7 months ago
1
Does Crawly support requests using the POST method?
#281
oallanmendes
closed
3 months ago
1
Fix javascript variable type
#280
cmnstmntmn
closed
7 months ago
0
Use Crawly.Engine.list_know_spiders instead of Crowly.running_spiders
#279
cmnstmntmn
closed
3 months ago
3
management Web UI on localhost:4001 is not working
#278
cmnstmntmn
closed
3 months ago
4
Logger.warn is deprecated
#277
ydlr
closed
6 months ago
5
Upgrade to `httpoison` 2.x?
#276
samrat
closed
3 months ago
3
Encountering Complications with Forwarding to Crawly.API.Router
#275
oallanmendes
closed
3 months ago
1
[error] Pipeline crash by call: Crawly.Middlewares.UniqueRequest.run
#274
PotentSoftware
opened
9 months ago
0
A new fetcher for Puppeteer based JS rendering
#272
oltarasenko
closed
3 months ago
1
Error: Could not load spiders.
#271
3even
closed
3 months ago
5
Change two logging calls to debug level
#268
dogweather
closed
11 months ago
0
Fix issue in the spider generator
#267
Rukomoynikov
closed
11 months ago
2
Fix spider_template.ex missing comma
#266
cmnstmntmn
closed
11 months ago
0
Make HTTP API togglable
#265
oltarasenko
closed
1 year ago
0
Q: Can the spider "fan out" on a website? (multiple next items)
#263
larshei
closed
1 year ago
1
Make the management tool opt-in by default
#262
aej
closed
3 months ago
5
Let Management Tool run in any place
#261
aej
closed
1 year ago
2
Update engine.ex
#260
maltekrupa
closed
1 year ago
0
Tutorial2
#258
oltarasenko
closed
1 year ago
0
Refactoring
#257
oltarasenko
closed
1 year ago
0
Improve UniqueRequest
#256
serpent213
closed
1 year ago
4
Running many instances of one spider
#255
serpent213
opened
1 year ago
3
robots.txt matching is pretty buggy
#254
serpent213
closed
3 months ago
10
Implement spiders preview
#253
oltarasenko
closed
1 year ago
0
Spider preview
#252
oltarasenko
closed
1 year ago
0
Refactor Jobs History
#251
oltarasenko
closed
1 year ago
0
Refactored Spiders storage in more general SimpleStorage for crawly
#250
oltarasenko
closed
1 year ago
0
Serpent213 before formatting
#249
oltarasenko
closed
1 year ago
2
Introduce SameDomainFilter
#248
serpent213
closed
1 year ago
3
Improve crawly management homepage
#247
oltarasenko
closed
1 year ago
0
`Crawly.Fetchers.Fetcher` implementation for Playwright
#246
Nezteb
closed
3 months ago
4
Dynamic spiders
#245
oltarasenko
closed
1 year ago
0
Standalone crawly
#244
oltarasenko
closed
1 year ago
0
Cleanup unused options from config samples
#242
oltarasenko
closed
1 year ago
0
Next