issues
search
unclecode
/
crawl4ai
🔥🕷️ Crawl4AI: Open-source LLM Friendly Web Crawler & Scrapper
Apache License 2.0
16.63k
stars
1.23k
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Bypassing automated crawler detection by Firewalls
#136
dnmahendra
opened
1 month ago
2
docs: fixed css_selector for example
#135
hitesh22rana
closed
1 month ago
1
Updated few code files which had few typos and errors in the code.
#134
vignesh1507
opened
1 month ago
0
This code file: crawl4ai/web_crawler.py needs minor changes
#133
vignesh1507
closed
1 month ago
2
Browser is not supported: Select playwright browser="firefox"
#132
dcolley
closed
1 month ago
2
Can we make it smart crawler along with sub web crawling ?
#131
Darshan2104
closed
1 month ago
6
Circular import error
#130
MSR2201
closed
1 month ago
2
Remove leading Y before here
#129
tuhinmallick
opened
1 month ago
0
spelling change in prompt and support to gpt-4o-mini
#128
Darshan2104
opened
1 month ago
0
Improve discoverability in chatGPT and other coding assistants
#126
codelion
opened
1 month ago
1
Fix crawling error in AsyncWebCrawler
#125
theguy000
opened
1 month ago
0
Please respect TDM Reservation Protocol
#124
llemeurfr
closed
1 month ago
1
Timeout setting
#123
openainext
opened
1 month ago
2
cannot import name 'WebCrawler' from 'crawl4ai'
#122
gulnihalk
opened
1 month ago
3
A docs page is broken
#121
vanetreg
closed
1 month ago
3
Screenshot must be taken after wait_for condition is met
#120
studio-anurag
opened
1 month ago
2
Add proxy functionality to AsyncWebCrawler and AsyncPlaywrightCrawler
#119
neelthepatel8
closed
1 month ago
8
Language Support
#118
oaishi
opened
1 month ago
2
crawler_strategy.set_hook() is not working
#117
studio-anurag
closed
1 month ago
2
Using Proxy
#116
shing-li
opened
1 month ago
5
[DOUBT] Performance expectations
#115
Sahil-Gulihar
opened
1 month ago
3
[DOUBT] Pagination Supported ?
#114
Greatz08
closed
1 month ago
2
Can you create an option so we can install on pinokio?
#113
xenstar
opened
1 month ago
1
Add Google Vertex AI (i.e. Gemini) in PROVIDER_MODELS of config.py
#112
huibrian
closed
1 month ago
2
Related to python Version
#111
y3rawat
closed
1 month ago
2
Example on whole-blog crawling?
#110
BradKML
closed
1 month ago
19
Created a new hook called "on_page_created" which allows the user to inspect raw HTTP requests/responses, and more
#109
ifaddict1
opened
1 month ago
1
Adding a parameter to disable SSL verification during crawling
#108
ifaddict1
opened
1 month ago
0
Please respect robots.txt
#107
Joshix-1
closed
1 month ago
6
No way to set crawl depth for crawler
#106
matijaparavac
closed
1 month ago
2
Crawling error
#105
BlackChila
closed
1 month ago
20
Has the CosineStrategy been deleted?
#104
1933211129
closed
1 month ago
1
I just wonder in doc where is AsyncWebCrawler
#103
NicoNicoNico123
closed
1 month ago
4
Crawl4ai Hard dependencites
#102
TomerLankri
closed
1 month ago
2
Gemini api
#101
VicThor-wpp
closed
2 months ago
1
typo in readme example
#100
jackmac92
closed
2 months ago
1
Extracting data from an iframe?
#99
ehubb20
closed
1 month ago
6
429 rate limit of 1 request per minute
#98
monkeybiz55
closed
1 month ago
3
How to scroll down in webpages using WebCrawler
#97
JaviMota
closed
2 months ago
1
Docker Issue: ModuleNotFoundError: No module named 'numpy'
#96
mjtechguy
opened
2 months ago
3
Feat: wait_for and documentation JavaScript Section
#95
jonymusky
closed
1 month ago
2
js load more not working
#94
anyangml
closed
2 months ago
4
Add support for non-ASCII characters in JSON output
#93
rangehow
closed
2 months ago
1
fix github description scrapper -> scraper
#92
dyigitpolat
closed
2 months ago
2
Restrict Certain HTML Tags (e.g., li, span) in Web Crawling
#91
roshan-sinha-dev
closed
2 months ago
7
why init server is too slow?
#90
lyh0825
closed
2 months ago
10
Hello, can we introduce Playwright as a dynamic crawler retriever to solve the problem of crawling API interface data
#89
adminChina
closed
2 months ago
7
There are 50 items on the page but the code shows only 30 items on nscrape! Using headless=False I can see that it's scrolling but the additional data that appears after scrolling is not being fetched by the crawler!
#88
navin-hariharan
closed
2 months ago
9
Crawl4 AI是否支持自定义LLM
#87
Hesongwork
closed
2 months ago
2
How Can I scroll the page? - js_code does not work
#86
navin-hariharan
closed
2 months ago
7
Previous
Next