search

supermemoryai / markdowner

A fast tool to convert any website into LLM-ready markdown data. Built by https://supermemory.ai
https://md.dhr.wtf
MIT License
874 stars 67 forks source link

Error 1101 : Worker threw exception #1

Open XenocodeRCE opened 5 months ago

XenocodeRCE commented 5 months ago

Hello

first, thank you ! amazing project

Error 1101 Ray ID: 8865f56ebae12c21 • 2024-05-19 17:55:34 UTC
Worker threw exception
What happened?
You've requested a page on a website (md.dhr.wtf) that is on the [Cloudflare](https://www.cloudflare.com/5xx-error-landing/) network. An unknown error occurred while rendering the page.

What can I do?
If you are the owner of this website:
you should [login to Cloudflare](https://www.cloudflare.com/login?utm_source=error_100x) and check the error logs for md.dhr.wtf.

Cloudflare Ray ID: 8865f56ebae12c21

Sometimes i get this error, it happens randomly

here is the url i'm sending as GET

https://md.dhr.wtf/?url=https://www.google.com/search?q=Peut-on%2Btout%2Bdire%2B%253F%2BDans%2Bune%2Bsoci%25C3%25A9t%25C3%25A9%2Bfond%25C3%25A9e%2Bsur%2Bla%2Blibert%25C3%25A9%2Bd%2527expression%252C%2Bla%2Bquestion%2Bde%2Bsavoir%2Bsi%2Bl%2527on%2Bpeut%2Btout%2Bdire%2Bsuscite%2Bdes%2Bd%25C3%25A9bats%2Bpassionn%25C3%25A9s%2Bet%2Bsoul%25C3%25A8ve%2Bdes%2Benjeux%2B%25C3%25A9thiques%252C%2Bmoraux%2Bet%2Bsociaux%2Bconsid%25C3%25A9rables.%2BCette%2Binterrogation%2Bmet%2Ben%2Bbalance%2Bles%2Bprincipes%2Bde%2Blibert%25C3%25A9%2Bindividuelle%2Bet%2Bles%2Blimites%2Bn%25C3%25A9cessaires%2Bpour%2Bpr%25C3%25A9server%2Bl%2527ordre%252C%2Bla%2Bs%25C3%25A9curit%25C3%25A9%2Bet%2Ble%2Brespect%2Bmutuel%2Bau%2Bsein%2Bde%2Bla%2Bsoci%25C3%25A9t%25C3%25A9.%2BAinsi%252C%2Baborder%2Bcette%2Bquestion%2Bexige%2Bune%2Banalyse%2Bapprofondie%2Bdes%2Bdiff%25C3%25A9rents%2Baspects%2Bimpliqu%25C3%25A9s.%2BD%2527une%2Bpart%252C%2Bd%25C3%25A9fendre%2Ble%2Bdroit%2Bde%2Btout%2Bdire%2Brevient%2B%25C3%25A0%2Bsoutenir%2Bla%2Blibert%25C3%25A9%2Bd%2527expression%2Bcomme%2Bun%2Bpilier%2Bfondamental%2Bde%2Bla%2Bd%25C3%25A9mocratie.%2BEn%2Bpermettant%2B%25C3%25A0%2Bchacun%2Bd%2527exprimer%2Bses%2Bopinions%252C%2Bm%25C3%25AAme%2Bles%2Bplus%2Bcontrovers%25C3%25A9es%252C%2Bla%2Bsoci%25C3%25A9t%25C3%25A9%2Bfavorise%2Ble%2Bd%25C3%25A9bat%2Bd%2527id%25C3%25A9es%2Bet%2Bla%2Bdiversit%25C3%25A9%2Bdes%2Bperspectives.%2BCette%2Blibert%25C3%25A9%2Bconstitue%2B%25C3%25A9galement%2Bun%2Bcontre
Dhravya commented 5 months ago

Hi! While it is possible, it is not recommended to use google search queries with markdowner/any web-to-markdown tool.

The results will, almost always, be unsatisfying (here's jina's result, and it is possible for the crawler to be banned! (that's what happened in my case)