search

kiliman / tailwindui-crawler

tailwindui-crawler downloads the component HTML files locally
MIT License
763 stars 95 forks source link

[Bug] Crawling seems broken (empty body tags) #27

Closed ecklf closed 4 years ago

ecklf commented 4 years ago

HTML output without using any transformer:

<html>
<head /><body /></html>
kiliman commented 4 years ago

I saw your post on Discord. I tried using your config as well as removing transformers and I got the correct files output. Did you download a release or clone the repo? Let's make sure you have the latest, then we can troubleshoot further. I want to make sure it works for you.

Thanks!

ecklf commented 4 years ago

Seems to be working now. Maybe there is a latency issue?

kiliman commented 4 years ago

I'm not sure what you mean by latency? I simply use await fetch() so would assume that it would throw if it timed out. Anyway, let me know if it happens again and we could log the response.

benkraus commented 4 years ago

@impulse you don't recall anything you did to get it working, did you? I'm having this exact same problem :(

ecklf commented 4 years ago

@impulse you don't recall anything you did to get it working, did you? I'm having this exact same problem :(

It worked again after a while with no changes. Still not sure where the problem was.

kiliman commented 4 years ago

Since I'm scraping an external site, it's possible the Tailwind UI site was having a temporary issue at the time.

joveice commented 3 years ago

I have the same issue, have ran it multiple times with and without transformers and all the tags are empty and no code. Just cloned the repo (master).