Update crawler to support new TailwindUI site

kiliman / tailwindui-crawler

tailwindui-crawler downloads the component HTML files locally

MIT License

756 stars 94 forks source link

Update crawler to support new TailwindUI site #45

Closed skinnyandbald closed 3 years ago

skinnyandbald commented 3 years ago

It's previously worked, but ran it today and am getting:

hasn't found a single component.

TailwindUI pushed some big updates to their site today, so maybe related to changes they made that broke the crawler? The URL paths seem to still be the same though.

kiliman commented 3 years ago

Yes, this is due to the change in site structure to support the new React/Vue components.

I'm working on updating the crawler.

kiliman commented 3 years ago

Ok, I've got the initial version crawling the new site. I should have this done tomorrow.

HTML

React

Vue

skinnyandbald commented 3 years ago

Ahh cool. Thanks, @kiliman !

heychazza commented 3 years ago

Hey @kiliman - using the github action version, and vue doesn't appear for me?

kiliman commented 3 years ago

@heychazza Someone else created the GitHub Action and I haven't had a chance to test it out with the new version.

I'll take a look.

heychazza commented 3 years ago

@heychazza Someone else created the GitHub Action and I haven't had a chance to test it out with the new version.

I'll take a look.

Thank you, tried the crawler locally as well and wasn't able to run..

kiliman commented 3 years ago

Just noticed there was a typo in the README. It should be vue, not vuew. Make sure in the .env file it looks like:

LANGUAGES=html,react,vue

What are you seeing when you run it locally?

kiliman commented 3 years ago

Created new issue for GitHub action #46

heychazza commented 3 years ago

Just noticed there was a typo in the README. It should be vue, not vuew. Make sure in the .env file it looks like:
LANGUAGES=html,react,vue
What are you seeing when you run it locally?

It only runs html and react.. really odd