nelsonic / github-scraper

🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡
425 stars 96 forks source link

Chore: Repo -> Branches `NaN` #126

Closed nelsonic closed 7 months ago

nelsonic commented 7 months ago

The only selector in the repo parser that isn't working now is branches:

https://github.com/nelsonic/github-scraper/actions/runs/7532430509/job/20503017933#step:5:537

image

This was working a week ago as you can see from the passing tests on GitHub Actions CI: https://github.com/nelsonic/github-scraper/actions

github-scraper-tests-passing

The problem is the <div> soup that is the GitHub HTML (thanks to the React mess ... 🙄)

github-dwyl-mvp-repo-branches-DOM-nesting

I don't know if I want to waste my time on this ... ⏳

nelsonic commented 7 months ago

The branches value is rendered by React in the browser so it's not available. Closing.