search

nelsonic / github-scraper

🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡
434 stars 96 forks source link

Should we scrape an issue that only has one comment? #24

Open nelsonic opened 9 years ago

nelsonic commented 9 years ago

Should we scrape issues that don't have any comments? e.g: github-issue-has-more-than-one-comment

iteles commented 9 years ago

Yes.

When there are 'no comments' what that actually means is that there is still an issue description, just no interaction on that issue yet.

(This is the 'no comments' issue highlighted above)

no-comments-issue-actually-has-description

The issue information is still very valuable, especially for https://github.com/dwyl/tudo functionality.

nelsonic commented 9 years ago

Right, so we still need to scrape it just to extract the body of the issue? :question:

iteles commented 9 years ago

I reckon so, as I assume we can get all the rest of the info we need (assignee, labels, etc) from the issue list view.

nelsonic commented 9 years ago

Already got most of the meta info (including milestone, as discussed ... or "milesontes" as my commit called them... :stuck_out_tongue_winking_eye: ) but we will need to extract the participants from the issue page ...