search

hackforla / data-science

The Hack For LA Data Science team is a Community of Practice within the LA brigade seeking to make analytical and machine learning services available to local communities and organizations.
28 stars 17 forks source link

webscraping folder initial commit #116

Closed rajindermavi closed 3 years ago

rajindermavi commented 3 years ago

[Edited]

This PR is a stand alone folder added to the 311-data folder. It contains a webscraping script for the tech stacks of each NC survey. See issue 44. The readme contains a link to the google sheets table of the tech used for each website.

AlbertUlysses commented 3 years ago

@rajindermavi can you give a quick description of what is going on in this commit?

rajindermavi commented 3 years ago

Right now the script will create a json file with tech stacks of each website for the NC survey. Just got advised to convert the output to a csv. I can get that done by tomorrow.

AlbertUlysses commented 3 years ago

Ah I understand. I was asking more about what this commit includes so I can merge it to the master. Is this commit just a folder creation with some extra files?

rajindermavi commented 3 years ago

Oh, yes. This is just a stand alone folder with the webscraping.

I just updated the PR to include the conversion of the json to csv. The csv is uploaded to google sheets, the link is included in the readme.

AlbertUlysses commented 3 years ago

awesome, looks good