hackforla / data-science

The Hack For LA Data Science team is a Community of Practice within the LA brigade seeking to make analytical and machine learning services available to local communities and organizations.

28 stars 17 forks source link

CoP: Data Science: Open Source Projects Data Set for Climate projects #152

Open akhaleghi opened 2 years ago

akhaleghi commented 2 years ago

Overview

We want to monitor various open source projects and create a script that will keep our listing up-to-date with information such as last active.

Action Items

[x] Add each project's URL to the Project URL column (You can see that if you hover over the Project name and description cells. You can also try to pull it from the Project URLs link in Resources below)
[x] Create a script that will visit each URL and update the following columns (Note that you may have to work around API limits):
- [x] Project URL
- [x] Last Active Date (Date)
- [x] Number of contributors
- [ ] Connect with volunteer who developed script to copy files over to Hack for LA repository. Code is here.
- [ ] Assess current script and make necessary edits so it can be automated to run and produce output periodically.
- [x] Develop a data dashboard to display information in a useful way

Resources/Instructions

Spreadsheet of open source projects we want to monitor here Original source for project URLs here Info about getting URL from a Google Sheet cell

akhaleghi commented 2 years ago

@ExperimentsInHonesty The volunteer working on this issue, Natalie, is still unable to edit the spreadsheet listed under resources.

akhaleghi commented 2 years ago

Hey @noneill256 I know you've been updating the team at the meetings, but can you also add those to the issue comments here so we can keep those documented?

noneill256 commented 2 years ago

@akhaleghi @ExperimentsInHonesty The scripts are all finished and the columns have been filled. Scripts will be run once a month starting now.

noneill256 commented 1 year ago

Added a new task to find someone else to run (and improve if they want) my script since I'm leaving Hack for LA for now. If it does find someone they can hit me up for help on Slack!

ExperimentsInHonesty commented 9 months ago

Needs a rewrite to make it an automated script instead of " Find a new person to run the script on a monthly basis" and that has a display component, so that we can share the data.

akhaleghi commented 8 months ago

Next steps: Connect with @noneill256 to get script files moved over to Hack for LA's repository (if it hasn't been done already). Once files have been moved (or found) on our repository, add a link to them in "Resources/Instructions" above.

Noah also might respond to slack

If not, please reach out to Admin channel to ask for their email address.

ExperimentsInHonesty commented 7 months ago

@JessicaLucindaCheng Can you add instructions for how they can move the content to a new repository. Repository has not been made yet.

JessicaLucindaCheng commented 7 months ago

@ExperimentsInHonesty

@JessicaLucindaCheng Can you add instructions for how they can move the content to a new repository. Repository has not been made yet.

Yes, I will do it this week.

JessicaLucindaCheng commented 7 months ago

Availability: 6 hours
- ETA: Wednesday, April 10, 2024

Action Items

[ ] Add instructions for how they can move the content to a new repository. Repository has not been made yet.

noneill256 commented 7 months ago

Sorry for the slow response! I'd be happy to help with moving my files over once I know what repository to put them in.

JessicaLucindaCheng commented 7 months ago

How to move a commit from one repo to another repo

Progress

Progress updates will be made in https://github.com/hackforla/website/issues/6595

Action Items

Add instructions for how they can move the content to a new repository. Repository has not been made yet.
- Instructions are still a work in progress but can be found here: https://github.com/hackforla/website/issues/6595#issuecomment-2047453668

ExperimentsInHonesty commented 5 months ago

@noneill256 Here is the repository https://github.com/hackforla/open-source-climate-projects. I just created it. It's got the same permissions that the Data Science Repos have and Karina, Sophia and Abe all can elevate permissions if you need them

akhaleghi commented 3 months ago

Hey @noneill256 just wanted to confirm that you are still working on this issue since there haven't been any updates in a few months

Shehroze23 commented 2 months ago

@noneill256 is not working on this project anymore. Someone else will need to copy the files to the Hack for LA repository.

Shehroze23 commented 1 month ago

Here is the link to the Open Source Projects Data Dashboard on Looker Studio:

https://lookerstudio.google.com/s/kSiUYcnTcYc.

You will need to log in to a Gmail account to view the dashboard. I am unassigning myself due to not having currently the skills to make edits to the script. If any changes are needed to the dashboard, I can be reached on Slack. Slack: shehrozek978