search

hackforla / open-community-survey

GNU General Public License v2.0
4 stars 0 forks source link

Conduct analysis of 99 NC website technologies #52

Open ebele-oputa opened 2 years ago

ebele-oputa commented 2 years ago

Dependency

Overview

We need to conduct a comparative analysis of the technologies that were used to build the 99 NC websites so that we can understand the commonalities, differences ~and create a list of recommendations for the NCs.~

Action Items

Resources/Instructions

ebele-oputa commented 2 years ago

@ShikaZzz Please rewrite the action items after having a conversation with rajinder

ebele-oputa commented 2 years ago

@ShikaZzz and @sonu-k we're not yet done with data collection so we can't do analysis. I'll move this to the Ice Box and assign you both on the other issue

ShikaZzz commented 2 years ago

Progress:

Blockers: 37 NC's are not successfully scrapped (returned nothing) Availability: 10 hours ETA: by next meeting

ShikaZzz commented 2 years ago

Progress:

Blockers: found bugs in scrapping code and working on debugging

Availability: 10 hours during weekend ETA: 1 week

kalyaniraman commented 2 years ago

@ShikaZzz Will you be continuing to work on this or do you need us to move it to prioritized backlog? If you want someone else to work on this, who should they reach out to?

ShikaZzz commented 2 years ago

@ShikaZzz Will you be continuing to work on this or do you need us to move it to prioritized backlog? If you want someone else to work on this, who should they reach out to?

Due to some reasons, I have to pause my work for this project. Rajinder (@rajindermavi) is working on debugging the scrapping code. My code is rerunnable based on Rajinder's scrapping code. Please reach out to the project manager to decide who will continue the analysis. If there are any questions regarding my work or code, please feel free to reach out to me.

ExperimentsInHonesty commented 2 years ago

sent this message in slack

@Abe Khaleghi the #community-survey project is working with Data Science on the Neighborhood Council website technology scrape. @Shika Zhou was on our team (here is the issue)but has to step back. Please connect @Kalyani Raman (pm of open community survey project) and @Rajinder Mavi to each other and identify what issue he is working from so we can wrap this project.

kalyaniraman commented 2 years ago

@ExperimentsInHonesty Tried reaching Rajinder couple time and i have not heard back from him.

kalyaniraman commented 2 years ago

Kalyani to reach out to Abe and find out where this is or will there be someone assigned to look at it.

kalyaniraman commented 2 years ago

Followed up on Slack - @Abe Khaleghi Hello Abe, I have been trying to reach @Rajinder Mavi and i have not heard back regarding the status of the issue #52 Conduct analysis of 99 NC website technologies, on where he was and if there is any work pending? Can you please assist in getting a feedback so OCS team can progress on this issue. Thankyou so much for all your help.

kalyaniraman commented 2 years ago

Response on following up with Abe and Rajinder - Rajinder responded - My work is on my GitHub https://github.com/rajindermavi/Webscraping I found technologies for webpages using the site builtwith. But I do run into my ip address getting blocked

kalyaniraman commented 2 years ago

image

akhaleghi commented 2 years ago

@rajinder could you do a few more things on this issue?

kalyaniraman commented 2 years ago

@akhaleghi @rajinder Please provide update

  1. Progress: "What is the current status of your project? What have you completed and what is left to do?"
  2. Blockers: "Difficulties or errors encountered."
  3. Availability: "How much time will you have this week to work on this issue?"
  4. ETA: "When do you expect this issue to be completed?"
  5. Pictures (if necessary): "Add any pictures that will help illustrate what you are working on."
kalyaniraman commented 2 years ago

Emailed Abe and Rajinder from open community survey gmail account to get an update and also asked if they could join the team meeting to resolve this ongoing issue. Waiting to hear back from them.

kalyaniraman commented 2 years ago

Last update received on March 3 from Rajinder image

kalyaniraman commented 2 years ago

Added this issue to Data Science PM meeting Agenda

kalyaniraman commented 2 years ago

@akhaleghi @rajinder Please provide update

  1. Progress: "What is the current status of your project? What have you completed and what is left to do?"
  2. Blockers: "Difficulties or errors encountered."
  3. Availability: "How much time will you have this week to work on this issue?"
  4. ETA: "When do you expect this issue to be completed?"
  5. Pictures (if necessary): "Add any pictures that will help illustrate what you are working on."
akhaleghi commented 2 years ago

@kalyaniraman We've covered all of this on Slack. OCS: Builtwith data on 99 NCs technologies is the output. The technologies have been identified on the 99 sites but the groupings (the second and third tabs of that spreadsheet) have not. Rajinder is no longer working on this, but what's left to do seems to be just taking the list on the first tab (probably focusing initially on the first 65 items with 2 or more instances) and categorizing them into a particular group.

ExperimentsInHonesty commented 2 years ago

@kalyaniraman the github handle of rajinder is not @rajinder its @rajindermavi but he is no longer on the project, so only message @akhaleghi

ExperimentsInHonesty commented 2 years ago

the issue on the Data Science community of practice is https://github.com/hackforla/data-science/issues/44

kalyaniraman commented 2 years ago

We have asked for more details from Data Science Team https://github.com/hackforla/data-science/issues/44#issuecomment-1152954106