Push investigation of SeekingAlpha into this repo

elephantscale / ml-fin

Apache License 2.0

0 stars 0 forks source link

Push investigation of SeekingAlpha into this repo #1

Open markkerzner opened 4 years ago

markkerzner commented 4 years ago

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

williamjfermo commented 4 years ago

will look into that I was trying to build my own script but will check that out too.

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner notifications@github.com wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHTOVWLCUZYW6WSHJDRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWZ3EF6APKEOCIIE55ABZ3RBQKUFANCNFSM4KQV2W6Q .

mdani38 commented 4 years ago

Sounds good. Will take a look

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner notifications@github.com wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q .

williamjfermo commented 4 years ago

Hi Mark I decided to go back to using that Scrapy code for Alpha Secure. I was able to get it to run. There was a tab error issue which is easily remedied by going through the code in the Spider folder and tabbing then untabbing. Next issue I had an error 403 and that was fixed by changing the USER AGENT in settings.py and replacing with your USER AGENT in the Alpha Secure folder. I was able to get some transcript but it super minimal, probably nothing you could work with to get a sentiment analysis. I looked at issues for repo and it is from 2017 so there might be issues running with the latest scrapy i downloaded.

I don't know if I can get any significant data by end of day but if I can't I will let you know then just focus on videoing my labs tomorrow to get that turned in.

On Thu, Feb 6, 2020 at 9:28 AM Matthew Danielson notifications@github.com wrote:

Sounds good. Will take a look

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner notifications@github.com wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub < https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHI756LV56S2USRR3TRBQUALA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7T3OY#issuecomment-582958523, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWZ3EAA63NDKNDLA6HW5P3RBQUALANCNFSM4KQV2W6Q .

markkerzner commented 4 years ago

This sounds good. Do you want to be part of the hackathon tomorrow?

On Thu, Feb 6, 2020, 5:05 PM williamjfermo notifications@github.com wrote:

Hi Mark I decided to go back to using that Scrapy code for Alpha Secure. I was able to get it to run. There was a tab error issue which is easily remedied by going through the code in the Spider folder and tabbing then untabbing. Next issue I had an error 403 and that was fixed by changing the USER AGENT in settings.py and replacing with your USER AGENT in the Alpha Secure folder. I was able to get some transcript but it super minimal, probably nothing you could work with to get a sentiment analysis. I looked at issues for repo and it is from 2017 so there might be issues running with the latest scrapy i downloaded.

I don't know if I can get any significant data by end of day but if I can't I will let you know then just focus on videoing my labs tomorrow to get that turned in.

On Thu, Feb 6, 2020 at 9:28 AM Matthew Danielson <notifications@github.com

wrote:

Sounds good. Will take a look

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner notifications@github.com wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub < https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHI756LV56S2USRR3TRBQUALA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7T3OY#issuecomment-582958523 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/ALWZ3EAA63NDKNDLA6HW5P3RBQUALANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6IMUUDH77XRH2U3VT3RBSCTJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELA6VNQ#issuecomment-583133878, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAETM6NW45TZSOOLEYGUNMLRBSCTJANCNFSM4KQV2W6Q .

williamjfermo commented 4 years ago

I don't think I have time I want to get the other lab work done. I'm going through the scrapy tutorial to run some code. I am not using that SeekingAlpha anymore as it has too many issues and looks like since 2017 the website has been updated and it will not work with that. I think 2017 that would have worked with the 2017 website and maybe an older version of scrapy. Plus it was scraping slides, which is what we don't need.

But I found this that might work which was done less then a year ago and will get what we want also. https://bountify.co/scrape-earnings-conference-call-transcripts

On Thu, Feb 6, 2020 at 5:04 PM Mark Kerzner notifications@github.com wrote:

This sounds good. Do you want to be part of the hackathon tomorrow?

On Thu, Feb 6, 2020, 5:05 PM williamjfermo notifications@github.com wrote:

Hi Mark I decided to go back to using that Scrapy code for Alpha Secure. I was able to get it to run. There was a tab error issue which is easily remedied by going through the code in the Spider folder and tabbing then untabbing. Next issue I had an error 403 and that was fixed by changing the USER AGENT in settings.py and replacing with your USER AGENT in the Alpha Secure folder. I was able to get some transcript but it super minimal, probably nothing you could work with to get a sentiment analysis. I looked at issues for repo and it is from 2017 so there might be issues running with the latest scrapy i downloaded.

I don't know if I can get any significant data by end of day but if I can't I will let you know then just focus on videoing my labs tomorrow to get that turned in.

On Thu, Feb 6, 2020 at 9:28 AM Matthew Danielson < notifications@github.com

wrote:

Sounds good. Will take a look

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner notifications@github.com wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHI756LV56S2USRR3TRBQUALA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7T3OY#issuecomment-582958523

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/ALWZ3EAA63NDKNDLA6HW5P3RBQUALANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub < https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6IMUUDH77XRH2U3VT3RBSCTJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELA6VNQ#issuecomment-583133878 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAETM6NW45TZSOOLEYGUNMLRBSCTJANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EFSXBXIM2WVLV7K4G3RBSJPRA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBDVTA#issuecomment-583154380, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWZ3EAXZFUOVACZP2RK6Q3RBSJPRANCNFSM4KQV2W6Q .

mdani38 commented 4 years ago

I also do not think I will have enough time. Want to get good progress on the lab and intro recordings.

On Thu, Feb 6, 2020 at 5:04 PM Mark Kerzner notifications@github.com wrote:

This sounds good. Do you want to be part of the hackathon tomorrow?

On Thu, Feb 6, 2020, 5:05 PM williamjfermo notifications@github.com wrote:

Hi Mark I decided to go back to using that Scrapy code for Alpha Secure. I was able to get it to run. There was a tab error issue which is easily remedied by going through the code in the Spider folder and tabbing then untabbing. Next issue I had an error 403 and that was fixed by changing the USER AGENT in settings.py and replacing with your USER AGENT in the Alpha Secure folder. I was able to get some transcript but it super minimal, probably nothing you could work with to get a sentiment analysis. I looked at issues for repo and it is from 2017 so there might be issues running with the latest scrapy i downloaded.

I don't know if I can get any significant data by end of day but if I can't I will let you know then just focus on videoing my labs tomorrow to get that turned in.

On Thu, Feb 6, 2020 at 9:28 AM Matthew Danielson < notifications@github.com

wrote:

Sounds good. Will take a look

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner notifications@github.com wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHI756LV56S2USRR3TRBQUALA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7T3OY#issuecomment-582958523

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/ALWZ3EAA63NDKNDLA6HW5P3RBQUALANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub < https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6IMUUDH77XRH2U3VT3RBSCTJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELA6VNQ#issuecomment-583133878 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAETM6NW45TZSOOLEYGUNMLRBSCTJANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPJT4ZX7JSK7R6BI4NLRBSJPRA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBDVTA#issuecomment-583154380, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJOLZPPWRDPDI5GGYZG45MTRBSJPRANCNFSM4KQV2W6Q .

markkerzner commented 4 years ago

Cool guys.thank you for your work

On Thu, Feb 6, 2020, 6:24 PM Matthew Danielson notifications@github.com wrote:

I also do not think I will have enough time. Want to get good progress on the lab and intro recordings.

On Thu, Feb 6, 2020 at 5:04 PM Mark Kerzner notifications@github.com wrote:

This sounds good. Do you want to be part of the hackathon tomorrow?

On Thu, Feb 6, 2020, 5:05 PM williamjfermo notifications@github.com wrote:

Hi Mark I decided to go back to using that Scrapy code for Alpha Secure. I was able to get it to run. There was a tab error issue which is easily remedied by going through the code in the Spider folder and tabbing then untabbing. Next issue I had an error 403 and that was fixed by changing the USER AGENT in settings.py and replacing with your USER AGENT in the Alpha Secure folder. I was able to get some transcript but it super minimal, probably nothing you could work with to get a sentiment analysis. I looked at issues for repo and it is from 2017 so there might be issues running with the latest scrapy i downloaded.

I don't know if I can get any significant data by end of day but if I can't I will let you know then just focus on videoing my labs tomorrow to get that turned in.

On Thu, Feb 6, 2020 at 9:28 AM Matthew Danielson < notifications@github.com

wrote:

Sounds good. Will take a look

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner < notifications@github.com> wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHI756LV56S2USRR3TRBQUALA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7T3OY#issuecomment-582958523

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/ALWZ3EAA63NDKNDLA6HW5P3RBQUALANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6IMUUDH77XRH2U3VT3RBSCTJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELA6VNQ#issuecomment-583133878

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AAETM6NW45TZSOOLEYGUNMLRBSCTJANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub < https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPJT4ZX7JSK7R6BI4NLRBSJPRA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBDVTA#issuecomment-583154380 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AJOLZPPWRDPDI5GGYZG45MTRBSJPRANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6PQBHMTRKSDKYNNNQ3RBSLZJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBFCYQ#issuecomment-583160162, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAETM6MTWTCCKS4577HBSB3RBSLZJANCNFSM4KQV2W6Q .

williamjfermo commented 4 years ago

Here is the file it produces it will scrape all the transcripts into one html file is my understanding. I just ran it through my machine and got this. If I set user agent to false it should get the rest i'm hoping.

On Thu, Feb 6, 2020 at 6:39 PM Mark Kerzner notifications@github.com wrote:

Cool guys.thank you for your work

On Thu, Feb 6, 2020, 6:24 PM Matthew Danielson notifications@github.com wrote:

I also do not think I will have enough time. Want to get good progress on the lab and intro recordings.

On Thu, Feb 6, 2020 at 5:04 PM Mark Kerzner notifications@github.com wrote:

This sounds good. Do you want to be part of the hackathon tomorrow?

On Thu, Feb 6, 2020, 5:05 PM williamjfermo notifications@github.com wrote:

Hi Mark I decided to go back to using that Scrapy code for Alpha Secure. I was able to get it to run. There was a tab error issue which is easily remedied by going through the code in the Spider folder and tabbing then untabbing. Next issue I had an error 403 and that was fixed by changing the USER AGENT in settings.py and replacing with your USER AGENT in the Alpha Secure folder. I was able to get some transcript but it super minimal, probably nothing you could work with to get a sentiment analysis. I looked at issues for repo and it is from 2017 so there might be issues running with the latest scrapy i downloaded.

I don't know if I can get any significant data by end of day but if I can't I will let you know then just focus on videoing my labs tomorrow to get that turned in.

On Thu, Feb 6, 2020 at 9:28 AM Matthew Danielson < notifications@github.com

wrote:

Sounds good. Will take a look

On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner < notifications@github.com> wrote:

Here is a repo that can help https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHI756LV56S2USRR3TRBQUALA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7T3OY#issuecomment-582958523

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/ALWZ3EAA63NDKNDLA6HW5P3RBQUALANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6IMUUDH77XRH2U3VT3RBSCTJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELA6VNQ#issuecomment-583133878

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AAETM6NW45TZSOOLEYGUNMLRBSCTJANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <

https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPJT4ZX7JSK7R6BI4NLRBSJPRA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBDVTA#issuecomment-583154380

, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AJOLZPPWRDPDI5GGYZG45MTRBSJPRANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub < https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6PQBHMTRKSDKYNNNQ3RBSLZJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBFCYQ#issuecomment-583160162 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAETM6MTWTCCKS4577HBSB3RBSLZJANCNFSM4KQV2W6Q

.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EAOECIIXZOP3RIBSCLRBSUS7A5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBJ66Y#issuecomment-583180155, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWZ3EGZM3HZBNFNVN6ZE4LRBSUS7ANCNFSM4KQV2W6Q .

williamjfermo commented 4 years ago

Here is the file


chmod u+x  earnings.py

On Fri, Feb 7, 2020 at 10:19 AM William Fermo <williamjfermo@gmail.com>
wrote:

> Here is the file it produces it will scrape all the transcripts into one
> html file is my understanding.  I just ran it through my machine and got
> this.  If I set user agent to false it should get the rest i'm hoping.
>
> On Thu, Feb 6, 2020 at 6:39 PM Mark Kerzner <notifications@github.com>
> wrote:
>
>> Cool guys.thank you for your work
>>
>> On Thu, Feb 6, 2020, 6:24 PM Matthew Danielson <notifications@github.com>
>> wrote:
>>
>> > I also do not think I will have enough time. Want to get good progress
>> on
>> > the lab and intro recordings.
>> >
>> >
>> > On Thu, Feb 6, 2020 at 5:04 PM Mark Kerzner <notifications@github.com>
>> > wrote:
>> >
>> > > This sounds good. Do you want to be part of the hackathon tomorrow?
>> > >
>> > > On Thu, Feb 6, 2020, 5:05 PM williamjfermo <notifications@github.com>
>> > > wrote:
>> > >
>> > > > Hi Mark I decided to go back to using that Scrapy code for Alpha
>> > Secure.
>> > > > I was able to get it to run.
>> > > > There was a tab error issue which is easily remedied by going
>> through
>> > the
>> > > > code in the Spider folder and tabbing then untabbing.
>> > > > Next issue I had an error 403 and that was fixed by changing the
>> USER
>> > > AGENT
>> > > > in settings.py and replacing with your USER AGENT in the Alpha
>> Secure
>> > > > folder.
>> > > > I was able to get some transcript but it super minimal, probably
>> > nothing
>> > > > you could work with to get a sentiment analysis.
>> > > > I looked at issues for repo and it is from 2017 so there might be
>> > issues
>> > > > running with the latest scrapy i downloaded.
>> > > >
>> > > > I don't know if I can get any significant data by end of day but if
>> I
>> > > can't
>> > > > I will let you know then just focus on videoing my labs tomorrow to
>> get
>> > > > that turned in.
>> > > >
>> > > >
>> > > >
>> > > > On Thu, Feb 6, 2020 at 9:28 AM Matthew Danielson <
>> > > notifications@github.com
>> > > > >
>> > > > wrote:
>> > > >
>> > > > > Sounds good. Will take a look
>> > > > >
>> > > > > On Thu, Feb 6, 2020 at 8:08 AM Mark Kerzner <
>> > notifications@github.com>
>> > > > > wrote:
>> > > > >
>> > > > > > Here is a repo that can help
>> > > > > >
>> https://github.com/Rumperuu/Scraping-Alpha/blob/master/README.md
>> > > > > >
>> > > > > > —
>> > > > > > You are receiving this because you were assigned.
>> > > > > > Reply to this email directly, view it on GitHub
>> > > > > > <
>> > > > >
>> > > >
>> > >
>> >
>> https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPIYX35IXTW2QWREQITRBQKUFA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7KXOI#issuecomment-582921145
>> > > > > >,
>> > > > > > or unsubscribe
>> > > > > > <
>> > > > >
>> > > >
>> > >
>> >
>> https://github.com/notifications/unsubscribe-auth/AJOLZPKTQOWHUAHJO6CPQETRBQKUFANCNFSM4KQV2W6Q
>> > > > > >
>> > > > > > .
>> > > > > >
>> > > > >
>> > > > > —
>> > > > > You are receiving this because you were assigned.
>> > > > > Reply to this email directly, view it on GitHub
>> > > > > <
>> > > >
>> > >
>> >
>> https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EHI756LV56S2USRR3TRBQUALA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEK7T3OY#issuecomment-582958523
>> > > > >,
>> > > > > or unsubscribe
>> > > > > <
>> > > >
>> > >
>> >
>> https://github.com/notifications/unsubscribe-auth/ALWZ3EAA63NDKNDLA6HW5P3RBQUALANCNFSM4KQV2W6Q
>> > > > >
>> > > > > .
>> > > > >
>> > > >
>> > > > —
>> > > > You are receiving this because you were assigned.
>> > > > Reply to this email directly, view it on GitHub
>> > > > <
>> > >
>> >
>> https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6IMUUDH77XRH2U3VT3RBSCTJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELA6VNQ#issuecomment-583133878
>> > > >,
>> > > > or unsubscribe
>> > > > <
>> > >
>> >
>> https://github.com/notifications/unsubscribe-auth/AAETM6NW45TZSOOLEYGUNMLRBSCTJANCNFSM4KQV2W6Q
>> > > >
>> > > > .
>> > > >
>> > >
>> > > —
>> > > You are receiving this because you were assigned.
>> > > Reply to this email directly, view it on GitHub
>> > > <
>> >
>> https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AJOLZPJT4ZX7JSK7R6BI4NLRBSJPRA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBDVTA#issuecomment-583154380
>> > >,
>> > > or unsubscribe
>> > > <
>> >
>> https://github.com/notifications/unsubscribe-auth/AJOLZPPWRDPDI5GGYZG45MTRBSJPRANCNFSM4KQV2W6Q
>> > >
>> > > .
>> > >
>> >
>> > —
>> > You are receiving this because you were assigned.
>> > Reply to this email directly, view it on GitHub
>> > <
>> https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=AAETM6PQBHMTRKSDKYNNNQ3RBSLZJA5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBFCYQ#issuecomment-583160162
>> >,
>> > or unsubscribe
>> > <
>> https://github.com/notifications/unsubscribe-auth/AAETM6MTWTCCKS4577HBSB3RBSLZJANCNFSM4KQV2W6Q
>> >
>> > .
>> >
>>
>> —
>> You are receiving this because you were assigned.
>> Reply to this email directly, view it on GitHub
>> <https://github.com/elephantscale/ml-fin/issues/1?email_source=notifications&email_token=ALWZ3EAOECIIXZOP3RIBSCLRBSUS7A5CNFSM4KQV2W62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELBJ66Y#issuecomment-583180155>,
>> or unsubscribe
>> <https://github.com/notifications/unsubscribe-auth/ALWZ3EGZM3HZBNFNVN6ZE4LRBSUS7ANCNFSM4KQV2W6Q>
>> .
>>
>