search

headrun / SWIFT

2 stars 0 forks source link

Capture Segment Details in BSE #129

Closed SreenivasDega closed 4 years ago

SreenivasDega commented 4 years ago

Requirement is to capture the segmentation under the category finance.

Navigation should happen in the below way.

financials ---> Quarterly / Annual --> Standalone / Consolidated / Segment

Example: https://www.bseindia.com/corporates/results.aspx?Code=532777&Company=INFO%20EDGE%20(INDIA)%20LTD.&qtr=105.00&RType=Seg&Typ=Q&Qname=Mar-20

anandhurajan commented 4 years ago

I was unable to connect to S3 using the client credentials and after checking for solutions was able connected to the S3 bucket by passing the region "eu-central-1" parameter in the credentials and was able to view all the buckets. But when trying to insert pdf into the bucket. I'm unable to upload the pdfs getting the Access Denied error. image

anandhurajan commented 4 years ago

Completed crawling the Segment Details and was able to capture the data and store them in local DB. Need to integrate the crawler with the existing crawler. Sample data captured.

image

anandhurajan commented 4 years ago

Completed Integrating Segment Category to the existing crawler.

image

SreenivasDega commented 4 years ago

Anandhu, test it completely and see if find any issues in that.

Cheers,

Sreenivas Dega, Head - Strategy and Operations

Headrun Technologies Pvt Ltd

Ph: 9703677770| Email: sreenivas@headrun.com sreenivas.dega@headrun.com

Follow us on: https://www.facebook.com/headrun/ https://www.linkedin.com/company/1024141/ http://www.headrun.com/

The contents of this email message and any attachments are intended solely for the addressee(s) and may contain confidential and/or privileged information and may be legally protected from disclosure

On Thu, Jul 9, 2020 at 3:00 PM anandhurajan notifications@github.com wrote:

Completed Integrating Segment Category to the existing crawler.

[image: image] https://user-images.githubusercontent.com/37609611/86995193-f61c7680-c1c5-11ea-904c-332f027b6b10.png

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/headrun/SWIFT/issues/129#issuecomment-656020032, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANCWIXIXK2ICPXORBA6J743R2WEZ5ANCNFSM4OMF36NQ .

anandhurajan commented 4 years ago

Getting the following error when trying to deploy Scrapyd

image

anandhurajan commented 4 years ago

Added Segment categories in BSE API image