search

caiobran / mstables

MorningStar.com scraper that consolidates tens of thousands of financial records into a SQLite relational database. Class 'dataframes' easily converts the SQLite data into pandas DataFrames (see Jupyter notebook for examples)
MIT License
180 stars 45 forks source link

integrate investpy as a datasource? #10

Open datatalking opened 2 years ago

datatalking commented 2 years ago

The interface and setup of this module work well but since the morningstar api is deprecated we could use https://github.com/alvarobartt/investpy/issues as a data source since there is thousands of stocks. How could we check for compatibility amount their offering and what the morning star data set uses?

@caiobran perhaps this is something @chrisidso could help with?

39952 stocks,
82221 funds,
11403 ETFs,
2029 currency crosses,
7797 indices,
688 bonds,
66 commodities,
250 certificates,
4697 cryptocurrencies.
datatalking commented 2 years ago

I've been able to dig into this deeper and since MorningStar is dead and deprecation is needed but without a new data source I held off. Now to come back I found an alternative data source that gives us many options.

I've spent a few days with investpy, it is already integrated with pandas dataframe, already has thousands of data points for many asset classes.

So that exceeds all but two of my other project requirements and it seems to be updated (as of last month)

Now that we know that, it would just be a matter of pointing the data as running investpy to access a data update via a pandas dataframe to be save in sqlite. @caiobran @dimejy2

datatalking commented 1 year ago

@caiobran we can cross @investpy off the list as it seems morningstar has enabled some kind of CloudFare and broke data access.