search

alvarobartt / investiny

🤏🏻 `investpy` but made tiny
https://alvarobartt.github.io/investiny
MIT License
316 stars 36 forks source link

Free account suggestion #80

Open AureliusMarcusHu opened 8 months ago

AureliusMarcusHu commented 8 months ago

Dear alvarobartt,

investing.com will never help you with this open source project, because they hire cloudflare to ban every non-paying data bot from their server forever. Knowing this, it is up to us to find another solution.

Has anyone thought of working with a free account from investing.com ? It is possible to create one or more watch lists with a free account. With a free account you will receive a personal cookie. Using this cookie together with curl make it possible to get my watch_list data. Any problem at all, from 09:00 to 22:00 with a frequency of 5 minutes. The free account and personal cookie let you pass Cloudflare bot checker. I'm really fresh in python, but I managed to get this done.

I would like to help with this open source project, but someone first needs to introduce me to the investiny project.

People who supporting this idea, send a like

alvarobartt commented 8 months ago

Hi @AureliusMarcusHu, thanks for the suggestion! Maybe we can add an auth param so that the cookie is provided and then we handle that internally, could you privately send me the details on how you retrieved it? I am not into investpy and investiny anymore, as I have other duties, but would be happy to apply that if that's a simple workaround 👍🏻

AureliusMarcusHu commented 8 months ago

Hi @alvarobartt, who currently maintains the investpy and investiny projects, if You are out of these projects ? Or will both projects face a silent death in the future ? Why you will have the details privately and not on this site ? I can post here the function how I construct the curl command, after you can run it on different ways.

alvarobartt commented 8 months ago

Oops forgot to remove the privately word. And yes, most likely silent not so silent death because I tried so bad whenever it broke but had few to no success, so decided it was not worth investing more time on it. Anyway your solution seems easy to implement and I can happily do it if so.

AureliusMarcusHu commented 8 months ago

@alvarobartt, There is a little problem, if we use the free account in the open source project. And everyone gone use it, then it is possible that investing.com take action against the free accounts. Do you know what I mean ? Maybe we will first talk about how we avoid this futured problem before bringing it to the public project. Have you any idea how to solve this futured problem ? Can I communicate with you on private ?

AureliusMarcusHu commented 8 months ago

@alvarobartt, A long time I was thinking about a little cloud server to gather the data from one point. Then we using the cloud server to distribute the data to the open source project. Is this a solution ? If we get a working solution now, we must prevent what happened in the past, that investing can block the open source project.

My opinion is that trading data should be accessible to everyone. Free or at a very low cost. Not at the crazy prices for premium account subscriptions as on several websites. These websites have enough income from their advertisements without having to charge crazy prices for their account subscriptions. If they give people access to all their data with a free account, there would be a storm of subscriptions of free accounts. At this way these websites have even more income from their advertisements.

Do you have any idea how many people used investpy before investing blocked their data? It does not have to be completely open source, it can also be a closed project with a low subscription price to cover the costs of the cloud server. What do you think about this idea ?

jdb130496 commented 7 months ago

Hi @AureliusMarcusHu

I am struggling to download historical data from investing.com site and stuck up. Data from other options like yahoo finance are not that reliable and also missing certain dates. I created free account on investing.com and added an item in watch list but being not well versed and acquainted with python, find it difficult to go ahead, download the cookies and rest of the procedure as you mentioned above. I want to download historical data of a scrip listed on NSE (National Stock Exchange, India). As suggested by you, if you can provide an example code to do this, I will be highly grateful to you. Thank you in advance. FYI my gmail account attached at investing.com is asharindani51@gmail.com