search

hemenkapadia / getbhavcopy

Free NSE and BSE data downloader
http://www.getbhavcopy.com
112 stars 49 forks source link

Getbhav convert to Metastock #234

Open algaeginger opened 1 year ago

algaeginger commented 1 year ago

Hi, I used getbhav since its inception till it provided NSE bhavcopy. I again came back to download BSE bhavcopy for the first time, a couple of days back. It worked very well just as in the past. However I've encountered a odd problem. The bhavcopy has the scrip symbol as a number (BSE symbols) but the Metastock conversion requires a alphanumeric symbol to proceed with the conversion. Has anyone overcome this issue? Some roundabout? Is it possible to delete the number symbol col and leave the alphanumeric symbol column in the BSE bhavcopy? Any help will be appreciated. Thanks

pparesh25 commented 1 year ago

Please provide me with a sample file, and I will try to assist you.

algaeginger commented 1 year ago

Dear Paresh,

Thank you very much for offering to assist .

This is the format that is required

4THDIM,20230526,21.2,21.2,21.2,21.2,5500 ACEINTEG,20230526,37.5,38.9,37.5,38.9,107 ADL,20230526,73,76.25,71,73.65,5549 AKI,20230526,107.6,112.9,103.2,103.95,25826 ALPSINDUS,20230526,2.45,2.45,2.4,2.45,27303 ANSALAPI,20230526,9.95,10,9.65,9.85,22682 ATAM,20230526,237.5,238.75,228,229.7,12559 AURIONPRO,20230526,713.6,748.2,707,748.2,87140

The output of getbhav for BSE is 533022,20090101,158,184,152,177,43740 526921,20090101,911,911,852,91,15916 532628,20090101,39,41,387,3995,372209 523395,20090101,940,940,9201,9201,25 500009,20090101,944,95,888,95,29486 531190,20090101,88,88,88,88,50

Need the symbol to be alphabetical or alphanumeric . So if the raw BSE bhavcopy shown below

SC_CODE SC_NAME SC_GROUP SC_TYPE OPEN HIGH LOW CLOSE LAST PREVCLOSE NO_TRADES NO_OF_SHRS NET_TURNOV TDCLOINDI 533022 20 MICRONS B Q 15.8 18.4 15.2 17.7 17.7 15.5 685 43740 760568 526921 21ST CEN.MGM B Q 9.11 9.11 8.52 9.1 9.11 8.68 56 15916 140479

could have the SC_NAME instead of the SC_CODE

I appreciate your prompt response and help.

Best regards, algae

On Sat, May 27, 2023 at 7:53 PM Paresh Patel @.***> wrote:

Please provide me with a sample file, and I will try to assist you.

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1565451612, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7NA2GRNP443IRLHJ43XIIE73ANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

pparesh25 commented 1 year ago

A simple solution to this is to write a python script using the pandas module, which replaces the first column which is the bse code and replaces it with the name. And another solution is to write a new downloader which downloads the data from bse india site and saves it in the desired format so that the latest data can be updated. I will write the script of first solution on Tuesday and give you the link, and if I get time for the second solution, I will definitely try

algaeginger commented 1 year ago

Thank you very much Paresh. You're going out of your way to help.

It's not all that important, you would be extremely busy in your (IT) job.

regards

On Sun, May 28, 2023 at 11:55 PM Paresh Patel @.***> wrote:

A simple solution to this is to write a python script using the pandas module, which replaces the first column which is the bse code and replaces it with the name. And another solution is to write a new downloader which downloads the data from bse india site and saves it in the desired format so that the latest data can be updated. I will write the script of first solution on Tuesday and give you the link, and if I get time for the second solution, I will definitely try

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1566222412, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7OFYJG7YF3LRSVPKSLXIOKBBANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

pparesh25 commented 1 year ago

A simple solution to this is to write a python script using the pandas module, which replaces the first column which is the bse code and replaces it with the name. And another solution is to write a new downloader which downloads the data from bse india site and saves it in the desired format so that the latest data can be updated. I will write the script of first solution on Tuesday and give you the link, and if I get time for the second solution, I will definitely try

I apologize for the delay. I had intended to complete this task on Tuesday but was unable to do so because I was out of town. Here is the link to the file, I have written and instructions on how to use it.

https://github.com/pparesh25/BSE-Code-to-Name/archive/refs/heads/main.zip

pparesh25 commented 1 year ago

Thank you very much Paresh. You're going out of your way to help. It's not all that important, you would be extremely busy in your (IT) job. regards>

I have created 'getbhavcopy-alternative' for accessing NSE EOD data, and it was part of my plan to include a similar option for BSE EOD data.

https://github.com/pparesh25/Getbhavcopy-alternative

algaeginger commented 1 year ago

Dear Paresh,

Thank you so much for your email and your solutions to the issue we were facing. Your expertise and help are greatly appreciated.

Life can get busy, and I appreciate you taking the time to undertake this project and for sharing it, Can I request you to make it an exe file so that non techies can use it. I can't make use of it myself. Presently i have a vba code to delete the extraneous columns and save it as a csv file. Your program will be a life saver.

Best regards, algae

On Wed, May 31, 2023 at 5:45 PM Paresh Patel @.***> wrote:

Thank you very much Paresh. You're going out of your way to help. It's not all that important, you would be extremely busy in your (IT) job. regards>

I have created 'getbhavcopy-alternative' for accessing NSE EOD data, and it was part of my plan to include a similar option for BSE EOD data.

https://github.com/pparesh25/Getbhavcopy-alternative

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1570108157, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7KWHSKURWRGXCF47HTXI4Y5NANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

pparesh25 commented 1 year ago

Dear Paresh, Thank you so much for your email and your solutions to the issue we were facing. Your expertise and help are greatly appreciated. Life can get busy, and I appreciate you taking the time to undertake this project and for sharing it, Can I request you to make it an exe file so that non techies can use it. I can't make use of it myself. Presently i have a vba code to delete the extraneous columns and save it as a csv file. Your program will be a life saver. Best regards, algae

https://github.com/pparesh25/Getbhavcopy-alternative/blob/main/How%20to%20download%20eod%20data.txt

pparesh25 commented 1 year ago

Installing and running Python scripts is very easy. Videos are available on YouTube for guidance. However, I cannot share the .exe file of my script, 'Getbhavcopy-alternative,' because Microsoft Defender shows a false positive. But you can build it yourself using the PyInstaller library to create a standalone .exe file. There is also a YouTube video tutorial available on how to create an .exe file from a .py file using PyInstaller. I will provide a video link that explains how to install Python and download data using the source code in the .py file.

pparesh25 commented 1 year ago

I hope you have already used the program to convert the BSE code column to names. If not, please follow these steps: create two new folders on drive C and name them 'BSE' and 'CSV'. Place your BSE bhavcopy file in the 'BSE' folder and the 'name.csv' file in the 'CSV' folder (note that the folder names must be capitalized). Finally, double-click on the .py file, and that's it!

algaeginger commented 1 year ago

I dind't understand that. Okay with creating two folders in C drive ' BSE' 'CSV'. Placed the bhavcopy(BSE data) in the BSE folder and the list of names in CSV folder.

Now what? where is the py file? and double clicking it? will it work? Apparently py files run through cmd prompt?

On Fri, Jun 2, 2023 at 12:59 AM Paresh Patel @.***> wrote:

I hope you have already used the program to convert the BSE code column to names. If not, please follow these steps: create two new folders on drive C and name them 'BSE' and 'CSV'. Place your BSE bhavcopy file in the 'BSE' folder and the 'name.csv' file in the 'CSV' folder (note that the folder names must be capitalized). Finally, double-click on the .py file, and that's it!

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1572656489, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7IXKJHFZMYYIILEYDTXJDUTLANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

pparesh25 commented 1 year ago

  1. Download the zip file from the following URL: BSE-Code-to-Name.zip.

    1. Extract the contents of the downloaded zip file.

    Inside the extracted folder, you will find two files: "name.csv" and "BSE-Code-to-Name.py".

    1. Create a folder named "CSV" in C: and place the "name.csv" file inside it.

    2. Create another folder named "BSE" in C: and place all the "bse-eq-bhavcopy.txt" files inside it.

    3. Ensure that Python is correctly installed on your system. If not, download and install Python from the official website (https://www.python.org/).

    4. If your Python installation is correct, navigate to the extracted folder and locate the "BSE-Code-to-Name.py" file.

    5. Double-click on the "BSE-Code-to-Name.py" file to run it. This script will process the files in the "BSE" folder and perform the desired changes.

    6. After running the script, check the files in the "BSE" folder to see if any changes have occurred.

    7. If the changes have not happened, you can try using Visual Studio Code (VS Code) as an alternative. Download and install VS Code from the official website (https://code.visualstudio.com/).

    8. Open VS Code, navigate to the extracted folder, and open the "BSE-Code-to-Name.py" file in the editor.

algaeginger commented 1 year ago

Hey Paresh,

Thanks a lot for the trouble.

Will also circulate it among trader groups so that it reaches more people.

Thanks again

regards

On Sat, Jun 3, 2023 at 12:57 AM Paresh Patel @.***> wrote:

1.

Download the zip file from the following URL: BSE-Code-to-Name.zip https://github.com/pparesh25/BSE-Code-to-Name/archive/refs/heads/main.zip .

  1. Extract the contents of the downloaded zip file.

    Inside the extracted folder, you will find two files: "name.csv" and "BSE-Code-to-Name.py".

  2. Create a folder named "CSV" in C: and place the "name.csv" file inside it.

  3. Create another folder named "BSE" in C: and place all the "bse-eq-bhavcopy.txt" files inside it.

  4. Ensure that Python is correctly installed on your system. If not, download and install Python from the official website ( https://www.python.org/).

  5. If your Python installation is correct, navigate to the extracted folder and locate the "BSE-Code-to-Name.py" file.

  6. Double-click on the "BSE-Code-to-Name.py" file to run it. This script will process the files in the "BSE" folder and perform the desired changes.

  7. After running the script, check the files in the "BSE" folder to see if any changes have occurred.

  8. If the changes have not happened, you can try using Visual Studio Code (VS Code) as an alternative. Download and install VS Code from the official website (https://code.visualstudio.com/).

  9. Open VS Code, navigate to the extracted folder, and open the "BSE-Code-to-Name.py" file in the editor.

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1574213569, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7MRMLMLXEBUZ7KI7GDXJI5DPANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

algaeginger commented 1 year ago

Hi Paresh ,

Yes, the work to add the name in BSE bhav copy has been completed though im yet to use NSE bhav copy-alternative. Is it something like bhavcopy, meaning fill in the date and click to download? Or a python procedure via cmd prompt? Thats always a bit intimidating :)

Cheers,

On Sat, Jun 3, 2023 at 11:11 PM Paresh Patel @.***> wrote:

Hey Paresh, Thanks a lot for the trouble. Will also circulate it among trader groups so that it reaches more people. Thanks again regards

Is your work done to add name in bse bhav copy? And also using nsebhavcopy-alternative?

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1575092011, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7JUO72OWUBINN2O7ATXJNZNBANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

iMakeBid commented 1 year ago

A New version of BID released which includes Open Interest and Series Filter. You can download from the link https://drive.google.com/drive/folders/1QYUXC-GJQRV5zRnC_SPLJ70Mq5yQY7UP?usp=share_link

pparesh25 commented 1 year ago

Hi Paresh , Yes, the work to add the name in BSE bhav copy has been completed though im yet to use NSE bhav copy-alternative. Is it something like bhavcopy, meaning fill in the date and click to download? Or a python procedure via cmd prompt? Thats always a bit intimidating :) Cheers,

If your installation of Python is proper, you can simply double-click on the 'Getbhavcopy-Eq-Ind.py' file. This action will automatically open the command prompt, where you will be prompted to enter the start date in the format YYYY-MM-DD, followed by the end date. Once you provide the dates, a new folder will be created on the C drive, and the data for the selected date range will be saved in that folder. I have renamed the NSE index names to match the name used in the old bhavcopy, and the data format is also consistent with the old bhavcopy. As a result, the databases created in Amibroker or Metastock using Heman sir's 'getbhavcopy' software can be updated seamlessly without requiring any modifications.

pparesh25 commented 1 year ago

A New version of BID released which includes Open Interest and Series Filter. You can download from the link https://drive.google.com/drive/folders/1QYUXC-GJQRV5zRnC_SPLJ70Mq5yQY7UP?usp=share_link

2023-05-07-NSE-EQ.txt 2023-05-14-NSE-EQ.txt 2023-05-21-NSE-EQ.txt 2023-05-28-NSE-EQ.txt 2023-06-04-NSE-EQ.txt what is this i don't understand

iMakeBid commented 1 year ago

what is this i don't understand

It is the bhavcopy file which has been processed for use in charting software. what is it that you do not understand? Can you elaborate?

iMakeBid commented 1 year ago

I have shifted the BID discussion. You can down load the update from here. https://github.com/iMakeBid/BID/issues/1#issuecomment-1579134275

algaeginger commented 1 year ago

Thanks for the update. Still at a loss. What is 'Imakebid' Two commits? This is what I'm seeing [image: image.png]

Whats to be done?

On Tue, Jun 6, 2023 at 10:28 PM iMakeBid @.***> wrote:

I have shifted the BID discussion. You can down load the update from here. iMakeBid/BID#1 (comment) https://github.com/iMakeBid/BID/issues/1#issuecomment-1579134275

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1579135583, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7LXGXYXFELNEAEEGK3XJ5OS7ANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

iMakeBid commented 1 year ago

You can click on the google drive link and download the app. Also the link to the app is below https://drive.google.com/drive/folders/1QYUXC-GJQRV5zRnC_SPLJ70Mq5yQY7UP?usp=share_link

pparesh25 commented 1 year ago

what is this i don't understand

It is the bhavcopy file which has been processed for use in charting software. what is it that you do not understand? Can you elaborate?

I believe all these dates are from Sundays, and I don't know since when nse started market on Sundays.

pparesh25 commented 1 year ago

Hi Paresh , Yes, the work to add the name in BSE bhav copy has been completed though im yet to use NSE bhav copy-alternative. Is it something like bhavcopy, meaning fill in the date and click to download? Or a python procedure via cmd prompt? Thats always a bit intimidating :) Cheers, … https://github.com/pparesh25/Getbhavcopy-alternative/blob/main/Video%20guide%20for%20downloading%20EOD%20data.txt

iMakeBid commented 1 year ago

Paresh there is some error on the NSE Server. It throws data for Saturday and Sunday. But I have updated my app and that has been rectified from the app siode., Probably NSE are still working on the new server and hope they will correct the same.

iMakeBid commented 1 year ago

Hi Paresh , Yes, the work to add the name in BSE bhav copy has been completed though im yet to use NSE bhav copy-alternative. Is it something like bhavcopy, meaning fill in the date and click to download? Or a python procedure via cmd prompt? Thats always a bit intimidating :) Cheers, … https://github.com/pparesh25/Getbhavcopy-alternative/blob/main/Video%20guide%20for%20downloading%20EOD%20data.txt

NIce work Paresh. I saw the video. Your app seems to do the works well. Keep it up.

algaeginger commented 1 year ago

I got this when I loaded the utility

[image: image.png]

cannot connect to NSE server. This application needs an active internet connection. Re-installed but its the same result

On Thu, Jun 8, 2023 at 10:46 AM iMakeBid @.***> wrote:

Hi Paresh , Yes, the work to add the name in BSE bhav copy has been completed though im yet to use NSE bhav copy-alternative. Is it something like bhavcopy, meaning fill in the date and click to download? Or a python procedure via cmd prompt? Thats always a bit intimidating :) Cheers, … <#m-931942055295554258>

https://github.com/pparesh25/Getbhavcopy-alternative/blob/main/Video%20guide%20for%20downloading%20EOD%20data.txt

NIce work Paresh. I saw the video. Your app seems to do the works well. Keep it up.

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1581904547, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7I52V6UIJZ73HX745TXKFN3JANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

iMakeBid commented 1 year ago

Please check your internet connection. This error is displayed with the app is unable to connect to NSE server. Also please check if you are able to access the NSE website. Are you using vpn or any firewall?

algaeginger commented 1 year ago

No, I am not using vpn or any firewall . Watching jio, youtube, sending and receiving mail on the same fibre net. only this app has an issue

iMakeBid commented 1 year ago

Oh.. I tried on jio using mobile hotspot and It works fine. I believe no other user have got this issue. Maybe you can try a few times or I request you please check with your interenet service provider.

algaeginger commented 1 year ago

Ok, I will try.

On Fri, Jun 9, 2023 at 12:17 PM iMakeBid @.***> wrote:

Oh.. I tried on jio using mobile hotspot and It works fine. I believe no other user have got this issue. Maybe you can try a few times or I request you please check with your interenet service provider.

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1584060895, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7KEWSKICVBCMBC47T3XKLBJLANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>

algaeginger commented 1 year ago

Hello Paresh,

Have you an iBid version that downloads BSE bhav ? Please let me know. And if the NSE version could include BE BQ .

Thanks

On Sun, Jun 11, 2023 at 4:58 PM Algae Ginger @.***> wrote:

Ok, I will try.

On Fri, Jun 9, 2023 at 12:17 PM iMakeBid @.***> wrote:

Oh.. I tried on jio using mobile hotspot and It works fine. I believe no other user have got this issue. Maybe you can try a few times or I request you please check with your interenet service provider.

— Reply to this email directly, view it on GitHub https://github.com/hemenkapadia/getbhavcopy/issues/234#issuecomment-1584060895, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOJ7V7KEWSKICVBCMBC47T3XKLBJLANCNFSM6AAAAAAYRAAKGU . You are receiving this because you authored the thread.Message ID: @.***>