Village data collection

[dhruv-1001]

Visit onlinemaps.surveyofindia.gov.in Update your profile.

Select Click to buy

Select State & Dist you want to download data for. Keep adding till you have added all the districts for a state.

Place order on next screen. Download data one-by-one.

Data downloaded will be in .zip format, with file names as such

• Village Boundary Database.zip
• Village Boundary Database (1).zip
• Village Boundary Database (2).zip
• ... and so on

Extract these files You will have .gdb folders for districts you have downloaded as such

• AGRA.gdb
• ALIGARH.gdb
• PRAYAGRAJ.gdb
• ... and so on

Now convert these files to .zip, to have files like this

• AGRA.zip
• ALIGARH.zip
• PRAYAGRAJ.zip
• ... and so on .zip to be created using this tool.

Now that you have .zip files for all districts of a state. You now need to upload these files to this repository using git lfs.

How to upload .zip files using git lfs

Make sure you have git lfs installed. Follow instructions provided here.

Once you have installed git lfs. Add everything you have downloaded, inside server/geojson-data/indian_village_boundaries.zip/ folder inside of a folder named after the state you have downloaded village data for. Following the example above, it would look like such.

• indian_village_boundaries.zip
  • uttar_pradesh
    • AGRA.zip
    • ALIGARH.zip
    • PRAYAGRAJ.zip

Once you have files in this file structure, follows this documentation to add downloaded files using git lfs.

Once you are done, open up a PR to this repository

List to track data collection progress

• [x] #37
• [ ] ANDHRA PRADESH
• [ ] #76
• [x] #59
• [x] BIHAR
• [x] #100
• [x] #71
• [x] #62
• [x] GOA
• [x] GUJARAT
• [x] #104
• [x] #77
• [ ] JAMMU AND KASMIR
• [x] #61
• [x] KARNATAKA
• [x] KERALA
• [x] #73
• [x] #39
• [x] MAHARASHTRA
• [ ] #111
• [ ] #75
• [ ] #47
• [ ] NAGALAND
• [x] ODISHA
• [x] #50
• [x] #40
• [x] RAJASTHAN
• [x] SIKKIM
• [x] #36
• [ ] TELANGANA
• [ ] THE DADRA AND NAGAR HAVELI AND DAMAN AND DIU
• [ ] #46
• [x] #38
• [x] #48
• [x] #45

Note: Comment on this issue if you are interested. And i'll create and assign the state ticket for you.

[sagarkori143]

Hi @dhruv-1001 👋 I want to work on this. Please assign this to me. Thanks!

[jainvedant392]

Hey @dhruv-1001 , I would like to contribute to this issue. Could I start working on it?

[younome71]

Hey @dhruv-1001, I would like to contribute to this issue

[the-dg04]

Hey @dhruv-1001 , I would like to contribute to this issue. Can you please assign it to me?

[ChakshuGautam]

Hey please raise PRs state-wise we will merge them as they are ready. Thanks.

Please don't wait for it to be assigned.

[dhruv-1001]

Hey all, just mention for what states you will be uploading the data for. So that everyone have a different state.

[kumarguddu609]

Hey @dhruv-1001 I am doing BIHAR

[dhruv-1001]

Please select the one that we don't already have data for. Do refer the checklist.

[kumarguddu609]

okay

[Biswapremsahu77]

Hey @dhruv-1001 i want to work on this, and i can take tamil nadu.

[the-dg04]

Hey @dhruv-1001 i would like to do Andaman and Nicobar

[sagarkori143]

Ok @dhruv-1001 . I am taking the UP 🤩

[masterismail]

will do it for Telangana !

edit : data isn't available for any district of Telangana

[rd-sharma7]

@dhruv-1001 I checked a checklist & Will upload data for Madhya Pradesh. inlast can I mention you ,if a doubt pop up there on comment or discord??

[sagarkori143]

Hey @dhruv-1001 . I am not able to locate this folder

Can you please help me in uploading the data

[dhruv-1001]

@sagarkori143, it doesn't exists. Just create dir along this path ./server/geojson-data/indiain_village_boundaries.zip/

[sagarkori143]

Okay Dhruv! Thanks!

[vilol-04]

hey @dhruv-1001 . I am interested to work on this issue. I'll be working for Chandigarh.

[kumarguddu609]

Hey @dhruv-1001 It gets error: can not upload new objects to public fork, when try to push git LFS objects to forked repository as github says

You can push Git LFS objects to public forks if the repository network already has Git LFS objects or you have write access to the root of the repository network. https://github.com/git-lfs/git-lfs/issues/1906

[younome71]

Hey @dhruv-1001, I will do for Punjab

[dhruv-1001]

will do it for Telangana !

edit : data isn't available for any district of Telangana

You can go ahead with some other state!

[dhruv-1001]

Hey @dhruv-1001 It gets error: can not upload new objects to public fork, when try to push git LFS objects to forked repository as github says

You can push Git LFS objects to public forks if the repository network already has Git LFS objects or you have write access to the root of the repository network. git-lfs/git-lfs#1906

It seems to work for me. Here is an example PR. Can you list out what all steps are you following?

[kumarguddu609]

Hey @dhruv-1001 The steps as follows:

1. As I have downloaded all the DISTRICTS of a state and converted the district file like AGRA.gdb to AGRA.zip , similary for all the districts, then created a folder of that state naming like uttar_pradesh . and zipped it all to indian_village_boundaries.zip.
2. Forked this repository and opened it locally using gitBash.
3. Opened Git Bash. Changed the current working directory to an existing repository use with Git LFS.
4. Created a new branch for adding village_boundaries as branch name. and change the working branch to new one.
5. Used *_git lfs track ".zip"_** for initializing git LFS to track .zip files
6. Then moved to server folder and maked a folder mkdir geojson-data and copy the entire indian_village_boundaries.zip file to the current working folder that is in the geojson-data.
7. Also here in the .gitingore file, I have removed the **/server/geojson-data/*** so that it gets added in commits. (When I don't change that it gets successfully pushed).
8. Now staged all files to commmit locally, it gets committed successfully.
9. When I try to push the newly branch to the forked repository, gets error can not upload new objects to public fork

Here I want to ask, should I remove **/server/geojson-data/*** from .gitignore or not. When it added, it doen't have any error and when it is added for push and removed from .gitignore, it is causing problem. and since you are collaborator, you can easily push gitLFS to this repository.

[sagarkori143]

hey @dhruv-1001 Is this path or formatting okay?

and should i remove geojsondata from gitignore ?

[Ashurajput02]

@dhruv-1001 seems cool and interesting. Would love to provide the details about the villages and districts in West UP and haryana which are not much known and the data about them on the internet is also very less like Kiratpur, bijnor, najibabad, and many more. Can I start working sir.

[zeel991]

Hey @dhruv-1001 , can I work for Uttarakhand , I have already gathered the data for the respective state , can you assign it to me so I can start working on it?

[kumarguddu609]

hey @sagarkori143 The folder structure should be like this server > geojson-data > indian_village_boundaries.zip > uttar_pradesh > AGRA.zip

[kumarguddu609]

Hey @dhruv-1001 , can I work for Uttarakhand , I have already gathered the data for the respective state , can you assign it to me so I can start working on it?

https://github.com/ChakshuGautam/geoip/issues/28#issuecomment-1918543673

[Ashurajput02]

Cool @kumarguddu609 starting to work on this. Thanks for highlighting

[Ashurajput02]

@sagarkori143 your commit seems fine bro

[sagarkori143]

@dhruv-1001 I would like to do it for Tripura and Mizoram also.

[kumarguddu609]

Hey @dhruv-1001 I would like to do WEST BENGAL also. Can you open the issue for it also.

[kumarguddu609]

Hey @dhruv-1001 raised PR for PUDUCHERRY also. Please open issue for that also.

[AlgoFoe]

Hey @dhruv-1001 ,I will take Andaman and Nicobar as I have already gathered the respective data ,can you please assign it to me?

[naina35]

hey @dhruv-1001 can i do it for Punjab..

[sagarkori143]

hey @dhruv-1001 can i do it for Punjab..

hey @naina35 someone has already taken punjab. Better choose another one 👍

[SarveshAtawane]

Hey @zeel991 sorry I didnt saw you took UK state I made a PR for thar state. Please can you choose another state.

[naina35]

hey @dhruv-1001 since Punjab is already taken can i do it for Assam

[Astitva1508]

Hey @dhruv-1001 i would like to do Himachal Pradesh. Please assign.

[sagarkori143]

Hey @dhruv-1001 as Tripura and Mizoram data is not available right now. So I am looking forward to add data for Delhi and Jharkhand. Please open a new issue and assign it to me. Thanks! 🙂

[Gauravdcap]

Hi @younome71 i didnt know punjab was taken (sorry). I have already made a pull request can you pick another one :sweat_smile: .

[jainvedant392]

Hey @dhruv-1001 , I am doing Meghalaya and Arunachal Pradesh.

[jainvedant392]

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

[rd-sharma7]

Hey @dhruv-1001 , I just stuck while pushing a geojson-data folder inro server , I already added this folder haiving all district data on my laptop folder you can see a tree of it there:

I don't know why in tree ,files of Madhya_Pradesh folder not present I added.

[sagarkori143]

Hey @dhruv-1001 , I just stuck while pushing a geojson-data folder inro server , I already added this folder haiving all district data on my laptop folder you can see a tree of it there:

I don't know why in tree ,files of Madhya_Pradesh folder not present I added.

Check out the git ignore file if you are ignoring these files while pushing.

[rd-sharma7]

Thanks @sagarkori143 . your hint worked.

[jainvedant392]

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

[jainvedant392]

Hey @dhruv-1001 , I have created the PR for Haryana state. It would be delightful if you could make an issue for it and also attach the C4GT community label to it. Thank you.

[dhruv-1001]

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

Data for meghalaya & arunanchal pradesh is now available. Comment on tickets, and i'll assign those issues to you. Edit: just checked, it says product is not available. Will have to wait until it's available.

[Biswapremsahu77]

Hey @dhruv-1001 i can do meghalaya and arunachal pradesh. You can assign it to me