project-open-data / project-open-data.github.io

Open Data Policy — Managing Information as an Asset
https://project-open-data.cio.gov/
Other
1.33k stars 585 forks source link

Federal open ArcGIS data from the top down #609

Open Jelfff opened 6 years ago

Jelfff commented 6 years ago

Problem: To the best of my knowledge there is no list showing the 'top' endpoint of federal ArcGIS servers with open data.

Solution: I made such a list and am curating it. Here it is: https://mappingsupport.com/p/surf_gis/list-federal-GIS-servers.pdf

If anyone knows about a federal ArcGIS server with open data that is not yet on the list, please let me know. You can email me via this contact page: https://mappingsupport.com/p/gmap4_contact.html

BTW, I also made a list of the 'top' endpoint for state ArcGIS servers with open data. https://mappingsupport.com/p/surf_gis/list-state-GIS-servers.pdf

Joseph Elfelt

gbinal commented 6 years ago

Hi @Jelfff - that's a neat project.

I'm not able to cross reference them but if you take a quick CMD+F look through this list of APIs that I manage, there's a number there as well.

Also, if you haven't done this already, skimming through the first 10-20 pages of search results for a google query of site:.gov/arcgis turns up a lot. Yeah, you have to filter out the non-federal websites but it still is a quick and dirty payload. Same with the search results for arcgis site:.gov.

Jelfff commented 6 years ago

Thanks Gray. I searched your list on "rest/services" and was able to add a couple to my federal list. I will post an updated list tomorrow a.m.

My main google search is _____ "rest/services" Replace the underline with something and include the quotes. I tried your first search and went through several pages but did not find anything new.

JJediny commented 6 years ago

@Jelfff Haven't checked these sources in a long time, but i did a similar project before joining GSA:

but the best way would be to use the agency provided data from data.gov and filter by esri rest: https://catalog-bsp.data.gov/dataset?res_format=Esri+REST&_res_format_sortAlpha=asc&_res_format_limit=0 or https://catalog.data.gov/api/3/action/package_search?q=%28res_format=Esri+REST

Only suggestion here would be to refrain from using PDFs to share open data sets; a csv or json file would be most helpful to others for sharing/parsing

Jelfff commented 6 years ago

Thanks John! I picked up several new federal ArcGIS servers from your list. I will post an updated list in the morning tomorrow.

MappingSupport commented 5 years ago

My work to locate government GIS server addresses has greatly expanded.

If you are looking for government GIS data anywhere in the USA then you might want to take a look at this list I curate as a public service. The list now has 1,400+ addresses for ArcGIS servers from the federal level down to the city level.

Worried about dead links? Got that covered with a weekly automated scan (my own code) of every server address. I expect there will be some tweaks to the list each week.

PDF file: https://mappingsupport.com/p/surf_gis/list-federal-state-county-city-GIS-servers.pdf

If you would rather grab a text file then just change the above link to “.txt”