I-GUIDE / CI_Platform

iGUIDE CI Platform Deployment
Apache License 2.0
0 stars 0 forks source link

Platform Kernels - Geopanda's not working #26

Open fbaig opened 3 months ago

fbaig commented 3 months ago

Problem Default kernel is Python 3 only without any GIS No GeoPanda's No Matplotlib

iguide kernel GeoPanda's is corrupted? Strange

guide-ewd kernel Geopanda's cannot read from remote URL

Code

r'https://www2.census.gov/geo/tiger/TIGER2019/STATE/tl_2019_us_state.zip    '
states = gpd.read_file(url_states)

Error DriverError: '/vsizip/vsicurl/https://www2.census.gov/geo/tiger/TIGER2019/STATE/tl_2019_us_state.zip' does not exist in the file system, and is not recognized as a supported dataset name.

Possible Solution: Instead of creating separate kernels, is it advisable to reuse CyberGISX kernels? @nosolls Mount CyberGISX CVMFS kernels. Run script to make those kernels available

rkalyanapurdue commented 3 months ago

I think the iguide kernel has some custom packages that weren't available in CyberGISX to get some notebooks to run. We may need to compare the two if we want to go down that route.

fbaig commented 3 months ago

Can we have both CyberGISX's kernels and have iguide kernels as well?

rkalyanapurdue commented 3 months ago

@nosolls we have geopandas v0.13.0 on the platform; i just checked and version 0.13.2 seems to run this code fine. Can you upgrade the geopandas version?

nosolls commented 3 months ago

Sorry about the slow update on this one. The bug with geopandas has been fixed. iguide and iguide-ewd will work with that code. We'll have a much faster way of dealing with these issues once we have a repo up for fixing/installing new packages for CVMFS.

I'll comment on a few things here. The default Python 3 kernel was not supposed to have any extra packages installed. We can add packages here, but we'd need a list of GIS packages we would want.

I spoke to Alex about adding the CyberGIS kernels to I-GUIDE. It is possible to add them. But we're wanting to add versions to the I-GUIDE kernels, and those would be the backup kernels. So the CyberGIS kernels would really act as transitions from CyberGIS to I-GUIDE instead of backup kernels.

I plan on adding the CyberGIS kernels in addition to the versioned I-GUIDE kernels. May need to scale up the CVMFS storage.