Size limit when using postgis data source - Githubissues

qgis / QGIS

QGIS is a free, open source, cross platform (lin/win/mac) geographical information system (GIS)

https://qgis.org

GNU General Public License v2.0

10.52k stars 2.99k forks source link

Size limit when using postgis data source #16342

Open qgib opened 11 years ago

qgib commented 11 years ago

Author Name: Alex Mandel (Alex Mandel) Original Redmine Issue: 7369

Redmine category:processing/saga Assignee: Victor Olaya

My layer that I want to run IDW on in postgis is 3.6G. Sextante trying to write this out to a temp shapefile on the system before passing to SAGA is a huge problem that will never work because the dbf table exceeds the 2 G limit. I let it run for 8 hours and if never seems to finish even making the shp. So this may be a SAGA bug for requiring shp input but we need to find a way to allow passing large data to analysis algorithms with a memory provider or using postgis directly. I have 32 G of RAM and am on 64 bit Ubuntu.

Related issue(s): #17058 (relates) Redmine related issue(s): 8249

qgib commented 11 years ago

Author Name: Victor Olaya (@volaya)

I am afraid there is nothing we can do for that. SAGA supports those formats, and it is a limitation of the software. The only solution is to develope new things in saga...

status_id was changed from Open to Feedback

qgib commented 11 years ago

Author Name: Alex Mandel (Alex Mandel)

Victor Olaya wrote:

I am afraid there is nothing we can do for that. SAGA supports those formats, and it is a limitation of the software. The only solution is to develope new things in saga...

What about warning users that an operation may not finish, or that it failed because the layer is too big for shp. Mine just sat locked up all night.

qgib commented 10 years ago