search

pgadmin-org / pgadmin4

pgAdmin is the most popular and feature rich Open Source administration and development platform for PostgreSQL, the most advanced Open Source database in the world.
https://www.pgadmin.org
Other
2.45k stars 643 forks source link

More than 500MB of data can not be downloaded from the pgAdmin (RM #5272) #3369

Open dpage opened 4 years ago

dpage commented 4 years ago

Issue migrated from Redmine: https://redmine.postgresql.org/issues/5272 Originally created by ivan khilitsky at 2020-03-18 15:21:05 UTC.

OS: Windows 10. More than 500MB of data can not be downloaded from the pgAdmin. When I try to download more than 500MB (about 500MB download takes 6-8 minutes) I take an empty file or 524 error.

dpage commented 4 years ago

Comment migrated from Redmine: https://redmine.postgresql.org/issues/5272#note-1 Originally created by Akshay Joshi at 2020-03-20 11:29:24 UTC.

Redmine ticket header update:

Name Old Value New Value
Fixed Version changed 4.19
dpage commented 4 years ago

Comment migrated from Redmine: https://redmine.postgresql.org/issues/5272#note-2 Originally created by Khushboo Vashi at 2020-04-03 10:25:55 UTC.

Redmine ticket header update:

Name Old Value New Value
Assigned To changed Fahar Abbas
Sprint changed squash
dpage commented 4 years ago

Comment migrated from Redmine: https://redmine.postgresql.org/issues/5272#note-3 Originally created by Ashesh Vashi at 2020-04-21 12:54:05 UTC.

Akshay - As other members are busy, let some other member tests this to understand its current state.

Redmine ticket header update:

Name Old Value New Value
Assigned To changed Fahar Abbas Akshay Joshi
dpage commented 4 years ago

Comment migrated from Redmine: https://redmine.postgresql.org/issues/5272#note-4 Originally created by Akshay Joshi at 2020-04-22 05:23:40 UTC.

Redmine ticket header update:

Name Old Value New Value
Assigned To changed Akshay Joshi
dpage commented 4 years ago

Comment migrated from Redmine: https://redmine.postgresql.org/issues/5272#note-5 Originally created by Akshay Joshi at 2020-04-29 09:13:58 UTC.

Redmine ticket header update:

Name Old Value New Value
Sprint changed squash Ready
luber commented 1 year ago

It looks like pgAdmin loads the file into memory before serving the Download file request...

image
adityatoshniwal commented 1 year ago

Please check https://github.com/pgadmin-org/pgadmin4/issues/5670#issuecomment-1386448083.

jolowicz commented 7 months ago

Hello,

I don't know if this is the same problem but when using Firefox, I can download bigger files but at a certain size (over 700 mo with over 7 millions results) no file is downloaded and I see the "out of memory error" in PgAdmin. When I check the memory usage the memory is not saturated on the server.

Adventurer2021 commented 6 months ago

Does anyone have a solution to download the data to CSV in the form of an SQL COPY statement? Just need to know how to get around this bug for large data results from a query. I'm thinking I need to create a table as a last statement in the query, then use the COPY TO csv file. But I can't figure out where to but this SQL commands in the query.

stelmath commented 2 months ago

Same here on the latest Pgadmin version for Windows v8.10

Adventurer2021 commented 1 month ago

pgAdmin4 V8.11 still has this issue. As a work-around, I've had to install SQL WorkBench It runs under Java and not a Chromium based solution (I guess).

SQL Workbench/J The free DBMS-independent database tool Build 130 (2023-11-19 17:52) Java Version: 17.0.7 (64bit) Copyright 2002-2023 Thomas Kellerer www.sql-workbench.eu support@sql-workbench.eu Built with Apache NetBeans (netbeans.apache.org) The editor is based on jEdit's 2.2.2 syntax highlighting package Licensed under a modified Apache 2.0 license