PHPOffice / PHPExcel

ARCHIVED
Other
11.46k stars 4.2k forks source link

Can't process large file #1344

Open lwoods opened 6 years ago

lwoods commented 6 years ago

I tried using the "Chunked" version of the example on a large xls file. I am blowing up with memory allocation. It looks like the complete file is loaded and then the chunking begins. Is this true and, if so, any way around loading a large file into limited ( 67 Meg ) memory?

Thanks

Adorfer commented 6 years ago

sorry, but there is -afaik- none. You need aprox. 4-6 times the memory as the size of the uncompressed file.

code05-hello commented 6 years ago

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

lwoods commented 6 years ago

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala notifications@github.com wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1cdbde00e3deb78a, or mute the thread https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

code05-hello commented 6 years ago

No, I mean you should take the process offline (on your local pc) and not on the server. I hope it helps.

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎21‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala notifications@github.com wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1cdbde00e3deb78a, or mute the thread https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

lwoods commented 6 years ago

That would defeat the purpose. I am trying to take all action away from the client because they are not computer-literate. My goal was "Click, and Done!"

On Tue, Nov 7, 2017 at 1:54 PM, Kalim M Puthawala notifications@github.com wrote:

No, I mean you should take the process offline (on your local pc) and not on the server. I hope it helps.

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎21‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala < notifications@github.com> wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87 051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice% 2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946& userId=1611542&signature=1cdbde00e3deb78a <https://mailtrack.io/trace/link/4acabdf6071bd2ab1592e53daf62ed1002c3f290?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1d628469fcabe9d7>,

or mute the thread https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813 330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications% 2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA- gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c <https://mailtrack.io/trace/link/68c3735e2e20992581b453de02ade04b7fcd87a0?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=17c37078f902f6c8>

.

--

Office: 623-556-8949 <(623)%20556-8949> Cell: 602-369-5049 <(602)%20369-5049>

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/05c863566f6e062e4d8cecd599899b85d36c6e5f?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342618851&userId=1611542&signature=9f73780c19e2212d, or mute the thread https://mailtrack.io/trace/link/076f828e5befcdaaa810029290720aaa22c2a64f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2fRQBSjKErCYKpYf8qf7M4wAa5rsks5s0MOggaJpZM4QSEjr&userId=1611542&signature=301b563a8b741aca .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

Adorfer commented 6 years ago

@kalimputhawala "timeout" sounds like a different issue than "out of memory". i can't follow your recommendations.

code05-hello commented 6 years ago

In php.ini file increase the memory, memory_limit= 64M

https://www.drupal.org/docs/7/managing-site-performance-and-scalability/changing-php-memory-limits

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎33‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

That would defeat the purpose. I am trying to take all action away from the client because they are not computer-literate. My goal was "Click, and Done!"

On Tue, Nov 7, 2017 at 1:54 PM, Kalim M Puthawala notifications@github.com wrote:

No, I mean you should take the process offline (on your local pc) and not on the server. I hope it helps.

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎21‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala < notifications@github.com> wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87 051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice% 2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946& userId=1611542&signature=1cdbde00e3deb78a <https://mailtrack.io/trace/link/4acabdf6071bd2ab1592e53daf62ed1002c3f290?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1d628469fcabe9d7>,

or mute the thread https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813 330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications% 2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA- gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c <https://mailtrack.io/trace/link/68c3735e2e20992581b453de02ade04b7fcd87a0?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=17c37078f902f6c8>

.

--

Office: 623-556-8949 <(623)%20556-8949> Cell: 602-369-5049 <(602)%20369-5049>

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/05c863566f6e062e4d8cecd599899b85d36c6e5f?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342618851&userId=1611542&signature=9f73780c19e2212d, or mute the thread https://mailtrack.io/trace/link/076f828e5befcdaaa810029290720aaa22c2a64f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2fRQBSjKErCYKpYf8qf7M4wAa5rsks5s0MOggaJpZM4QSEjr&userId=1611542&signature=301b563a8b741aca .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

dalecosp commented 6 years ago

Hi lwoods. I've successfully written large Excel files with PHPExcel on FreeBSD; I set PHP's "max_execution_time" high (I used 86400 [one hour]) in the script and memory_limit=1024M in PHP.ini.

In PHPExcel, we use PHPExcel_CachedObjectStorageFactory::cache_to_discISAM, per the docs. Problem there is that very large files fill up a lot of disk space (been working on one lately that's over 2GB, and that one is giving us some trouble).

Hope this helps ....

lwoods commented 6 years ago

Thanks for the reply, Kevin,

My file is 6 Meg!!!

On Thu, Nov 16, 2017 at 1:12 PM, Kevin Kinsey notifications@github.com wrote:

Hi lwoods. I've successfully written Excel files in excess of 1GB with PHPExcel on FreeBSD; I set PHP's "max_execution_time" high (I used 86400 [one hour]) in the script and memory_limit=1024M in PHP.ini.

In PHPExcel, we use PHPExcel_CachedObjectStorageFactory::cache_to_discISAM, per the docs.

I have had trouble with a TWO GB file though ;-)

Hope this helps ....

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/ed1a71a1c3d47c42736bea48de7ca7099e8421f1?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-345048447&userId=1611542&signature=d8c04235c41bd80d, or mute the thread https://mailtrack.io/trace/link/3a8d7eb22397d65ffd49804162a1380c1f1d3482?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2UwVZOOGwdwFGQwabRyjygrHCoL6ks5s3JdBgaJpZM4QSEjr&userId=1611542&signature=5cbd189d5e35ce05 .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

lwoods commented 6 years ago

I guess I was trying to be lazy. I used to tear about Access databases at the hex level so I guess ripping up an Excel spreadsheet will not be much harder. Here I go!

On Thu, Nov 16, 2017 at 1:12 PM, Kevin Kinsey notifications@github.com wrote:

Hi lwoods. I've successfully written Excel files in excess of 1GB with PHPExcel on FreeBSD; I set PHP's "max_execution_time" high (I used 86400 [one hour]) in the script and memory_limit=1024M in PHP.ini.

In PHPExcel, we use PHPExcel_CachedObjectStorageFactory::cache_to_discISAM, per the docs.

I have had trouble with a TWO GB file though ;-)

Hope this helps ....

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/2e2e414c28f656ef98d6cc41c20cfb76bf2b3356?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-345048447&userId=1611542&signature=8ba5d1adc439a4b4, or mute the thread https://mailtrack.io/trace/link/58eecc57d79177b210be3ae8eb802c7d4e700faf?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2UwVZOOGwdwFGQwabRyjygrHCoL6ks5s3JdBgaJpZM4QSEjr&userId=1611542&signature=0266f40f267ee5e6 .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.