Quick question, What do you recommend as the best way of saving large amounts data, > then 3 Gigs, pulled from Bloomberg to disk? Currently I am doing Data.to_hdf(), but that is really slow and uses a lot of memory to write the file, also it sometimes crashes python. Are you familiar with more efficient options to save the data?. Thanks in advance.
Quick question, What do you recommend as the best way of saving large amounts data, > then 3 Gigs, pulled from Bloomberg to disk? Currently I am doing Data.to_hdf(), but that is really slow and uses a lot of memory to write the file, also it sometimes crashes python. Are you familiar with more efficient options to save the data?. Thanks in advance.