omines / datatables-bundle

DataTables bundle for Symfony
https://omines.github.io/datatables-bundle/
MIT License
260 stars 114 forks source link

Exporting a large dataset #312

Closed Filoz closed 11 months ago

Filoz commented 1 year ago

Hello everyone, I have a table with about 1 000 000 records.

I would like to export the datas via symfony messenger so that I can generate the xls in asynch.

The current method for the export ( https://github.com/omines/datatables-bundle/blob/031d134b9762a1fe1d4c32484c5eded2621f2cef/src/Exporter/DataTableExporterInterface.php#L25 ) passes an iterator as argument so I don't think I could take advantage of the current export system.

Do you have any suggestions on how I could proceed?

thank you!

github-actions[bot] commented 11 months ago

Stale issue message

curry684 commented 11 months ago

You should completely ignore this bundle and implement the export and download logic elsewhere. This bundle is about rendering data to a client via a webbrowser, which for practical reasons is limited to tens of thousands of rows.

Exporting/managing millions of rows should just be dedicated functionality elsewhere outside of the display logic, which is all this bundle is.