huggingface / dataset-viewer

Lightweight web API for visualizing and exploring any dataset - computer vision, speech, text, and tabular - stored on the Hugging Face Hub
https://huggingface.co/docs/datasets-server
Apache License 2.0
640 stars 65 forks source link

Pass copies of DataFrames instead of views #2903

Closed albertvillanova closed 2 weeks ago

albertvillanova commented 3 weeks ago

As the memory leak may be caused by improperly de-referenced objects, better pass copies of DataFrames instead of views.

In a subsequent PR I could try to optimize memory usage by not storing unnecessary data.

albertvillanova commented 2 weeks ago

Superseded by: