astronomy-commons / lsdb

Large Survey DataBase
https://lsdb.io
BSD 3-Clause "New" or "Revised" License
13 stars 3 forks source link

Documentation: highlight that from_dataframe is not for large datasets #376

Closed hombit closed 1 month ago

hombit commented 1 month ago

We should highlight that from_dataframe() is not designed for large datasets (>~1M rows) and that hipscat-import should be used instead. This should go to both docstring and RTD

smcguire-cmu commented 1 month ago

This would also be good as a warning when we run from_dataframe to check the size of the input data frame and raise a warning if it's large.

camposandro commented 1 month ago

This has been completed by #379.