huggingface / datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

https://huggingface.co/docs/datasets

Apache License 2.0

19.28k stars 2.7k forks source link

Raise error for incorrect JSON serialization #7273

Closed varadhbhatnagar closed 3 days ago

varadhbhatnagar commented 2 weeks ago

Raise error when lines = False and batch_size < Dataset.num_rows in Dataset.to_json().

Issue: #7037

Related PRs:

7039 #7181

varadhbhatnagar commented 2 weeks ago

PTAL @lhoestq @albertvillanova

HuggingFaceDocBuilderDev commented 3 days ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.