Open CShorten opened 2 months ago
Hey team, this notebook contains some more investigations into this idea of Weaviate Collections <> HuggingFace Dataset Hub or JSON files - https://github.com/weaviate/recipes/blob/main/weaviate-features/crud-apis/research/weaviate-collection-interoperability.ipynb
What?
Get the objects from a Collection in Weaviate and to a local JSON file.
Why?
This helps with quick experimentation, maybe other use cases.
How?
Thinking this API:
That pretty much just wraps the cursor API,
And then dumps the JSON file with the
savepath
.Maybe also makes the
json
Python library another dependency of Weaviate's Python Client (if not already).