search

amikos-tech / chromadb-data-pipes

ChromaDB Data Pipes 🖇️ - The easiest way to get data into and out of ChromaDB
https://datapipes.chromadb.dev/
MIT License
8 stars 1 forks source link

What if the huggingface dataset has more parameters? E.g., subset #139

Closed chunthebear closed 3 months ago

chunthebear commented 3 months ago

I do not think cdp handles additional config parameters, e.g. a subset of a HF dataset. Any help is appreciated!

chunthebear commented 3 months ago

Figured out, had to modify the source codes a bit.

tazarov commented 3 months ago

the import/export commands have a bunch of params to map features from/to the datasets.

chunthebear commented 3 months ago

The config parameter is missing. I added it in my repo: https://github.com/chunthebear/chromadb-data-pipes