fastnlp / fastNLP

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
https://gitee.com/fastnlp/fastNLP
Apache License 2.0
3.06k stars 450 forks source link

[疑问][建议]话说为什么DataSet不支持List[Dict]的data?建议像huggingface 的Dataset那样支持一下? #427

Open iamqiz opened 1 year ago

iamqiz commented 1 year ago

fastNLP不支持

from fastNLP import DataSet
ds=[{"name":"aa","age":21},{"name":"bb","age":22},{"name":"cc","age":19}]
data_set = DataSet(ds)

huggingface 的Dataset支持

from datasets import Dataset
ds=[{"name":"aa","age":21},{"name":"bb","age":22},{"name":"cc","age":19}]
dataset = Dataset.from_list(ds)

希望能支持

x54-729 commented 1 year ago

谢谢您的建议!我们会在之后添加对这种初始化方式的支持