chengchingwen / Pickle.jl

An experimental package for loading and saving object in Python Pickle format.
MIT License
50 stars 9 forks source link

the loaded file does not quite look like the file loaded in python #26

Open CaiYitao opened 2 years ago

CaiYitao commented 2 years ago

loaded file by Pickle in Julia

image

the loaded pickle file in python

image
chengchingwen commented 2 years ago

The Defer type is a used to analysis unknown python types, the torch_geometric.data.data.Data in your case. We would need to define a custom mapping for converting the torch_geometric.data.data.Datainto similar Julia type. I never use torch_geometric, but it looks like a data type for storing graph data for GNN models?

cc @yuehhua, Do you have any thoughts on the Data type? I guess we already have some similar graph type in one of those graph packages.

yuehhua commented 2 years ago

It seems that the Data class is quite similar to FeaturedGraph I build in GraphSignals.jl. Mwanwhile, I am curious about the dataset you want to load. I am also working on GraphMLDatasets.jl. I can support the dataset you want for you.

CaiYitao commented 2 years ago

my dataset comes from this package ConfGF It is preprocessed qm9 dataset. the dataset is about molecular conformation.

It would be great if we can add such functionalities into Pickle and GraphMLDatasets in Julia.

Thanks for your great work!

yuehhua commented 2 years ago

It is better to support qm9 dataset in GraphMLDatasets in Julia. I will support naive qm9 dataset, and you can check yuehhua/GraphMLDatasets.jl#29