search

datafusion-contrib / datafusion-objectstore-hdfs

HDFS based on Java implementation as a remote ObjectStore for DataFusion
Apache License 2.0
8 stars 8 forks source link

the trait `object_store::ObjectStore` is not implemented for `HadoopFileSystem` #15

Open smallzhongfeng opened 11 months ago

smallzhongfeng commented 11 months ago

It seems that there is a problem after upgrading to version 0.1.4 today, and now it affects the packaging of datafusion.

smallzhongfeng commented 11 months ago

@yahoNanJing

yahoNanJing commented 11 months ago

Thanks for reporting this. I'll have a check today.

yahoNanJing commented 11 months ago

Hi @smallzhongfeng, have you customize your own datafusion? The community version of the datafusion does not depend on this crate, right?

For ballista, I have just updated the dependency version of this crate to deal with the interface change of the ObjectStore

iajoiner commented 11 months ago

Same issue here.

yahoNanJing commented 11 months ago

Hi @iajoiner, are you using this crate for datafusion or ballista? Please have a check for the version of ObjectStore. This 0.1.4 version is for the latest object_store since it changes the interface of ObjectStore.

iajoiner commented 11 months ago

@yahoNanJing Actually we are using delta-rs.

yahoNanJing commented 11 months ago

Please verify which version of object_store your delta-rs uses.

iajoiner commented 11 months ago

@yahoNanJing 0.6.1

smallzhongfeng commented 11 months ago

Hi @smallzhongfeng, have you customize your own datafusion? The community version of the datafusion does not depend on this crate, right?

For ballista, I have just updated the dependency version of this crate to deal with the interface change of the ObjectStore

We are currently developing ballista by ourselves, so when we upgraded at that time, this dependency needed to add some interfaces. Now we have upgraded to the latest version and improved the corresponding interfaces. It is no problem..