search

prestodb / presto

The official home of the Presto distributed SQL query engine for big data
http://prestodb.io
Apache License 2.0
15.85k stars 5.32k forks source link

Raptorx: Are there plans to support iceberg connector? #17025

Open zhengxingmao opened 2 years ago

zhengxingmao commented 2 years ago

Will this feature have the same performance improvement when it is migrated to iceberg connector?

beinan commented 2 years ago

Thank you for your interest in raptorx. We just merged a PR for the alluxio local cache support in iceberg connector, feel free to give it a shot, thanks! https://github.com/prestodb/presto/pull/16942

zhengxingmao commented 2 years ago

Met this error . java.lang.UnsupportedOperationException: s3a is not supported as the external filesystem. at alluxio.hadoop.LocalCacheFileSystem.initialize(LocalCacheFileSystem.java:91) at com.facebook.presto.cache.alluxio.AlluxioCachingFileSystem.initialize(AlluxioCachingFileSystem.java:72) at com.facebook.presto.cache.CacheFactory.createCachingFileSystem(CacheFactory.java:54) at com.facebook.presto.hive.cache.HiveCachingHdfsConfiguration.lambda$getConfiguration$0(HiveCachingHdfsConfiguration.java:71) at com.facebook.presto.hive.cache.HiveCachingHdfsConfiguration$CachingJobConf.createFileSystem(HiveCachingHdfsConfiguration.java:105) at org.apache.hadoop.fs.PrestoFileSystemCache.get(PrestoFileSystemCache.java:59) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at com.facebook.presto.hive.HdfsEnvironment.lambda$getFileSystem$0(HdfsEnvironment.java:71) at com.facebook.presto.hive.authentication.NoHdfsAuthentication.doAs(NoHdfsAuthentication.java:23) at com.facebook.presto.hive.HdfsEnvironment.getFileSystem(HdfsEnvironment.java:70) at com.facebook.presto.hive.HdfsEnvironment.getFileSystem(HdfsEnvironment.java:64)