-
Hi, Im using petastorm to feed tensorflow models lunched with spark in an EMR cluster. The code is the basic to read parquet files on s3:
```
from pyarrow import fs
from petastorm.reader import Rea…
-
```
What steps will reproduce the problem?
1.create any unit test with a setup() method, which create hadoop local file
system
2.make dumb/empty test method, run the test make sure it pass
3.add @Run…
-
```
What steps will reproduce the problem?
1.create any unit test with a setup() method, which create hadoop local file
system
2.make dumb/empty test method, run the test make sure it pass
3.add @Run…
-
Support for Azure Blob-Store - WASB Hadoop Filesystem
Hi,
From h2ostream:
we are using Azure Blobstore (wasb interface - part of Hadoop release 2.7.1 https://hadoop.apache.org/docs/stable/had…
-
### Apache Iceberg version
1.5.2 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
when I do
```python
spark.sql("""CALL rest.system.remove_orphan_files(table =…
-
hi all,
i tried to run agaricus example on yarn. The following exception is thrown:
~/platform/java-1.8.0//bin/java -cp `/home/hadoop/bin/hadoop classpath`:tracker/../yarn//dmlc-yarn.jar org.apache.h…
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](http…
-
org.apache.hadoop
hadoop-common
3.3.3
io.juicefs
juicefs-hadoop
1.1.0
public static voi…
-
**Describe the bug**
invalid wasb credentials taking 13-14 minutes to execute. from 5.x this issue is happening. till 5.0.0 its working as expected
***Exception or Stack Trace***
Getting correct …
-
是否有 hadoop filesystem 的接口，如[hadoop-cos](https://github.com/tencentyun/hadoop-cos)实现的的这种？