search

NICTA / scoobi

A Scala productivity framework for Hadoop.
http://nicta.github.com/scoobi/
482 stars 97 forks source link

As S3 is not the default file system on Amazon EMR #295

Closed ondrejivanic closed 11 years ago

ondrejivanic commented 11 years ago

This code throws the exception below (0.8.0-cdh3-SNAPSHOT):

This file system object (hdfs://10.248.22.247:9000) does not support access to the request path 's3://bucket/table/year=0/month=0/day=0'
 You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf)
 to obtain a file system supporting your path.
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:384)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:129)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:513)
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:770)
        ...

See #185, #239, #199