pedros / hdfs-fuse

Automatically exported from code.google.com/p/hdfs-fuse
2 stars 1 forks source link

Can't mount runnig HDFS #1

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
What steps will reproduce the problem? : 
1. I have installed HADOOP 0.16.4 on Gentoo (i386) 2.6.23 Kernel 
2. I have all needed packeges installed HDFS, FUSE 2.7.0 Kernel module + 
libs
3. Java is 1.6.0.07

hadoop@pandora ~ $ hadoop dfs -ls        
Found 2 items
/user/hadoop/sis2.tar   <r 4>   1853480960      2008-07-29 15:30        rw-
r--r--       hadoop  supergroup
/user/hadoop/sis3.tar   <r 4>   1853480960      2008-07-29 15:45        rw-
r--r--       hadoop  supergroup
hadoop@pandora ~ $ ls -ls /mnt
total 12732
    0 drwxr-xr-x 2 root   root         48 Jun 22  2007 cdrom
    0 drwx------ 2 root   root         72 Aug  3  2006 floppy
    0 drwxr-xr-x 5 hadoop hadoop      216 Jul 30  2008 hadoop
12732 -rw-r--r-- 1 root   root   13024172 May  6 01:48 hadoop-0.16.4.tar.gz
    0 drwxr-xr-x 2 root   root         48 Jul 30  2008 hdfs
    0 drwxr-xr-x 2 root   root         48 Jun 23  2007 md1
pandora bin # ldd hdfs-fuse 
        linux-gate.so.1 =>  (0xffffe000)
        libfuse.so.2 => /usr/lib/libfuse.so.2 (0xb7f3a000)
        libhdfs.so => /lib/libhdfs.so (0xb7f33000)
        libjvm.so => /lib/libjvm.so (0x06000000)
        libhdfs-fuse.so => /lib/libhdfs-fuse.so (0xb7f28000)
        libc.so.6 => /lib/libc.so.6 (0xb7e0a000)
        libm.so.6 => /lib/libm.so.6 (0xb7de5000)
        librt.so.1 => /lib/librt.so.1 (0xb7ddb000)
        libdl.so.2 => /lib/libdl.so.2 (0xb7dd7000)
        libpthread.so.0 => /lib/libpthread.so.0 (0xb7dc4000)
        /lib/ld-linux.so.2 (0xb7f5a000)
pandora bin # ./hdfs-mount /mnt/hdfs/
pandora bin # ls /mnt/hdfs/ -ls
total 0
pandora bin # lsmod
Module                  Size  Used by
configfs               23696  0 
fuse                   38548  0 
raid456               120336  1 
md_mod                 66964  2 raid456
async_xor               6400  1 raid456
async_memcpy            5760  1 raid456
async_tx                6144  1 raid456
xor                    17416  2 raid456,async_xor

Doesn't mount even no ERRORS?!

Original issue reported on code.google.com by burn2d...@gmail.com on 30 Jul 2008 at 12:59

GoogleCodeExporter commented 8 years ago
Have you tried adding the '-d' flag so that fuse runs in debug/non-daemon mode? 
or do
the log files say anything?

Original comment by peter.wy...@gmail.com on 1 Aug 2008 at 6:51

GoogleCodeExporter commented 8 years ago
Run Hadoop daemon in debug mode?!
I think the uperfs sould give some output 
like the Arhitecture is 

HADOOP
    |_
      FUSE
          |_
            HDFS_FUSE

I'm I missing smth?

Original comment by burn2d...@gmail.com on 4 Aug 2008 at 8:29

GoogleCodeExporter commented 8 years ago
There is no FUSE Daemon. Fuse is a kernel module.

Original comment by burn2d...@gmail.com on 5 Aug 2008 at 8:24

GoogleCodeExporter commented 8 years ago
I meant the fuse-hdfs module, not fuse itself.  By specifying -d, you will see 
the
output in stderr and the fuse-hdfs will not daemonize.

Original comment by peter.wy...@gmail.com on 19 Aug 2008 at 6:49

GoogleCodeExporter commented 8 years ago
pandora bin # lsmod
Module                  Size  Used by
fuse                   38548  1 
raid456               120336  1 
md_mod                 66964  2 raid456
async_xor               6400  1 raid456
async_memcpy            5760  1 raid456
async_tx                6144  1 raid456
xor                    17416  2 raid456,async_xor

pandora bin # ./hdfs-fuse -d /mnt/hdfs/ 
pandora bin # mount
/dev/sda1 on / type reiserfs (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
udev on /dev type tmpfs (rw,nosuid)
devpts on /dev/pts type devpts (rw)
shm on /dev/shm type tmpfs (rw,noexec,nosuid,nodev)
usbfs on /proc/bus/usb type usbfs (rw,devmode=0664,devgid=85)
nfsd on /proc/fs/nfsd type nfsd (rw)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
/dev/md/1 on /opt/backup/data type reiserfs (rw)
none on /sys/fs/fuse/connections type fusectl (rw)
pandora bin # 

No output still. Maybe an author could comment?!

Original comment by burn2d...@gmail.com on 26 Aug 2008 at 11:22

GoogleCodeExporter commented 8 years ago
have you done an echo $?   

looking at the code:

    if (fuse_log_init(config.logdir, "hdfs-fuse", config.loglv) ) exit(127);    

which happens before calling the fuse code. And it looks like that can return
non-zero without printing anything.

There may be some debugging info you can apply from
http://wiki.apache.org/hadoop/MountableHDFS to here, but I would check the exit 
code.

Original comment by peter.wy...@gmail.com on 27 Aug 2008 at 3:35

GoogleCodeExporter commented 8 years ago

Original comment by jass.z...@gmail.com on 14 Jan 2010 at 3:26