Open maobaolong opened 3 years ago
I want to reproduce this issue on my macos, but I met another worse issue, the fuse process exited accidentally.
Did you compare the md5 of the written file and the original file? Is it possible to read the 1.6GB file back from alluxio to local filesystem and compare the md5?
@maobaolong i tested in both mac and os. In Linux, i copy the file to standalone fuse mount point and then copy it back
-rw-------. 1 ec2-user ec2-user 1888552920 Jul 31 02:38 testfile <-- original
-rw-------. 1 ec2-user ec2-user 1888552920 Aug 11 05:47 testfile2 <--copy to fuse and copy back
Those two files are exactly the same, fuse works well.
bin/alluxio fs ls /testfile
-rw------- alluxio alluxio 1888552920 NOT_PERSISTED 08-11-2021 05:46:03:445 100% /testfile
the fuse config is
ALLUXIO_FUSE_JAVA_OPTS="-Xmx16G -Xms16G -XX:MaxDirectMemorySize=14g"
in local mac, I do see the same fuse process exited issue. Still need some investigation
@LuQQiu This is the error log on mac
/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/bin/java -agentlib:jdwp=transport=dt_socket,address=127.0.0.1:61975,suspend=y,server=n -Xmx4g -XX:MaxDirectMemorySize=4g -Dlog4j.configuration=file:/Users/mbl/projects/github/hcfsfuse/conf/log4j.properties -javaagent:/Users/mbl/Library/Caches/JetBrains/IntelliJIdea2021.2/captureAgent/debugger-agent.jar -Dfile.encoding=UTF-8 -classpath /Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_251.jdk/Contents/Home/lib/tools.jar:/Users/mbl/projects/github/hcfsfuse/target/classes:/Users/mbl/.m2/repository/org/alluxio/alluxio-integration-fuse/2.6.0-SNAPSHOT/alluxio-integration-fuse-2.6.0-SNAPSHOT.jar:/Users/mbl/.m2/repository/org/alluxio/alluxio-integration-jnifuse-fs/2.6.0-SNAPSHOT/alluxio-integration-jnifuse-fs-2.6.0-SNAPSHOT.jar:/Users/mbl/.m2/repository/org/alluxio/alluxio-integration-jnifuse-native/2.6.0-SNAPSHOT/alluxio-integration-jnifuse-native-2.6.0-SNAPSHOT.jar:/Users/mbl/.m2/repository/org/apache/logging/log4j/log4j-api/2.13.3/log4j-api-2.13.3.jar:/Users/mbl/.m2/repository/org/apache/logging/log4j/log4j-core/2.13.3/log4j-core-2.13.3.jar:/Users/mbl/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/Users/mbl/.m2/repository/org/alluxio/alluxio-core-common/2.6.0-SNAPSHOT/alluxio-core-common-2.6.0-SNAPSHOT.jar:/Users/mbl/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.11.1/jackson-databind-2.11.1.jar:/Users/mbl/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.11.1/jackson-annotations-2.11.1.jar:/Users/mbl/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.11.1/jackson-core-2.11.1.jar:/Users/mbl/.m2/repository/commons-io/commons-io/2.7/commons-io-2.7.jar:/Users/mbl/.m2/repository/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar:/Users/mbl/.m2/repository/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar:/Users/mbl/.m2/repository/com/google/code/gson/gson/2.8.6/gson-2.8.6.jar:/Users/mbl/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.11/metrics-jmx-4.1.11.jar:/Users/mbl/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.11/metrics-jvm-4.1.11.jar:/Users/mbl/.m2/repository/io/grpc/grpc-netty/1.37.0/grpc-netty-1.37.0.jar:/Users/mbl/.m2/repository/io/perfmark/perfmark-api/0.23.0/perfmark-api-0.23.0.jar:/Users/mbl/.m2/repository/org/codehaus/mojo/animal-sniffer-annotations/1.19/animal-sniffer-annotations-1.19.jar:/Users/mbl/.m2/repository/io/netty/netty-all/4.1.52.Final/netty-all-4.1.52.Final.jar:/Users/mbl/.m2/repository/io/swagger/swagger-annotations/1.6.2/swagger-annotations-1.6.2.jar:/Users/mbl/.m2/repository/org/apache/commons/commons-lang3/3.11/commons-lang3-3.11.jar:/Users/mbl/.m2/repository/org/apache/curator/curator-client/4.2.0/curator-client-4.2.0.jar:/Users/mbl/.m2/repository/org/apache/curator/curator-framework/4.2.0/curator-framework-4.2.0.jar:/Users/mbl/.m2/repository/org/reflections/reflections/0.9.12/reflections-0.9.12.jar:/Users/mbl/.m2/repository/org/javassist/javassist/3.26.0-GA/javassist-3.26.0-GA.jar:/Users/mbl/.m2/repository/org/alluxio/alluxio-core-transport/2.6.0-SNAPSHOT/alluxio-core-transport-2.6.0-SNAPSHOT.jar:/Users/mbl/.m2/repository/io/grpc/grpc-protobuf/1.37.0/grpc-protobuf-1.37.0.jar:/Users/mbl/.m2/repository/io/grpc/grpc-protobuf-lite/1.37.0/grpc-protobuf-lite-1.37.0.jar:/Users/mbl/.m2/repository/javax/annotation/javax.annotation-api/1.3.2/javax.annotation-api-1.3.2.jar:/Users/mbl/.m2/repository/org/alluxio/alluxio-core-client-fs/2.6.0-SNAPSHOT/alluxio-core-client-fs-2.6.0-SNAPSHOT.jar:/Users/mbl/.m2/repository/com/google/protobuf/protobuf-java/3.12.4/protobuf-java-3.12.4.jar:/Users/mbl/.m2/repository/commons-codec/commons-codec/1.13/commons-codec-1.13.jar:/Users/mbl/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.11/metrics-core-4.1.11.jar:/Users/mbl/.m2/repository/io/grpc/grpc-api/1.37.0/grpc-api-1.37.0.jar:/Users/mbl/.m2/repository/io/grpc/grpc-context/1.37.0/grpc-context-1.37.0.jar:/Users/mbl/.m2/repository/io/grpc/grpc-core/1.37.0/grpc-core-1.37.0.jar:/Users/mbl/.m2/repository/com/google/android/annotations/4.1.1.4/annotations-4.1.1.4.jar:/Users/mbl/.m2/repository/io/grpc/grpc-stub/1.37.0/grpc-stub-1.37.0.jar:/Users/mbl/.m2/repository/org/rocksdb/rocksdbjni/6.15.2/rocksdbjni-6.15.2.jar:/Users/mbl/.m2/repository/com/github/serceman/jnr-fuse/0.5.5/jnr-fuse-0.5.5.jar:/Users/mbl/.m2/repository/com/github/jnr/jnr-posix/3.0.54/jnr-posix-3.0.54.jar:/Users/mbl/.m2/repository/com/github/jnr/jnr-constants/0.9.15/jnr-constants-0.9.15.jar:/Users/mbl/.m2/repository/com/github/jnr/jnr-ffi/2.1.12/jnr-ffi-2.1.12.jar:/Users/mbl/.m2/repository/com/github/jnr/jffi/1.2.23/jffi-1.2.23.jar:/Users/mbl/.m2/repository/com/github/jnr/jffi/1.2.23/jffi-1.2.23-native.jar:/Users/mbl/.m2/repository/org/ow2/asm/asm-commons/7.1/asm-commons-7.1.jar:/Users/mbl/.m2/repository/org/ow2/asm/asm-analysis/7.1/asm-analysis-7.1.jar:/Users/mbl/.m2/repository/org/ow2/asm/asm-tree/7.1/asm-tree-7.1.jar:/Users/mbl/.m2/repository/org/ow2/asm/asm-util/7.1/asm-util-7.1.jar:/Users/mbl/.m2/repository/com/github/jnr/jnr-a64asm/1.0.0/jnr-a64asm-1.0.0.jar:/Users/mbl/.m2/repository/com/github/jnr/jnr-x86asm/1.0.2/jnr-x86asm-1.0.2.jar:/Users/mbl/.m2/repository/com/google/guava/guava/29.0-jre/guava-29.0-jre.jar:/Users/mbl/.m2/repository/com/google/guava/failureaccess/1.0.1/failureaccess-1.0.1.jar:/Users/mbl/.m2/repository/com/google/guava/listenablefuture/9999.0-empty-to-avoid-conflict-with-guava/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/Users/mbl/.m2/repository/org/checkerframework/checker-qual/2.11.1/checker-qual-2.11.1.jar:/Users/mbl/.m2/repository/com/google/errorprone/error_prone_annotations/2.3.4/error_prone_annotations-2.3.4.jar:/Users/mbl/.m2/repository/com/google/j2objc/j2objc-annotations/1.3/j2objc-annotations-1.3.jar:/Users/mbl/.m2/repository/commons-cli/commons-cli/1.3.1/commons-cli-1.3.1.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-common/3.2.1/hadoop-common-3.2.1.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-annotations/3.2.1/hadoop-annotations-3.2.1.jar:/Users/mbl/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/mbl/.m2/repository/commons-net/commons-net/3.6/commons-net-3.6.jar:/Users/mbl/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/mbl/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/Users/mbl/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/mbl/.m2/repository/commons-beanutils/commons-beanutils/1.9.3/commons-beanutils-1.9.3.jar:/Users/mbl/.m2/repository/org/apache/commons/commons-configuration2/2.1.1/commons-configuration2-2.1.1.jar:/Users/mbl/.m2/repository/org/apache/commons/commons-text/1.4/commons-text-1.4.jar:/Users/mbl/.m2/repository/org/slf4j/slf4j-log4j12/1.7.25/slf4j-log4j12-1.7.25.jar:/Users/mbl/.m2/repository/com/google/re2j/re2j/1.1/re2j-1.1.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-auth/3.2.1/hadoop-auth-3.2.1.jar:/Users/mbl/.m2/repository/net/minidev/json-smart/2.3/json-smart-2.3.jar:/Users/mbl/.m2/repository/net/minidev/accessors-smart/1.2/accessors-smart-1.2.jar:/Users/mbl/.m2/repository/org/ow2/asm/asm/5.0.4/asm-5.0.4.jar:/Users/mbl/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/Users/mbl/.m2/repository/org/apache/htrace/htrace-core4/4.1.0-incubating/htrace-core4-4.1.0-incubating.jar:/Users/mbl/.m2/repository/org/codehaus/woodstox/stax2-api/3.1.4/stax2-api-3.1.4.jar:/Users/mbl/.m2/repository/com/fasterxml/woodstox/woodstox-core/5.0.3/woodstox-core-5.0.3.jar:/Users/mbl/.m2/repository/dnsjava/dnsjava/2.1.7/dnsjava-2.1.7.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-ozone-client/1.1.0/hadoop-ozone-client-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-ozone-common/1.1.0/hadoop-ozone-common-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/mbl/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-hdds-common/1.1.0/hadoop-hdds-common-1.1.0.jar:/Users/mbl/.m2/repository/info/picocli/picocli/4.4.0/picocli-4.4.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-hdds-config/1.1.0/hadoop-hdds-config-1.1.0.jar:/Users/mbl/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-server/2.0.0/ratis-server-2.0.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-thirdparty-misc/0.6.0/ratis-thirdparty-misc-0.6.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-proto/2.0.0/ratis-proto-2.0.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-common/2.0.0/ratis-common-2.0.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-client/2.0.0/ratis-client-2.0.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-server-api/2.0.0/ratis-server-api-2.0.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-metrics/2.0.0/ratis-metrics-2.0.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-netty/2.0.0/ratis-netty-2.0.0.jar:/Users/mbl/.m2/repository/org/apache/ratis/ratis-grpc/2.0.0/ratis-grpc-2.0.0.jar:/Users/mbl/.m2/repository/com/lmax/disruptor/3.4.2/disruptor-3.4.2.jar:/Users/mbl/.m2/repository/org/apache/commons/commons-pool2/2.6.0/commons-pool2-2.6.0.jar:/Users/mbl/.m2/repository/org/bouncycastle/bcpkix-jdk15on/1.67/bcpkix-jdk15on-1.67.jar:/Users/mbl/.m2/repository/org/bouncycastle/bcprov-jdk15on/1.67/bcprov-jdk15on-1.67.jar:/Users/mbl/.m2/repository/commons-validator/commons-validator/1.6/commons-validator-1.6.jar:/Users/mbl/.m2/repository/commons-digester/commons-digester/1.8.1/commons-digester-1.8.1.jar:/Users/mbl/.m2/repository/io/jaegertracing/jaeger-client/1.2.0/jaeger-client-1.2.0.jar:/Users/mbl/.m2/repository/io/jaegertracing/jaeger-thrift/1.2.0/jaeger-thrift-1.2.0.jar:/Users/mbl/.m2/repository/org/apache/thrift/libthrift/0.13.0/libthrift-0.13.0.jar:/Users/mbl/.m2/repository/com/squareup/okhttp3/okhttp/4.2.2/okhttp-4.2.2.jar:/Users/mbl/.m2/repository/com/squareup/okio/okio/2.2.2/okio-2.2.2.jar:/Users/mbl/.m2/repository/io/jaegertracing/jaeger-core/1.2.0/jaeger-core-1.2.0.jar:/Users/mbl/.m2/repository/io/jaegertracing/jaeger-tracerresolver/1.2.0/jaeger-tracerresolver-1.2.0.jar:/Users/mbl/.m2/repository/io/opentracing/contrib/opentracing-tracerresolver/0.1.8/opentracing-tracerresolver-0.1.8.jar:/Users/mbl/.m2/repository/io/opentracing/opentracing-util/0.33.0/opentracing-util-0.33.0.jar:/Users/mbl/.m2/repository/io/opentracing/opentracing-api/0.33.0/opentracing-api-0.33.0.jar:/Users/mbl/.m2/repository/io/opentracing/opentracing-noop/0.33.0/opentracing-noop-0.33.0.jar:/Users/mbl/.m2/repository/org/yaml/snakeyaml/1.26/snakeyaml-1.26.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-hdds-interface-client/1.1.0/hadoop-hdds-interface-client-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-hdds-client/1.1.0/hadoop-hdds-client-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-ozone-interface-client/1.1.0/hadoop-ozone-interface-client-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-ozone-filesystem/1.1.0/hadoop-ozone-filesystem-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-ozone-filesystem-common/1.1.0/hadoop-ozone-filesystem-common-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-hdds-hadoop-dependency-client/1.1.0/hadoop-hdds-hadoop-dependency-client-1.1.0.jar:/Users/mbl/.m2/repository/org/apache/hadoop/hadoop-hdfs/3.2.2/hadoop-hdfs-3.2.2.jar:/Users/mbl/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar hcfsfuse.fuse.HCFSFuse -jniFuse -c /Users/mbl/projects/github/hcfsfuse/conf/ozone-site.xml -m /Users/mbl/mp4 -r file:///Users/mbl/mp-target
Connected to the target VM, address: '127.0.0.1:61975', transport: 'socket'
2021-08-12 10:53:19,370 [main] WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2021-08-12 10:53:19,924 [main] INFO utils.NativeLibraryLoader (NativeLibraryLoader.java:loadLibraryFromJar) - Loaded lib by jar from path /var/folders/hj/jty18sr93t3_cbkb01szbv3w0000gn/T/libjnifuse1596551316455394116.jnilib.
2021-08-12 10:53:20,133 [main] INFO fuse.HCFSFuse (HCFSFuse.java:main) - Mounting HCFSJniFuseFileSystem: mount point="/Users/mbl/mp4", OPTIONS="[]"
2021-08-12 10:53:20,133 [main] INFO jnifuse.AbstractFuseFileSystem (AbstractFuseFileSystem.java:mount) - Mounting /Users/mbl/mp4: blocking=true, debug=false, fuseOpts="[]"
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x000000010eaf0223, pid=66943, tid=0x0000000000005c03
#
# JRE version: Java(TM) SE Runtime Environment (8.0_251-b08) (build 1.8.0_251-b08)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.251-b08 mixed mode bsd-amd64 compressed oops)
# Problematic frame:
# V [libjvm.dylib+0x2f0223]
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /Users/mbl/projects/github/hcfsfuse/hs_err_pid66943.log
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
Disconnected from the target VM, address: '127.0.0.1:61975', transport: 'socket'
Process finished with exit code 134 (interrupted by signal 6: SIGABRT)
@maobaolong Yeah, i also see that in mac. I cannot reproduce in Linux but can in mac
This issue has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions.
Alluxio Version:
Master branch
hash 2427c985ea1b
Describe the bug
copy a 1.8g file to alluxio by alluxio-fuse, and left 1.6g in the alluxio fs without any error.
To Reproduce
Start a alluxio-master and a alluxio-worker Start alluxio-fuse copy a 1.8g file into the mount point list the file and found that it is 1.6g, not 1.8g
Expected behavior
the target file is 1.8g and with the same content.
Urgency Urgent
Additional context No.