search

InBetweenNames / gentooLTO

A Gentoo Portage configuration for building with -O3, Graphite, and LTO optimizations
GNU General Public License v2.0
571 stars 96 forks source link

FUSE / MergerFS Issue with Flags #416

Closed ellisonpatterson closed 4 years ago

ellisonpatterson commented 5 years ago

https://github.com/trapexit/mergerfs/issues/661

Looks like some flags cause issues, I made a custom.conf file in /etc/portage/package.cflags and added the following:

sys-fs/mergerfs /-O3/-O0
sys-fs/fuse /-O3/-O0
sys-fs/fuse-common /-O3/-O0

The hanging issue has seemed to go away but I'm wondering if anything else should be added?

Thanks!

elsandosgrande commented 5 years ago 
root@sandys-pavilion:/home/sandy# emerge --info sys-fs/fuse sys-fs/fuse-common sys-fs/mergerfs

emerge: there are no ebuilds to satisfy "sys-fs/mergerfs".

emerge: searching for similar names...
emerge: Maybe you meant any of these: sys-fs/rarfs, sys-fs/rar2fs, sys-fs/bees?

Where did you get the ebuild from?

Also:

root@sandys-pavilion:/home/sandy# emerge --info sys-fs/fuse sys-fs/fuse-common
Portage 2.3.76 (python 3.7.4-final-0, default/linux/amd64/17.1/desktop/plasma/systemd, gcc-9.2.0, glibc-2.29-r5, 5.2.14-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-5.2.14-gentoo-x86_64-AMD_A9-9410_RADEON_R5,_5_COMPUTE_CORES_2C+3G-with-gentoo-2.6
KiB Mem:     7546556 total,   1079888 free
KiB Swap:   16777212 total,  16777212 free
Timestamp of repository gentoo: Thu, 12 Sep 2019 16:30:01 +0000
Head commit of repository gentoo: cb65294a93c80042b0ce13cef4cad5761db0122d
Timestamp of repository jorgicio: Thu, 12 Sep 2019 04:25:11 +0000
Head commit of repository jorgicio: 13dfc17ab28b62615f6e43ae19bdb6e8714fa589

Timestamp of repository lto-overlay: Tue, 13 Aug 2019 12:46:50 +0000
Head commit of repository lto-overlay: c8fc58cf4c85e71253affba7ce21d153618776a9

Timestamp of repository matrix: Tue, 20 Aug 2019 14:05:56 +0000
Head commit of repository matrix: 079013fd081c092ae503019259da16c8f712d135

Timestamp of repository mv: Sun, 08 Sep 2019 18:45:41 +0000
Head commit of repository mv: 67825eae1131a0acf5d5611504c4819d2943b762

Timestamp of repository steam-overlay: Mon, 09 Sep 2019 15:05:53 +0000
Head commit of repository steam-overlay: 7cc9c3dbc28dc42b2087b60a04836109d7510210

sh bash 5.0_p11
ld GNU ld (Gentoo 2.32 p2) 2.32.0
ccache version 3.7.3 [disabled]
app-shells/bash:          5.0_p11::gentoo
dev-java/java-config:     2.2.0-r4::gentoo
dev-lang/perl:            5.30.0::gentoo
dev-lang/python:          2.7.16-r102::lto-overlay, 3.6.9-r1::lto-overlay, 3.7.4-r2::lto-overlay
dev-util/ccache:          3.7.3::gentoo
dev-util/cmake:           3.15.3::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/sandbox:         2.18::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.11.6-r3::gentoo, 1.13.4-r2::gentoo, 1.16.1-r1::gentoo
sys-devel/binutils:       2.32-r1::gentoo
sys-devel/gcc:            8.3.0-r1::gentoo, 9.2.0::gentoo
sys-devel/gcc-config:     2.1::gentoo
sys-devel/libtool:        2.4.6-r5::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 5.2::gentoo (virtual/os-headers)
sys-libs/glibc:           2.29-r5::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-max-age: 24
    sync-rsync-extra-opts: 

jorgicio
    location: /var/db/repos/jorgicio
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/jorgicio.git
    masters: gentoo

lto-overlay
    location: /var/db/repos/lto-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/lto-overlay.git
    masters: gentoo mv

matrix
    location: /var/db/repos/matrix
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/matrix.git
    masters: gentoo

mv
    location: /var/db/repos/mv
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/mv.git
    masters: gentoo

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O3 -march=bdver4 -pipe -pthread -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=2 -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc/locale* /etc/nginx/nginx.conf /etc/portage/make.conf /etc/systemd/logind.conf /etc/systemd/system/ /usr/lib/sysctl.d/90-override.conf"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.3/ext-active/ /etc/php/cgi-php7.3/ext-active/ /etc/php/cli-php7.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O3 -march=bdver4 -pipe -pthread -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=2 -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra"
DISTDIR="/usr/portage/distfiles"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O3 -march=bdver4 -pipe -pthread -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=2 -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O3 -march=bdver4 -pipe -pthread -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=2 -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra"
GENTOO_MIRRORS="http://ftp.ntua.gr/pub/linux/gentoo/ https://mirrors.evowise.com/gentoo/ https://ftp.halifax.rwth-aachen.de/gentoo/ http://ftp.halifax.rwth-aachen.de/gentoo/"
LANG="en_US.UTF-8"
LDFLAGS="-O3 -march=bdver4 -pipe -pthread -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=2 -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra -Wl,-O1 -Wl,--as-needed -Wl,-O3"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="* 7zip X a52 aac acl acpi activities aio alsa amd64 amr amrenc androiddump apache2 appstream aribsub asm audiofile bash-completion berkdb bluetooth branding brightness-control browser-integration bzip2 cairo caps cdda cddb cdio cdr cdrom cgroup-hybrid cholmod ciscodump cjk clamdtop cli color-management colord connection-sharing context corefonts cracklib crypt cups cxx cycles d3d9 dav1d dbus declarative dri dri3 drm dts dvd dvdr egl emboss encode eps examples exif extras fam farstream fcitx fcitx4 fdt ffmpeg fftw filecaps flac fluidsynth fontconfig fortran fpm frei0r ftp fuse gallium gbm gd gdbm gentoo-vm geolocation gif git glamor gles gles1 gles2 gles3 glib gme gmp gnuefi gnuplot googledrive gpg gpm gps graphite grub gsl gstreamer gtk gtk3 guile guile2 handbook hardened heif hpn iconv icu id3tag imagemagick ipv6 iso java joystick jpeg jpeg2k kde kdenlive kipi kms kwallet latex layers lcms ldap lensfun libaom libass libcaca libdrm libinput libkms libnotify libtirpc libxml2 llvm lm-sensors lrz lto lz4 lzma lzo mad man matroska mem-scramble minizip mng modern-top mount mousepad mp3 mp4 mpeg mpi mtp multilib musepack mysql mysqli native-headset ncurses networkmanager nfs nghttp2 nginx nls nptl numpy ogg omxil openal opencl opencv openexr opengl openh264 openimageio openmp opus orientation osmesa pam pango pch pci pcre pdf pdfimport phonon pie plasma png policykit posix postproc postscript ppds prison projectm ptex pulseaudio python qalculate qml qt4 qt5 qtmedia quad quicktime rar raw readline realtime rubberband sasl sbc sbsms scanner scripts sdl seccomp semantic-desktop sha3 shout sid skins smi sound sox speex spell spice split-usr sqlite ssl startup-notification svg swaybar swaybg swaymsg swaynag symlink sync-plugin-portage system-llvm systemd systemtap taglib tcpd theora threads tiff tls-heartbeat tools touchpad truetype twolame udev udisks umfpack unicode unwind upower usb usbredir user-permissions user-session utils uuid v4l vaapi vala vamp vcd vdpau video vim-pager vim-syntax virgl virt-network vlc vorbis vpx vulkan vulkan-overlay wallpapers wayland webengine webp widgets wifi wireshark-plugins wxwidgets x264 x265 xattr xcb xcomposite xml xpm xv xvid yaml zlib zvbi" ABI_X86="32 64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good acc_power nopl nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor ssse3 sse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs xop skinit wdt lwp fma4 tce nodeid_msr tbm perfctr_core perfctr_nb bpext ptsc mwaitx cpb hw_pstate ssbd vmmcall fsgsbase bmi1 avx2 smep bmi2 xsaveopt arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif overflow_recov" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput wacom" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="AMDGPU WebAssembly" NETBEANS_MODULES="apisupport cnd groovy gsf harness ide identity j2ee java mobility nb php profiler soa visualweb webcommon websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python3_7 python3_6 python2_7" RUBY_TARGETS="ruby24 ruby25" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi radeon" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

=================================================================
                        Package Settings
=================================================================

sys-fs/fuse-2.9.9-r1::gentoo was built with the following:
USE="examples -static-libs" ABI_X86="(64)"
CFLAGS="-O3 -march=bdver4 -pipe -pthread -fopenmp -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra -Wno-error -Wl,-O1 -Wl,--as-needed -Wl,-O3"
CXXFLAGS="-O3 -march=bdver4 -pipe -pthread -fopenmp -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra -Wno-error -Wl,-O1 -Wl,--as-needed -Wl,-O3"
LDFLAGS="-O3 -march=bdver4 -pipe -pthread -fopenmp -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra -Wno-error -Wl,-O1 -Wl,--as-needed -Wl,-O3"

sys-fs/fuse-common-3.4.1::gentoo was built with the following:
USE="" ABI_X86="(64)"
CFLAGS="-O3 -march=bdver4 -pipe -pthread -fopenmp -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra -Wno-error -Wl,-O1 -Wl,--as-needed -Wl,-O3"
CXXFLAGS="-O3 -march=bdver4 -pipe -pthread -fopenmp -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra -Wno-error -Wl,-O1 -Wl,--as-needed -Wl,-O3"
LDFLAGS="-O3 -march=bdver4 -pipe -pthread -fopenmp -fira-hoist-pressure -fira-loop-pressure -fbranch-target-load-optimize -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -fuse-linker-plugin -fuse-ld=bfd -Wall -Wextra -Wno-error -Wl,-O1 -Wl,--as-needed -Wl,-O3"

Please provide the output of emerge --info [package list], because this is strange. At the very least, FUSE should have no issues when it comes to the ticket which you referred to above.

trapexit commented 5 years ago

It wasn't the build flags per se. It was a bug that the flags tickled. Please try 2.28.2 before changing flags.

ellisonpatterson commented 5 years ago

I am using the MVA layman repo for that ebuild (https://gpo.zugaina.org/AJAX/Ebuild/38398600/View) and the issue I was experiencing was with MergerFS and ZFS causing some type of hang when removing a file within the mount that MergerFS creates, which is similar to that issue.

ellisonpatterson commented 4 years ago

Sorry I was wrong, hope I didn't waste anyones time! I'll close the issue.