search

dotmesh-io / dotmesh

dotmesh (dm) is like git for your data volumes (databases, files etc) in Docker and Kubernetes
https://dotmesh.com
Apache License 2.0
538 stars 29 forks source link

Missing modules.order and modules.builtin (broken dotmesh install) #792

Open joeauty opened 4 years ago

joeauty commented 4 years ago

User requirement

My install is now broken, I want to fix it. Tried a reinstall, dm cluster reset, but dm cluster init generates the following in OS X Catalina:

depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.dep.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.dep.bin.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.alias.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.alias.bin.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.softdep.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.symbols.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.symbols.bin.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.builtin.bin.tmp, 1101, 644): Read-only file system depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.devname.tmp, 1101, 644): Read-only file system

  • modprobe -d /system-lib zfs modprobe: FATAL: Module zfs not found in directory /system-lib/lib/modules/4.19.76-linuxkit
  • fetch_zfs ++ uname -r
  • KERN=4.19.76-linuxkit
  • RELEASE=zfs-4.19.76-linuxkit.tar.gz
  • cd /bundled-lib
  • '[' -d /bundled-lib/lib/modules ']'
  • curl -f -o zfs-4.19.76-linuxkit.tar.gz https://get.dotmesh.io/zfs/zfs-4.19.76-linuxkit.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 19.7M 100 19.7M 0 0 2341k 0 0:00:08 0:00:08 --:--:-- 4035k
  • tar xf zfs-4.19.76-linuxkit.tar.gz
  • depmod -b /bundled-lib depmod: WARNING: could not open /bundled-lib/lib/modules/4.19.76-linuxkit/modules.order: No such file or directory depmod: WARNING: could not open /bundled-lib/lib/modules/4.19.76-linuxkit/modules.builtin: No such file or directory
  • modprobe -d /bundled-lib zfs modprobe: ERROR: ../libkmod/libkmod.c:514 lookup_builtin_file() could not open builtin file '/bundled-lib/lib/modules/4.19.76-linuxkit/modules.builtin.bin' modprobe: ERROR: ../libkmod/libkmod.c:514 lookup_builtin_file() could not open builtin file '/bundled-lib/lib/modules/4.19.76-linuxkit/modules.builtin.bin' modprobe: ERROR: could not insert 'zfs': Exec format error
lukemarsden commented 4 years ago

Thanks for the bug report! We were just talking about fixing this today.

BTW, did you decide to try dotmesh because you saw my talk at the Bristol Data Science meetup? :) If so, check out dotscience.com, where you can spin up dotmesh in a Jupyter container on our SaaS for free.

joeauty commented 4 years ago

Thanks for the bug report! We were just talking about fixing this today.

BTW, did you decide to try dotmesh because you saw my talk at the Bristol Data Science meetup? :) If so, check out dotscience.com, where you can spin up dotmesh in a Jupyter container on our SaaS for free.

I did not see your talk, is it online?

Thanks for looking into this! We're all very interested in Dotmesh and would love to be informed and educated about all plans and development roadmap stuff :)

lukemarsden commented 4 years ago

Thanks @joeauty, what's your use case for Dotmesh out of interest?

joeauty commented 4 years ago

Thanks @joeauty, what's your use case for Dotmesh out of interest?

Dataset collaboration among our dev team for QA. I remember one of your talks at a Dockercon got into ML cases, we aren't there yet, but we see value in "Git for data", and I used to use ZFS in a past life so I understand its merits for use cases like this!

prisamuel commented 4 years ago

This issue is related to https://github.com/dotmesh-io/zfs-builder/issues/6 -> support for zfs-4.19.76-linuxkit