PREP_SYSTEM_FOR_DIETPI.sh | Automate

Fourdee commented 6 years ago

Status: Beta

What is this?

This script will install and convert any 'bloated' Debian/Raspbian installation, into a lightweight DietPi system.

What this script does NOT do:

Support converting existing installed software (eg: nextcloud, Plex Media Server) over to the DietPi system. All existing software (APT) and user data will be deleted.

Step 1: Ensure a Debian/Raspbian OS is running on the system

For best results, we recommend a fresh/clean minimal Debian/Raspbian installation
Native PC users: please install Debian stable before hand: https://www.debian.org/distrib/netinst
Desktop images should work, however, the minimal the image, the quicker the installation, as less packages will need to be removed.
NB: We do not support Ubuntu, or have any plans to do so.

Step 2: Pre-req packages

Critical packages These should already exist on most systems, however pure minimal images may require the following installations) apt-get update; apt-get install -y systemd-sysv ca-certificates sudo wget locales --reinstall

Step 3: Run DietPi installer

Must be run from SSH or local term eg: Outside of desktop environment
In case of SSH, to prevent connection loss, an Ethernet connection is required.

Ensure you have elevated privileges (eg: login as `root`, or use `sudo su`).

Copy and paste all into term.

wget https://raw.githubusercontent.com/MichaIng/DietPi/master/PREP_SYSTEM_FOR_DIETPI.sh -O PREP_SYSTEM_FOR_DIETPI.sh
#wget https://raw.githubusercontent.com/MichaIng/DietPi/jessie-support/PREP_SYSTEM_FOR_DIETPI.sh -O PREP_SYSTEM_FOR_DIETPI.sh
#wget https://raw.githubusercontent.com/MichaIng/DietPi/beta/PREP_SYSTEM_FOR_DIETPI.sh -O PREP_SYSTEM_FOR_DIETPI.sh
#wget https://raw.githubusercontent.com/MichaIng/DietPi/dev/PREP_SYSTEM_FOR_DIETPI.sh -O PREP_SYSTEM_FOR_DIETPI.sh
chmod +x PREP_SYSTEM_FOR_DIETPI.sh
./PREP_SYSTEM_FOR_DIETPI.sh

Follow the onscreen prompts.

k-plan commented 6 years ago

to test the preparation script on already existing devices. But on the other hand as HC1 is/should work more less the same than XU3/4, the error should have also occurred there.

Yes. HC1 is a XU4 without HDMI but with onboard USB3-to-SATA-Bridge, like CloudShell for XU4 before. But anyway. Whatever device shall I test?

C2? Fourdee did this.
RPi? Fourdee did this and you can do by yourself.
C1+? Puuh ... next case full of worms ....
AllWinner (Orange/Banana/Nano Pi) ? This are crappy slow for testing ...

MichaIng commented 6 years ago

@k-plan Thx for copying, so I guess there is no "moving" posts possible in github.

About image creation testing: Choice is yours, maybe orientate on the machine usage statistics, but for now the plan is anyway to get all images up to date until 6.0 release. I will try to fix the kernel un/installation issue. Still thinking how to solve this best. The easiest way is to just "apt-get install" all device specific kernel/firmware/bootloader packages. This will also mark them as "manually" installed, thus prevents them from being autoremoved. As in case new/different versions of kernel are being installed, the older ones should be able to autoremove successfully. The only thing is that it doesn't fit anymore into 'Step 4: APT removals:' 😆, could be moved into 'Step 3: Distro selection / APT prep:' or we create a new step: APT hardware package preparation or something like that.

But to allow further testing for now, I will create PR and fix/adjust some other things, I found yesterday.

k-plan commented 6 years ago

Quick and dirty:

🈴 OrangePi One, running DietPi Jessie (3.x) > Stretch
it's running nice and smooth 👍

[Ok] Completed, disk can now be saved to .img for later use, or, reboot system to start first run of DietPi:

😃

==>> endless boot loop

Thx for copying, so I guess there is no "moving" posts possible in github.

Yes, not for you and me. It's sadly not a forum.

Fourdee commented 6 years ago

@k-plan

OrangePi One, running DietPi Jessie (3.x) > Stretch

All ARMbian images will fail to boot currently. We've not added the armbian APT kernel packages to the list yet (they'll get removed). I'll do this once v6.0 is near completion and have to go through all the images.

Installed kernel packages should be under:

dpkg -l | grep '^linux'

Working devices with this script should be (off top my head):

VM's
RPi's
Odroid's
Rock64

Fourdee commented 6 years ago

Maybe we can scrape the current linux-image from system, prior to dep list generation, then add it automatically. I'll take a look.

k-plan commented 6 years ago

@Fourdee

Hmm ... so I can stop testing for now?

Or shall go on with Odroid C1+?

Or leave you coders alone for the moment to continue your nice work?

Fourdee commented 6 years ago

@k-plan

Its not fully finished yet, but yep, if you want to play/test 😄, the C1 should work (and the ones I posted above).

MichaIng commented 6 years ago

@k-plan @Fourdee Fix is there https://github.com/Fourdee/DietPi/pull/1362 If this generally works, we can thinking of moving the stuff somewhere else or something.

I followed now the idea, that we control installation of certain hardware related packages. Not only the kernel, also firmware and bootloader (grub etc.) could be removed (without alternative/new version) in between otherwise, which could lead to problems. But of course then we need to know which packages are possible/best/necessary for the certain devices.

To allow further testing, we can add APT rule to prevent any linux-image* from being autoremoved temporary as well?

k-plan commented 6 years ago

@Fourdee

the C1 should work

🈴 Odroid C1+ running Meveric Jessie (last Kernel 3.x) > Stretch

171231-0001

Required Information:

DietPi Version | v.
SBC Device | NULL (index=10)
Distro | stretch (index=4)
Command | G_AGI: apt-transport-https apt-utils bash-completion bc bzip2 ca-certificates console-setup cron curl dbus debconf dosfstools dphys-swapfile dropbear ethtool fake-hwclock fbset firmware-realtek gnupg hdparm hfsplus htop initramfs-tools iputils-ping isc-dhcp-client locales nano net-tools ntfs-3g ntp p7zip-full parted psmisc resolvconf sudo tzdata unzip usbutils wget whiptail wput zip linux-image-armhf-odroid-c1 crda firmware-atheros firmware-brcm80211 firmware-ralink iw rfkill wireless-tools wpasupplicant
Error Handler | G_ERROR_HANDLER

Additional Information (if applicable):

Software title | DietPi-PREP_SYSTEM_FOR_DIETPI

Expected behaviour:

Actual behaviour:

[Error] Unable to continue, the program will now terminate.

Steps to reproduce:

Additional logs:

Log file contents:
E: Method https has died unexpectedly!
E: Sub-process https received a segmentation fault.
E: Method /usr/lib/apt/methods/https did not start correctly

Stop for now. Must leave the house for New Year's party.

Wish you all a Happy New Year 🚀 💥 🍸

Fourdee commented 6 years ago

@k-plan

E: Sub-process https received a segmentation fault.

Hardware failure by looks of it ☹️. Board/SDcard/PSU.

Might be an issue with script, i'll run a test on my C2. Yep fine, although doesn't rule out a possible issue with C1 and script, however, seg fault usually means hardware issue.

k-plan commented 6 years ago

@Fourdee

Hardware failure by looks of it . Board/SDcard/PSU. r, seg fault usually means hardware issue.

I don't think so. Same messages as on Odroid XU4/HC1 : https://github.com/Fourdee/DietPi/issues/1285#issuecomment-354602656

But I will give #1362 a try.

MichaIng commented 6 years ago

@Fourdee @k-plan If you search the web, you will find a mass of issues with this error message, including some with "method http" or "method http+curl" as some people try to solve it by using curl as default method. Sadly I couldn't find some root fix for now, some evasive symptom fixes (basically change to "http" or "http+curl" within the sources, completely remove additional sources and stuff like stat), but the error can generally also occur there.

At least one thing took my interest: /usr/lib/methods/curl+http --> /usr/lib/methods/curl Within this methods folder are the binaries, which fail in case of error:

ls -l /usr/lib/apt/methods/
total 640
lrwxrwxrwx 1 root root      5 Sep 13 18:47 bzip2 -> store
-rwxr-xr-x 1 root root  34976 Sep 13 18:47 cdrom
-rwxr-xr-x 1 root root  18592 Sep 13 18:47 copy
-rwxr-xr-x 1 root root  18592 Sep 13 18:47 file
-rwxr-xr-x 1 root root  63744 Sep 13 18:47 ftp
-rwxr-xr-x 1 root root  55456 Sep 13 18:47 gpgv
lrwxrwxrwx 1 root root      5 Sep 13 18:47 gzip -> store
-rwxr-xr-x 1 root root 112808 Sep 13 18:47 http
-rwxr-xr-x 1 root root  92328 Sep 13 18:47 https
lrwxrwxrwx 1 root root      5 Sep 13 18:47 lzma -> store
-rwxr-xr-x 1 root root 137448 Sep 13 18:47 mirror
-rwxr-xr-x 1 root root  47264 Sep 13 18:47 rred
-rwxr-xr-x 1 root root  30896 Sep 13 18:47 rsh
lrwxrwxrwx 1 root root      3 Sep 13 18:47 ssh -> rsh
-rwxr-xr-x 1 root root  22688 Sep 13 18:47 store
lrwxrwxrwx 1 root root      5 Sep 13 18:47 xz -> store

Maybe we need to reload some libraries/ldconfig or something after switching to https/install apt-transport-https or something? I am not too deep in all this library/binary stuff, sorry 😆.

Another thing that made me thinking is, about the error with the completely removed kernel package. Depending on the starting system setup (in case of meverics odroid image, this might change a bid faster as for Debian mini.iso's) we might purge some other basic system functions in between as well. We could consider generally installing our core packages first, before purging the other packages. I am not sure, how much installation/configuration depends on other installed packages, but we could simply create an image both methods, with purging>installing and installing>purging and compare the result.

k-plan commented 6 years ago

Image: (NR_4.x)_DietPi_v158_OdroidXU4-armv7-(Jessie).img => fresh install, auto updated to v159

root@DietPi:~# ls -l /usr/lib/apt/methods/
total 424
lrwxrwxrwx 1 root root     4 May  5  2017 bzip2 -> gzip
-rwxr-xr-x 1 root root 26064 May  5  2017 cdrom
-rwxr-xr-x 1 root root 13776 May  5  2017 copy
-rwxr-xr-x 1 root root 17872 May  5  2017 file
-rwxr-xr-x 1 root root 46576 May  5  2017 ftp
-rwxr-xr-x 1 root root 21968 May  5  2017 gpgv
-rwxr-xr-x 1 root root 17872 May  5  2017 gzip
-rwxr-xr-x 1 root root 62932 May  5  2017 http
-rwxr-xr-x 1 root root 58836 May  5  2017 https
lrwxrwxrwx 1 root root     4 May  5  2017 lzma -> gzip
-rwxr-xr-x 1 root root 83412 May  5  2017 mirror
-rwxr-xr-x 1 root root 30160 May  5  2017 rred
-rwxr-xr-x 1 root root 26072 May  5  2017 rsh
lrwxrwxrwx 1 root root     3 May  5  2017 ssh -> rsh
lrwxrwxrwx 1 root root     4 May  5  2017 xz -> gzip

k-plan commented 6 years ago

Image (by meveric): Debian-Jessie-1.1.4-20171121-XU3+XU4.img => fresh install, no updates

root@odroid-jessie:~# ls -l /usr/lib/apt/methods/
total 402
lrwxrwxrwx 1 root root     4 Dec 11  2016 bzip2 -> gzip
-rwxr-xr-x 1 root root 26064 Dec 11  2016 cdrom
-rwxr-xr-x 1 root root 13776 Dec 11  2016 copy
-rwxr-xr-x 1 root root 17872 Dec 11  2016 file
-rwxr-xr-x 1 root root 46576 Dec 11  2016 ftp
-rwxr-xr-x 1 root root 21968 Dec 11  2016 gpgv
-rwxr-xr-x 1 root root 17872 Dec 11  2016 gzip
-rwxr-xr-x 1 root root 62932 Dec 11  2016 http
-rwxr-xr-x 1 root root 58836 Dec 11  2016 https
lrwxrwxrwx 1 root root     4 Dec 11  2016 lzma -> gzip
-rwxr-xr-x 1 root root 83412 Dec 11  2016 mirror
-rwxr-xr-x 1 root root 30160 Dec 11  2016 rred
-rwxr-xr-x 1 root root 26072 Dec 11  2016 rsh
lrwxrwxrwx 1 root root     3 Dec 11  2016 ssh -> rsh
lrwxrwxrwx 1 root root     4 Dec 11  2016 xz -> gzip

Hmm ... can't see a difference.

# make sure the image is fully updated:
apt-get update && apt-get upgrade && reboot ## because of kernel,linux-image, linux-header update

root@odroid-jessie:~# ls -l /usr/lib/apt/methods/
total 402
lrwxrwxrwx 1 root root     4 Dec 11  2016 bzip2 -> gzip
-rwxr-xr-x 1 root root 26064 Dec 11  2016 cdrom
-rwxr-xr-x 1 root root 13776 Dec 11  2016 copy
-rwxr-xr-x 1 root root 17872 Dec 11  2016 file
-rwxr-xr-x 1 root root 46576 Dec 11  2016 ftp
-rwxr-xr-x 1 root root 21968 Dec 11  2016 gpgv
-rwxr-xr-x 1 root root 17872 Dec 11  2016 gzip
-rwxr-xr-x 1 root root 62932 Dec 11  2016 http
-rwxr-xr-x 1 root root 58836 Dec 11  2016 https
lrwxrwxrwx 1 root root     4 Dec 11  2016 lzma -> gzip
-rwxr-xr-x 1 root root 83412 Dec 11  2016 mirror
-rwxr-xr-x 1 root root 30160 Dec 11  2016 rred
-rwxr-xr-x 1 root root 26072 Dec 11  2016 rsh
lrwxrwxrwx 1 root root     3 Dec 11  2016 ssh -> rsh
lrwxrwxrwx 1 root root     4 Dec 11  2016 xz -> gzip

k-plan commented 6 years ago

What a mess ...

🈴 Can't get it running on Debian-Jessie-1.1.4-20171121-XU3+XU4.img

GIT_BRANCH='9ccbf344e1e28b23154c71e696c5559afe161cfb'

....
Processing triggers for systemd (232-25+deb9u1) ...
Processing triggers for ca-certificates (20161130+nmu1) ...
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
W: Size of file /var/cache/apt/archives/partial/libc-l10n_2.24-11+deb9u1_all.deb is not what the server reported 819636 337
W: Size of file /var/cache/apt/archives/partial/libc6_2.24-11+deb9u1_armhf.deb is not what the server reported 2338890 8192
W: Size of file /var/cache/apt/archives/partial/libc-bin_2.24-11+deb9u1_armhf.deb is not what the server reported 682610 338
W: Size of file /var/cache/apt/archives/partial/debconf_1.5.61_all.deb is not what the server reported 159498 329
W: Size of file /var/cache/apt/archives/partial/gcc-6-base_6.3.0-18_armhf.deb is not what the server reported 179856 334
W: Size of file /var/cache/apt/archives/partial/libgcc1_1%3a6.3.0-18_armhf.deb is not what the server reported 38504 8192
W: Size of file /var/cache/apt/archives/partial/libaudit-common_1%3a2.6.7-2_all.deb is not what the server reported 18108 4096
W: Size of file /var/cache/apt/archives/partial/libcap-ng0_0.7.7-3+b1_armhf.deb is not what the server reported 12664 8192
W: Size of file /var/cache/apt/archives/partial/libaudit1_1%3a2.6.7-2_armhf.deb is not what the server reported 48490 8192
W: Size of file /var/cache/apt/archives/partial/libpam0g_1.1.8-3.6_armhf.deb is not what the server reported 119664 331
W: Size of file /var/cache/apt/archives/partial/libpcre3_2%3a8.39-3_armhf.deb is not what the server reported 317376 330
W: Size of file /var/cache/apt/archives/partial/libselinux1_2.6-3+b3_armhf.deb is not what the server reported 93372 343
W: Size of file /var/cache/apt/archives/partial/libsepol1_2.6-2_armhf.deb is not what the server reported 211668 336
W: Size of file /var/cache/apt/archives/partial/libsemanage-common_2.6-2_all.deb is not what the server reported 26924 4096
W: Size of file /var/cache/apt/archives/partial/libsemanage1_2.6-2_armhf.deb is not what the server reported 91612 342
W: Size of file /var/cache/apt/archives/partial/libbz2-1.0_1.0.6-8.1_armhf.deb is not what the server reported 41914 4096
W: Size of file /var/cache/apt/archives/partial/libustr-1.0-1_1.0.4-6_armhf.deb is not what the server reported 58436 335
W: Size of file /var/cache/apt/archives/partial/libpam-modules-bin_1.1.8-3.6_armhf.deb is not what the server reported 101704 4096
W: Size of file /var/cache/apt/archives/partial/libpam-modules_1.1.8-3.6_armhf.deb is not what the server reported 289934 337
W: Size of file /var/cache/apt/archives/partial/passwd_1%3a4.4-4.1_armhf.deb is not what the server reported 958144 330
W: Size of file /var/cache/apt/archives/partial/libuuid1_2.29.2-1_armhf.deb is not what the server reported 69562 337
W: Size of file /var/cache/apt/archives/partial/libfdisk1_2.29.2-1_armhf.deb is not what the server reported 189588 4096
W: Size of file /var/cache/apt/archives/partial/libtinfo5_6.0+20161126-1+deb9u1_armhf.deb is not what the server reported 288068 348
W: Size of file /var/cache/apt/archives/partial/libncursesw5_6.0+20161126-1+deb9u1_armhf.deb is not what the server reported 94722 351
W: Size of file /var/cache/apt/archives/partial/libncurses5_6.0+20161126-1+deb9u1_armhf.deb is not what the server reported 74610 350
W: Size of file /var/cache/apt/archives/partial/libsmartcols1_2.29.2-1_armhf.deb is not what the server reported 116036 342
W: Size of file /var/cache/apt/archives/partial/base-files_9.9+deb9u3_armhf.deb is not what the server reported 67258 341
W: Size of file /var/cache/apt/archives/partial/sensible-utils_0.0.9+deb9u1_all.deb is not what the server reported 10756 8192
W: Size of file /var/cache/apt/archives/partial/debianutils_4.8.1.1_armhf.deb is not what the server reported 99254 340
W: Size of file /var/cache/apt/archives/partial/bash_4.4-5_armhf.deb is not what the server reported 1371334 324
W: Size of file /var/cache/apt/archives/partial/bash-completion_1%3a2.1-4.3_all.deb is not what the server reported 178338 346
W: Size of file /var/cache/apt/archives/partial/util-linux_2.29.2-1_armhf.deb is not what the server reported 918218 339
W: Size of file /var/cache/apt/archives/partial/init-system-helpers_1.48_all.deb is not what the server reported 44018 8192
W: Size of file /var/cache/apt/archives/partial/sysvinit-utils_2.88dsf-59.9_armhf.deb is not what the server reported 67266 345
W: Size of file /var/cache/apt/archives/partial/startpar_0.59-3.1_armhf.deb is not what the server reported 21686 4096
W: Size of file /var/cache/apt/archives/partial/insserv_1.14.0-5.4+b1_armhf.deb is not what the server reported 60170 338
W: Size of file /var/cache/apt/archives/partial/sysv-rc_2.88dsf-59.9_all.deb is not what the server reported 67416 336
W: Size of file /var/cache/apt/archives/partial/libdbus-1-3_1.10.24-0+deb9u1_armhf.deb is not what the server reported 174330 342
W: Size of file /var/cache/apt/archives/partial/libreadline7_7.0-3_armhf.deb is not what the server reported 131412 336
W: Size of file /var/cache/apt/archives/partial/libssl1.0.2_1.0.2l-2+deb9u2_armhf.deb is not what the server reported 918778 364
W: Size of file /var/cache/apt/archives/partial/wpasupplicant_2%3a2.4-1+deb9u1_armhf.deb is not what the server reported 847768 339
W: Size of file /var/cache/apt/archives/partial/initscripts_2.88dsf-59.9_armhf.deb is not what the server reported 84480 342
W: Size of file /var/cache/apt/archives/partial/libgpg-error0_1.26-2_armhf.deb is not what the server reported 107824 345
W: Size of file /var/cache/apt/archives/partial/libgcrypt20_1.7.6-2+deb9u2_armhf.deb is not what the server reported 467210 350
W: Size of file /var/cache/apt/archives/partial/liblz4-1_0.0~r131-2+b1_armhf.deb is not what the server reported 31418 335
W: Size of file /var/cache/apt/archives/partial/libapparmor1_2.11.0-3_armhf.deb is not what the server reported 74714 339
W: Size of file /var/cache/apt/archives/partial/libip4tc0_1.6.0+snapshot20161117-6_armhf.deb is not what the server reported 66136 352
W: Size of file /var/cache/apt/archives/partial/libmount1_2.29.2-1_armhf.deb is not what the server reported 164638 338
W: Size of file /var/cache/apt/archives/partial/libseccomp2_2.3.1-2.1_armhf.deb is not what the server reported 32258 4096
W: Size of file /var/cache/apt/archives/partial/mount_2.29.2-1_armhf.deb is not what the server reported 181252 334
W: Size of file /var/cache/apt/archives/partial/libsystemd0_232-25+deb9u1_armhf.deb is not what the server reported 258958 342
W: Size of file /var/cache/apt/archives/partial/libklibc_2.0.4-9_armhf.deb is not what the server reported 50112 331
W: Size of file /var/cache/apt/archives/partial/klibc-utils_2.0.4-9_armhf.deb is not what the server reported 97142 334
W: Size of file /var/cache/apt/archives/partial/e2fslibs_1.43.4-2_armhf.deb is not what the server reported 196780 336
W: Size of file /var/cache/apt/archives/partial/e2fsprogs_1.43.4-2_armhf.deb is not what the server reported 931070 337
W: Size of file /var/cache/apt/archives/partial/initramfs-tools_0.130_all.deb is not what the server reported 65976 344
W: Size of file /var/cache/apt/archives/partial/initramfs-tools-core_0.130_all.deb is not what the server reported 96964 349
W: Size of file /var/cache/apt/archives/partial/linux-base_4.5_all.deb is not what the server reported 19130 4096
W: Size of file /var/cache/apt/archives/partial/systemd-sysv_232-25+deb9u1_armhf.deb is not what the server reported 80682 343
W: Size of file /var/cache/apt/archives/partial/libudev1_232-25+deb9u1_armhf.deb is not what the server reported 118974 339
W: Size of file /var/cache/apt/archives/partial/udev_232-25+deb9u1_armhf.deb is not what the server reported 1076744 4096
W: Size of file /var/cache/apt/archives/partial/systemd_232-25+deb9u1_armhf.deb is not what the server reported 2269164 338
W: Size of file /var/cache/apt/archives/partial/libattr1_1%3a2.4.47-2+b2_armhf.deb is not what the server reported 17084 4096
W: Size of file /var/cache/apt/archives/partial/acl_2.2.52-3+b1_armhf.deb is not what the server reported 56868 4096
W: Size of file /var/cache/apt/archives/partial/libacl1_2.2.52-3+b1_armhf.deb is not what the server reported 25546 4096
W: Size of file /var/cache/apt/archives/partial/lsb-base_9.20161125_all.deb is not what the server reported 27934 4096
W: Size of file /var/cache/apt/archives/partial/kmod_23-2_armhf.deb is not what the server reported 78162 323
W: Size of file /var/cache/apt/archives/partial/libkmod2_23-2_armhf.deb is not what the server reported 43356 8192
W: Size of file /var/cache/apt/archives/partial/adduser_3.115_all.deb is not what the server reported 241436 4096
W: Size of file /var/cache/apt/archives/partial/libprocps6_2%3a3.3.12-3_armhf.deb is not what the server reported 55330 335
W: Size of file /var/cache/apt/archives/partial/procps_2%3a3.3.12-3_armhf.deb is not what the server reported 243926 331
W: Size of file /var/cache/apt/archives/partial/cpio_2.11+dfsg-6_armhf.deb is not what the server reported 172158 4096
W: Size of file /var/cache/apt/archives/partial/libcap2_1%3a2.25-1_armhf.deb is not what the server reported 15816 4096
W: Size of file /var/cache/apt/archives/partial/libdevmapper1.02.1_2%3a1.02.137-2_armhf.deb is not what the server reported 159754 343
W: Size of file /var/cache/apt/archives/partial/dmsetup_2%3a1.02.137-2_armhf.deb is not what the server reported 106726 332
W: Size of file /var/cache/apt/archives/partial/libcryptsetup4_2%3a1.7.3-4_armhf.deb is not what the server reported 101570 342
W: Size of file /var/cache/apt/archives/partial/libidn11_1.33-1_armhf.deb is not what the server reported 111620 334
W: Size of file /var/cache/apt/archives/partial/liblzma5_5.2.2-1.2+b1_armhf.deb is not what the server reported 226144 339
W: Size of file /var/cache/apt/archives/partial/tar_1.29b-1.1_armhf.deb is not what the server reported 737720 326
W: Size of file /var/cache/apt/archives/partial/libpam-runtime_1.1.8-3.6_all.deb is not what the server reported 211970 335
W: Size of file /var/cache/apt/archives/partial/cron_3.0pl1-128+b1_armhf.deb is not what the server reported 92386 332
W: Size of file /var/cache/apt/archives/partial/dpkg_1.18.24_armhf.deb is not what the server reported 2069928 326
W: Size of file /var/cache/apt/archives/partial/readline-common_7.0-3_all.deb is not what the server reported 70446 337
W: Size of file /var/cache/apt/archives/partial/libnl-genl-3-200_3.2.27-2_armhf.deb is not what the server reported 19142 4096
W: Size of file /var/cache/apt/archives/partial/libnl-3-200_3.2.27-2_armhf.deb is not what the server reported 54140 339
W: Size of file /var/cache/apt/archives/partial/libpcsclite1_1.8.20-1_armhf.deb is not what the server reported 54162 4096
W: Size of file /var/cache/apt/archives/partial/coreutils_8.26-3_armhf.deb is not what the server reported 2781622 335
W: Size of file /var/cache/apt/archives/partial/libtext-charwidth-perl_0.04-7+b6_armhf.deb is not what the server reported 9430 8192
W: Size of file /var/cache/apt/archives/partial/libtext-iconv-perl_1.7-5+b4_armhf.deb is not what the server reported 14606 8192
W: Size of file /var/cache/apt/archives/partial/perl-base_5.24.1-3+deb9u2_armhf.deb is not what the server reported 1238020 339
W: Size of file /var/cache/apt/archives/partial/liblocale-gettext-perl_1.07-3+b1_armhf.deb is not what the server reported 18390 8192
W: Size of file /var/cache/apt/archives/partial/init_1.48_armhf.deb is not what the server reported 12010 8192
W: Size of file /var/cache/apt/archives/partial/bsdutils_1%3a2.29.2-1_armhf.deb is not what the server reported 107228 337
W: Size of file /var/cache/apt/archives/partial/dash_0.5.8-2.4_armhf.deb is not what the server reported 103570 4096
W: Size of file /var/cache/apt/archives/partial/diffutils_1%3a3.5-3_armhf.deb is not what the server reported 303198 334
W: Size of file /var/cache/apt/archives/partial/findutils_4.6.0+git+20161106-2_armhf.deb is not what the server reported 607580 349
W: Size of file /var/cache/apt/archives/partial/grep_2.27-2_armhf.deb is not what the server reported 370478 325
W: Size of file /var/cache/apt/archives/partial/gzip_1.6-5+b1_armhf.deb is not what the server reported 108130 327
W: Size of file /var/cache/apt/archives/partial/hostname_3.18+b1_armhf.deb is not what the server reported 14112 8192
W: Size of file /var/cache/apt/archives/partial/login_1%3a4.4-4.1_armhf.deb is not what the server reported 787880 4096
W: Size of file /var/cache/apt/archives/partial/ncurses-bin_6.0+20161126-1+deb9u1_armhf.deb is not what the server reported 359710 350
W: Size of file /var/cache/apt/archives/partial/sed_4.4-1_armhf.deb is not what the server reported 273414 322
W: Size of file /var/cache/apt/archives/partial/libstdc++6_6.3.0-18_armhf.deb is not what the server reported 346528 334
W: Size of file /var/cache/apt/archives/partial/zlib1g_1%3a1.2.8.dfsg-5_armhf.deb is not what the server reported 82358 4096
W: Size of file /var/cache/apt/archives/partial/libapt-inst2.0_1.4.8_armhf.deb is not what the server reported 189874 333
W: Size of file /var/cache/apt/archives/partial/apt-utils_1.4.8_armhf.deb is not what the server reported 397670 328
W: Size of file /var/cache/apt/archives/partial/debian-archive-keyring_2017.5_all.deb is not what the server reported 56438 8192
W: Size of file /var/cache/apt/archives/partial/libapt-pkg5.0_1.4.8_armhf.deb is not what the server reported 851258 332
W: Size of file /var/cache/apt/archives/partial/apt_1.4.8_armhf.deb is not what the server reported 1198552 322
W: Size of file /var/cache/apt/archives/partial/libdb5.3_5.3.28-12+deb9u1_armhf.deb is not what the server reported 594978 340
W: Size of file /var/cache/apt/archives/partial/gpgv_2.1.18-8~deb9u1_armhf.deb is not what the server reported 453060 336
W: Size of file /var/cache/apt/archives/partial/libdebconfclient0_0.227_armhf.deb is not what the server reported 47410 4096
W: Size of file /var/cache/apt/archives/partial/base-passwd_3.5.43_armhf.deb is not what the server reported 56568 339
W: Size of file /var/cache/apt/archives/partial/ncurses-base_6.0+20161126-1+deb9u1_all.deb is not what the server reported 237998 349
W: Size of file /var/cache/apt/archives/partial/mawk_1.3.3-17+b3_armhf.deb is not what the server reported 77160 330
W: Size of file /var/cache/apt/archives/partial/netbase_5.4_all.deb is not what the server reported 19050 4096
W: Size of file /var/cache/apt/archives/partial/libbsd0_0.8.3-1_armhf.deb is not what the server reported 89644 334
W: Size of file /var/cache/apt/archives/partial/libedit2_3.1-20160903-3_armhf.deb is not what the server reported 69852 343
W: Size of file /var/cache/apt/archives/partial/libopts25_1%3a5.18.12-3_armhf.deb is not what the server reported 61078 8192
W: Size of file /var/cache/apt/archives/partial/libssl1.1_1.1.0f-3+deb9u1_armhf.deb is not what the server reported 1137372 342
W: Size of file /var/cache/apt/archives/partial/ntp_1%3a4.2.8p10+dfsg-3+deb9u1_armhf.deb is not what the server reported 553730 4096
W: Size of file /var/cache/apt/archives/partial/libassuan0_2.4.3-2_armhf.deb is not what the server reported 36286 8192
W: Size of file /var/cache/apt/archives/partial/pinentry-curses_1.0.0-2_armhf.deb is not what the server reported 46648 8192
W: Size of file /var/cache/apt/archives/partial/libnpth0_1.3-1_armhf.deb is not what the server reported 13598 8192
W: Size of file /var/cache/apt/archives/partial/gnupg-agent_2.1.18-8~deb9u1_armhf.deb is not what the server reported 512398 343
W: Size of file /var/cache/apt/archives/partial/libksba8_1.3.5-2_armhf.deb is not what the server reported 85888 336
W: Size of file /var/cache/apt/archives/partial/libsqlite3-0_3.16.2-5+deb9u1_armhf.deb is not what the server reported 498696 345
W: Size of file /var/cache/apt/archives/partial/gnupg_2.1.18-8~deb9u1_armhf.deb is not what the server reported 1058666 337
W: Size of file /var/cache/apt/archives/partial/libslang2_2.3.1-5_armhf.deb is not what the server reported 461446 333
W: Size of file /var/cache/apt/archives/partial/libcomerr2_1.43.4-2_armhf.deb is not what the server reported 62898 338
W: Size of file /var/cache/apt/archives/partial/libss2_1.43.4-2_armhf.deb is not what the server reported 66424 334
W: Size of file /var/cache/apt/archives/partial/multiarch-support_2.24-11+deb9u1_armhf.deb is not what the server reported 199634 347
W: Size of file /var/cache/apt/archives/partial/tzdata_2017c-0+deb9u1_all.deb is not what the server reported 262110 335
W: Size of file /var/cache/apt/archives/partial/libusb-0.1-4_2%3a0.1.12-30_armhf.deb is not what the server reported 21350 4096
W: Size of file /var/cache/apt/archives/partial/libelf1_0.168-1_armhf.deb is not what the server reported 154328 333
W: Size of file /var/cache/apt/archives/partial/libmnl0_1.0.4-2_armhf.deb is not what the server reported 11150 4096
W: Size of file /var/cache/apt/archives/partial/iproute2_4.9.0-1+deb9u1_armhf.deb is not what the server reported 598322 4096
W: Size of file /var/cache/apt/archives/partial/libnettle6_3.3-1+b2_armhf.deb is not what the server reported 210616 8192
W: Size of file /var/cache/apt/archives/partial/iputils-ping_3%3a20161105-1_armhf.deb is not what the server reported 56762 340
W: Size of file /var/cache/apt/archives/partial/libisc-export160_1%3a9.10.3.dfsg.P4-12.3+deb9u3_armhf.deb is not what the server reported 317982 358
W: Size of file /var/cache/apt/archives/partial/libdns-export162_1%3a9.10.3.dfsg.P4-12.3+deb9u3_armhf.deb is not what the server reported 789518 358
W: Size of file /var/cache/apt/archives/partial/isc-dhcp-client_4.3.5-3_armhf.deb is not what the server reported 304126 341
W: Size of file /var/cache/apt/archives/partial/isc-dhcp-common_4.3.5-3_armhf.deb is not what the server reported 135922 4096
W: Size of file /var/cache/apt/archives/partial/libnewt0.52_0.52.19-1+b1_armhf.deb is not what the server reported 65660 338
W: Size of file /var/cache/apt/archives/partial/libpopt0_1.16-10+b2_armhf.deb is not what the server reported 46124 8192
W: Size of file /var/cache/apt/archives/partial/nano_2.7.4-1_armhf.deb is not what the server reported 475494 326
W: Size of file /var/cache/apt/archives/partial/libgmp10_2%3a6.1.2+dfsg-1_armhf.deb is not what the server reported 194550 334
W: Size of file /var/cache/apt/archives/partial/libhogweed4_3.3-1+b2_armhf.deb is not what the server reported 126378 336
W: Size of file /var/cache/apt/archives/partial/libffi6_3.2.1-6_armhf.deb is not what the server reported 18928 4096
W: Size of file /var/cache/apt/archives/partial/libp11-kit0_0.23.3-2_armhf.deb is not what the server reported 96664 337
W: Size of file /var/cache/apt/archives/partial/libtasn1-6_4.10-1.1_armhf.deb is not what the server reported 45516 8192
W: Size of file /var/cache/apt/archives/partial/libgnutls30_3.5.8-5+deb9u3_armhf.deb is not what the server reported 840036 4096
W: Size of file /var/cache/apt/archives/partial/libunistring0_0.9.6+really0.9.3-0.1_armhf.deb is not what the server reported 255374 360
W: Size of file /var/cache/apt/archives/partial/libidn2-0_0.16-1+deb9u1_armhf.deb is not what the server reported 58750 345
W: Size of file /var/cache/apt/archives/partial/libpsl5_0.17.0-3_armhf.deb is not what the server reported 40694 4096
W: Size of file /var/cache/apt/archives/partial/wget_1.18-5+deb9u1_armhf.deb is not what the server reported 781320 332
W: Size of file /var/cache/apt/archives/partial/whiptail_0.52.19-1+b1_armhf.deb is not what the server reported 37422 8192
W: Size of file /var/cache/apt/archives/partial/libgnutls-openssl27_3.5.8-5+deb9u3_armhf.deb is not what the server reported 181868 352
W: Size of file /var/cache/apt/archives/partial/libkeyutils1_1.5.9-9_armhf.deb is not what the server reported 11766 4096
W: Size of file /var/cache/apt/archives/partial/libgssapi-krb5-2_1.15-1+deb9u1_armhf.deb is not what the server reported 133324 344
W: Size of file /var/cache/apt/archives/partial/libkrb5-3_1.15-1+deb9u1_armhf.deb is not what the server reported 266846 337
W: Size of file /var/cache/apt/archives/partial/libk5crypto3_1.15-1+deb9u1_armhf.deb is not what the server reported 117200 340
W: Size of file /var/cache/apt/archives/partial/libkrb5support0_1.15-1+deb9u1_armhf.deb is not what the server reported 58000 343
W: Size of file /var/cache/apt/archives/partial/libsasl2-modules-db_2.1.27~101-g0780600+dfsg-3_armhf.deb is not what the server reported 66712 367
W: Size of file /var/cache/apt/archives/partial/libsasl2-2_2.1.27~101-g0780600+dfsg-3_armhf.deb is not what the server reported 98172 358
W: Size of file /var/cache/apt/archives/partial/libldap-common_2.4.44+dfsg-5+deb9u1_all.deb is not what the server reported 85370 351
W: Size of file /var/cache/apt/archives/partial/libldap-2.4-2_2.4.44+dfsg-5+deb9u1_armhf.deb is not what the server reported 197320 352
W: Size of file /var/cache/apt/archives/partial/libnghttp2-14_1.18.1-1_armhf.deb is not what the server reported 69056 339
W: Size of file /var/cache/apt/archives/partial/libssh2-1_1.7.0-1_armhf.deb is not what the server reported 127620 337
W: Size of file /var/cache/apt/archives/partial/libcurl3-gnutls_7.52.1-5+deb9u3_armhf.deb is not what the server reported 261788 345
W: Size of file /var/cache/apt/archives/partial/apt-transport-https_1.4.8_armhf.deb is not what the server reported 166882 338
W: Size of file /var/cache/apt/archives/partial/openssl_1.1.0f-3+deb9u1_armhf.deb is not what the server reported 702704 340
W: Size of file /var/cache/apt/archives/partial/ca-certificates_20161130+nmu1_all.deb is not what the server reported 195794 352
W: Size of file /var/cache/apt/archives/partial/curl_7.52.1-5+deb9u3_armhf.deb is not what the server reported 223322 334
W: Size of file /var/cache/apt/archives/partial/libcurl3_7.52.1-5+deb9u3_armhf.deb is not what the server reported 263772 4096
W: Size of file /var/cache/apt/archives/partial/htop_2.0.2-1_armhf.deb is not what the server reported 78964 326
W: Size of file /var/cache/apt/archives/partial/libcap2-bin_1%3a2.25-1_armhf.deb is not what the server reported 26422 4096
W: Size of file /var/cache/apt/archives/partial/libiw30_30~pre9-12+b1_armhf.deb is not what the server reported 19354 4096
W: Size of file /var/cache/apt/archives/partial/libtext-wrapi18n-perl_0.06-7.1_all.deb is not what the server reported 8644 2001
W: Size of file /var/cache/apt/archives/partial/net-tools_1.60+git20161116.90da8a0-1_armhf.deb is not what the server reported 234404 355
W: Size of file /var/cache/apt/archives/partial/sudo_1.8.19p1-2.1_armhf.deb is not what the server reported 1034598 331
W: Size of file /var/cache/apt/archives/partial/u-boot-tools_2016.11+dfsg1-4_armhf.deb is not what the server reported 102872 344
W: Size of file /var/cache/apt/archives/partial/unzip_6.0-21_armhf.deb is not what the server reported 156334 4096
W: Size of file /var/cache/apt/archives/partial/wireless-tools_30~pre9-12+b1_armhf.deb is not what the server reported 109694 352
 [Ok] G_AGDUG:
 [Info] Disabling swapfile generation for dphys-swapfile during install
 [Info] Installing core DietPi pre-req APT packages
 [Info] APT installation for: apt-transport-https apt-utils bash-completion bc bzip2 ca-certificates console-setup cron curl dbus debconf dosfstools dphys-swapfile dropbear ethtool fake-hwclock fbset firmware-realtek gnupg hdparm hfsplus htop initramfs-tools iputils-ping isc-dhcp-client locales nano net-tools ntfs-3g ntp p7zip-full parted psmisc resolvconf sudo tzdata unzip usbutils wget whiptail wput zip crda firmware-atheros firmware-brcm80211 firmware-ralink iw rfkill wireless-tools wpasupplicant
 [Info] APT is processing, please wait...

E: Method https has died unexpectedly!
E: Sub-process https received a segmentation fault.
E: Method /usr/lib/apt/methods/https did not start correctly
sed: can't read /DietPi/dietpi/.version: No such file or directory
sed: can't read /DietPi/dietpi/.version: No such file or directory

 [Error] DietPi-PREP_SYSTEM_FOR_DIETPI: G_AGI: apt-transport-https apt-utils bash-completion bc bzip2 ca-certificates console-setup cron curl dbus debconf dosfstools dphys-swapfile dropbear ethtool fake-hwclock fbset firmware-realtek gnupg hdparm hfsplus htop initramfs-tools iputils-ping isc-dhcp-client locales nano net-tools ntfs-3g ntp p7zip-full parted psmisc resolvconf sudo tzdata unzip usbutils wget whiptail wput zip crda firmware-atheros firmware-brcm80211 firmware-ralink iw rfkill wireless-tools wpasupplicant
 [Info] exit_code = 100
 [Info] VERSION:v. | HW_MODEL:11 | HW_ARCH:0 | DISTRO:4
 [Info] Log file contents:
E: Method https has died unexpectedly!
E: Sub-process https received a segmentation fault.
E: Method /usr/lib/apt/methods/https did not start correctly
 [Info] If problems persist, please report this to DietPi for investigation, including a screenshot of this error! (https://github.com/Fourdee/DietPi/issues).
sed: can't read /DietPi/dietpi/.version: No such file or directory
sed: can't read /DietPi/dietpi/.version: No such file or directory

After 10x unsuccessful effort, now try DietPi_v158_OdroidXU4-armv7-(Jessie).img to look what's happen.

k-plan commented 6 years ago

🈯️ Try out DietPi_v158_OdroidXU4-armv7-(Jessie).img PREP work like a charm! 👍 😄 But no chance with meveric Debian-Jessie-1.1.4-20171121-XU3+XU4.img Think, something is missing ... 😢 but can't figure out what it is. Anyway, I can build a v6 image.

You wan't to review the latest commits? Want to merge, to make testing live easier for @k-plan 😄.

Lol, @k-plan had bad experience lately ❤️ 😄. Yep, lets fix it 😃

Not with you, boys and girls. You are my favorit bash scripting heros! ❤️ 😃

I will leave you alone for now, so you can do you coding stuff unhurriedly without interruption. Will quarrel wife and family from now on.

Congratulations and thanks for your excellent effort! 💯 👍

Give me a sign, whenever I can help with testing some hardware stuff.

k-plan commented 6 years ago

Note for me:

Working devices with this script should be (off top my head):
...
- Odroid's
...

For Jessie yes, for Stretch no, think Buster can't work at the moment? (missing in meveric repository?).

Better we will have a look in PREP_SYSTEM_FOR_DIETPI.sh:

...
[    Ok    ] Completed, disk can now be saved to .img for later use, or, reboot system to start first run of DietPi:
root@ODROID-HC1_to_STRETCH_image-up:~# ls /etc/apt/sources.list.d/
meveric-all.list  meveric-all-XU3.list  meveric-jessie.list

root@DietPi:~# cat /etc/apt/sources.list.d/meveric-jessie.list
deb http://fuzon.co.uk/meveric jessie main backports

/etc/apt/sources.list.d/meveric-* cause as well the problem with E: Method https has died unexpectedly!

Fourdee commented 6 years ago

@k-plan

Yep, there is a Stretch repo, however, it appears 1/10th in size of Jessie, missing core packages. So for now, we need to stick with Jessie on Meveric's: http://fuzon.co.uk/meveric/dists/stretch/main/binary-armhf/Packages vs http://fuzon.co.uk/meveric/dists/jessie/main/binary-armhf/Packages

Fourdee commented 6 years ago

@k-plan Tested my HC-1:

🈯️ DietPi current image of XU3/4 (jessie) > Stretch
🈯️ Stretch > Stretch

Not seeing E: Method https has died unexpectedly!

Which original image did you use?

k-plan commented 6 years ago

@Fourdee

So for now, we need to stick with Jessie on Meveric's

Hmm ... can I please ask some questions?

Before I started to play around with Jessie => Stretch, I have do some reseach and reading.

Debian (general)

We have to switch over /etc/apt/sources.list . Okay: https://github.com/Fourdee/DietPi/blob/testing/PREP_SYSTEM_FOR_DIETPI.sh#L401-L421
Do some research if something has change since Aug. 2016

https://wiki.debian.org/DebianStretch#Packages_.26_versions Packages & versions apt : 1.4.6 kernel : Linux 4.9 gcc : 6.3 libc : libc6 2.24-11

But with Odroid devices we will stay on Kernel 3.x with Stretch. That doesn't make sense to me. Can we use all vantage from Stretch with 3.x? Debian state Stretch kernel will be Linux 4.9 LTS Yes, I know where is no 4.x for C1 and C2 (Amlogic) from Hardkernel. (http://openlinux.amlogic.com/wiki/index.php/Arm/arm-Kernel_Info/Kernel4.9)

Meveric Debian repository

Have read here:

https://forum.odroid.com/viewtopic.php?f=79&t=25822#p203553 meveric-all is OS independent and don't need to be changed. Switching meveric-jessie to stretch as well as the rest of /etc/apt/sources.list should work fine. All repositories are already in place.

So we shall stay on /etc/apt/sources.list.d/meveric-jessie.list with Stretch on all Odroid devices? Does this sort of "jessie-backports" bring us more trouble than benefit?

Sorry for stupid asking, but I think sooner or later users will ask this as well. I know, you are longer and closer to the whole Hardkernel/Odroid/meveric affair, when I ever will be.

k-plan commented 6 years ago

@Fourdee

Which original image did you use?

https://oph.mdrjr.net/meveric/images/Jessie/Debian-Jessie-1.1.4-20171121-XU3+XU4.img.xz from here: [OS] Debian Jessie

Do so, because you have write up here:

This script will automatically install/configure and convert a fresh Debian/Raspbian installation, into DietPi.

🈴 Meveric Debian-Jessie-1.1.4-20171121-XU3+XU4.img > DietPi Stretch v.6

write it to sd card and fire your HC1/XU4 up.
login as "root" with pwd "odroid"
root@odroid-jessie:~# sudo GIT_BRANCH=$GIT_BRANCH ./PREP_SYSTEM_FOR_DIETPI.sh -bash: sudo: command not found
okay, no sudo here:
GIT_BRANCH=$GIT_BRANCH ./PREP_SYSTEM_FOR_DIETPI.sh Reading package lists... Done Building dependency tree Reading state information... Done E: Unable to locate package sudo Error: Unable to install sudo, please install it manually with - apt-get install -y sudo
okay, apt-get update first: apt-get update && GIT_BRANCH=$GIT_BRANCH ./PREP_SYSTEM_FOR_DIETPI.sh
now you get the first warning (_of many follow up while running PREP_SYS.._): Please check that your locale settings: LANGUAGE = (unset), LC_ALL = (unset), LANG = "en_GB.UTF-8" are supported and installed on your system.
But PREP_SYSTEM_FOR_DIETPI.sh is starting now with ugly looking whiptail:

Result on Odroid HC1:

180104-0007

Yes, https://github.com/Fourdee/DietPi/issues/1285#issuecomment-354602715 will fix ugly looking Whiptail and aviod error messages, but didn't change result.
Yes, first apt-get install curl gnupg1-curl didn't fix issue

k-plan commented 6 years ago

@Fourdee

Retest with your hosted image here: http://fuzon.co.uk/meveric/images/ODROID-GameStation-Turbo-3.9.5-20171115-XU3+XU4-Jessie.img.xz

🈴 Meveric ODROID-GameStation-Turbo-3.9.5-20171115-XU3+XU4-Jessie.img > DietPi Stretch v.6

very impressive to watch how PREP_SYSTEM_FOR_DIETPI.sh strip a 5GB image over 1600 packets down without a mess... 👍 Logfile here: /var/log/apt/term.log

Result on Odroid HC1:

180104-0009

MichaIng commented 6 years ago

@k-plan If I got it right, that we need to stick to Jessie means, that also the Debian repo need to stay Jessie, until the issue with Kodi+Meveric Stretch is solved. So this will hopefully avoid the https method error for now.

As fast as Kodi issue is solved, we can also switch/allow distro upgrading, and then need to solve this https method error. I have still no idea where this is coming from. Does it appear also, if you start with a Meveric Stretch image and just stay on Stretch? Maybe we need to do all purging/upgrading/installing via http (when coming from Jessie) and then adjust the sources to https after the system was fully upgraded. I remember anyway https souces issues with Jessie, but as far as I know, APT did still work.

About kernel: For my experience, kernel version and distro do not need to correlate. Even that Debian Stretch repo ships 4.9, also 3.X should work. Also 4.14 should. So its more about stability if a kernals version in general and the major package version freeze of stable repo, than about compatibility with the distro version.

So as for now on public prelaration script we need to unallow upgrading of Distro on Meveric based devices, generally until Kodi fix, and internally fix this https method issue.

k-plan commented 6 years ago

@MichaIng

Thanks for your answer Micha.

Meveric Stretch image

Hmm ... only can found two: 1x for C2 and 1x for U??? . Both are very outdated. https://oph.mdrjr.net/meveric/images/Stretch/

If I got it right, that we need to stick to Jessie means, that also the Debian repo need to stay Jessie,

Hmm ... possible but if I see here:

@k-plan Tested my HC-1:

🈯️ DietPi current image of XU3/4 (jessie) > Stretch 🈯️ Stretch > Stretch

If I had understand previously correct, you vote for Stretch on all images, if we will switch to DietPi v.6? Or do I mix it up? https://github.com/Fourdee/DietPi/issues/1281 https://github.com/Fourdee/DietPi/issues/475 So I have begin to start upgrading XU4/HC1 image (Jessie) > Stretch It can be my fault. Sorry. But I have learn a lot, thanks to Micha and Dan. ❤️ 😄

About kernel: For my experience, kernel version and distro do not need to correlate. Even that Debian Stretch repo ships 4.9, also 3.X should work.

👍 so I have miss the goal what Debian wiki mean. Have ask this, because a lot of users whine around, because where is no 4.x kernel in DietPi. They mean or hope this and that will work or will work better with a newer kernel. I persanally don't think so or miss something, except of network file transfer performance for XU4/HC1. 😀

With VM's and RPi's where is no Kernel 4.x controversy. You can install what ever you like or can do. But majority of users can or will only hit dietpi-update and claim "maker of DietPi" have to do the rest.

Hope, @Fourdee will throw light on us, so we get a consistent direction. Looking forward to his answer.

MichaIng commented 6 years ago

@k-plan Ah okay, so no real Meveric Stretch image available, I see.

Yeah, @Fourdee seemed to have not the https method error? This is very interesting... But anyway: We already turn off https, when DietPi image/system WILL be Jessie: https://github.com/Fourdee/DietPi/blob/testing/PREP_SYSTEM_FOR_DIETPI.sh#L411 as I faced some warnings there on apt update (thou it worked well through). But instead of doing this depending on target system, we should do this depending on current system. If target system is Stretch or above, then we can switch to https again after Step 5 G_AGDUG (apt-get dist-upgrade). Maybe this solves the issue for you. Will make a PR tomorrow.

Yes I would love to move all our images to Stretch, especially with v6.0, as users need to install it with new image. And as new image is also the preferred way to move from Jessie from Stretch, we could save users the trouble to flash a new image two times. Especially the risk for Odroid users now is high, that they to need to flash twice in short succession because of that. But as Stretch does not yet work well (especially Kodi) on Meverics image, which seems also the reason he is not maintaining up to date Stretch images, there is a good reason to follow.

But this does not mean, that we should not already start to test Meveric > Stretch images! Would be great to switch them instantly, as soon as Meveric fully supports Stretch repo with working Kodi 😃.

@whining users: Hah, I never faced some software feature or something, that needed kernel upgrade, and I lived long time with outdated Raspbian repo kernel. Especially on Meverics repo I just checked, the 3.X kernel is still regularly updated, with a high minor version number, means about stability and reliability they should work great! Yeah theoretical maximum transfer speed, also as you tested, might be lower, but I doubt that many would recognize this during daily use cases. But I can understand, as I also love to stay at newest versions. Want to upgrade my production server to Buster + Ondej's PHP repo for PHP7.2 (https://packages.sury.org/php/) etc. as fast as v6.0 is out (with buster as testing integrated), but this is something I can archive on my individual system with known risk and willing to tinker around, if something fails. And I already tested all software I need on testing Buster VM and did or will fix the issues I face(d) here before release 😛.

Fourdee commented 6 years ago

@k-plan

https://oph.mdrjr.net/meveric/images/Jessie/Debian-Jessie-1.1.4-20171121-XU3+XU4.img.xz from here: [OS] Debian Jessie

I'll test this image, see if we can resolve the issues you mentioned 👍 Yep, this script is designed to run on any Debian minimal image, so we'll iron out the bugs.

for locale issue, maybe we can pre-configure this for install/setup at start of script, although we need to check its installed. Might be better added to the commands, before running PREP_SYSTEM script. Leave it with me.

Kernel wise, we use the officially supported/stable kernel, device specific. Dev/bleeding edge are optional.

Fourdee commented 6 years ago

Re-Test with https://oph.mdrjr.net/meveric/images/Jessie/Debian-Jessie-1.1.4-20171121-XU3+XU4.img.xz:

🈯️ Locale/whiptail issue resolved.
🈺 W: Size of file /var/lib/apt/lists/partial/deb.debian.org_debian_dists_stretch-updates_InRelease is not what the server reported 91028 4096, Unpacking linux-image-3.10.106+ (3.10.106-20171124-XU3) over (3.10.106-20171115-XU3).
🈴[Processing] APT installation for: apt-transport-https apt-utils bash-completion bc bzip2 ca-certificates console-setup cron curl dbus debconf dosfstools dphys-swapfile dropbear ethtool fake-hwclock fbset firmware-realtek gnupg hdparm hfsplus htop initramfs-tools iputils-ping isc-dhcp-client locales nano net-tooE: Method https has died unexpectedly!c resolvconf sudo tzdata unzip usbutils wget whiptail wput zip, please wait... E: Sub-process https received a segmentation fault.

Fixed with: https://github.com/Fourdee/DietPi/commit/84198500ca652876bda3b8399b11e863990a7105

MichaIng commented 6 years ago

@Fourdee @k-plan Try out my PR, as it keeps http method: https://github.com/Fourdee/DietPi/pull/1373

MichaIng commented 6 years ago

Ah sorry, just fixed DISTRO is still global G_DISTRO.

Fourdee commented 6 years ago

Re-Tests after @MichaIng PR fix :

🈯️ C2: Buster > Buster
🈴 HC1: Meveric Jessie > Stretch -- root@odroid-jessie:~# apt-get update 0% [Working] -- Replace sources.list https with http resolves. PREP DL was cached (old version)? --- need to also apply to sources.list.d/* ? No effect root@odroid-jessie:~# apt-get update Ign:1 http://deb.debian.org/debian stretch InRelease Hit:2 http://deb.debian.org/debian stretch-updates InRelease Hit:3 http://deb.debian.org/debian-security stretch/updates InRelease Hit:4 http://deb.debian.org/debian stretch-backports InRelease Hit:5 http://deb.debian.org/debian stretch Release 0% [Working]^C -- [ Info ] Setting APT sources.list: stretch 4 , G_DISTRO being flagged as 4, not 3. sed not applied.
🈯️ (https://github.com/Fourdee/DietPi/commit/eb01d56ce280b9d7ed64fe9d6bf6ab6cb5d0d3f6) Native PC: Stretch > Stretch | EFI post error, hang.
🈯️ RPi: Stretch > Stretch

MichaIng commented 6 years ago

@Fourdee Yes @k-plan's tests also showed, that Method https died is not resolved with my PR. At least it resolved this one: apt_https

Debian Jessie -> DietPi Stretch pre https://github.com/Fourdee/DietPi/pull/1373
The error disappears after Stretch dist-upgrade, so http for Debian repo need to stay until that.

I made again research, but the reasons for Method https died seem to be various: Memory issues (i.a. too high usage/emergency kill), corrupted 3rd party repo, corrupted APT binary/package. For many users this was never solved, randomly appearing after times without issue.

We can check, if keeping HTTP on Odroid/Meveric images, also after Stretch upgrade, works.
We can check, if blocking any kernel upgrade (which is simply done by G_AGDUP here) prevents issue.
Solution for now would be anyway to block distro upgrading for Odroid/Meveric images, until Stretch is officially supported/offered by Meveric.

Fourdee commented 6 years ago

@MichaIng

With: https://github.com/Fourdee/DietPi/commit/71999efb4a848193ee69ac8c069d1518cf692299

Error occurs during:

 [  Error   ] DietPi-Set_Hardware: G_AGI: alsa-utils

root@odroid-jessie:~# apt-get update
0% [Working]
#hang

Reboot results in heartbeat, but no LAN.

Memory issues (i.a. too high usage/emergency kill),

Maybe we can try creating a swapfile at start of PREP?

Solution for now would be anyway to block distro upgrading for Odroid/Meveric images, until Stretch is officially supported/offered by Meveric.

Yep, we've spend far too much time on this already. I'am tempted to leave it as a known issue, and see if it crops up on other devices., then investigate further. From what I can remember, other device Jessie > Stretch upgrades were fine, but i'd need to retest another system to confirm.

Fourdee commented 6 years ago

Ok, need to make a start on the new images, or they will never be completed in time.

I'll start creating the new images with version 6.-1 over next few days (and fix any bugs in PREP if found during it). 6.-1 allows us to run day one updates if we miss anything.

🈯️ Resolved: FS resize not functional, partition resize is fine, expansion is not running: /etc/systemd/system/dietpi-fs_expand.service
🈺 RPi image rootfs is 650MB min on resize, probably needs a fstrim -v /, or many small RPi files left on image?

🈯️ Resolved: DietPi-RAMdisk not saving during shutdown

root@DietPi:~# cat /var/tmp/dietpi/logs/dietpi-ramdisk.log
Sun  7 Jan 13:21:45 GMT 2018 | DietPi-Ramdisk: Stopping
cp: failed to access ‘/boot/’: Host is down

Main images 1st:

VMware: Stretch
VBox: Stretch
Native PC: Stretch
RPi: Stretch
RPi: Jessie?
Odroid C1: Jessie

Odroid C2: Jessie Meveric's image causes failure, manual removal of rm /etc/apt/sources.list.d/deb-multimedia.list required

W: Failed to fetch http://www.deb-multimedia.org/dists/jessie/InRelease  Unable to find expected entry 'main/binary-arm64/Packages' in Release file (Wrong sources.list entry or malformed file)

We need to run update-locale at some point?

root@DietPi:~# cat /etc/bash.bashrc | grep LANG
# - LANG
export $(cat /etc/default/locale | grep LANG=)
root@DietPi:~# cat /etc/default/locale
#  File generated by update-locale
#LANG=en_US.UTF-8

Clearly not:

root@DietPi:~# update-locale
root@DietPi:~# cat /etc/default/locale
#  File generated by update-locale
#LANG=en_US.UTF-8

Odroid XU3/4/HC1: Jessie

MichaIng commented 6 years ago

@Fourdee No need for RPi Jessie from my point of view. If anyway fresh flash is necessary, I don't see any reason why anyone would stay on oldstable.

I can create VirtualBox Stretch, if wanted.

About APT error: Very strange one, this didn't occur before you moved the HTTPS switch a bid down the script? I can't imagine what could make a difference there. Was during Odroid Jessie > Stretch, right? => Another argument to completely disable https within sources.list for Odroids for now. But is given anyway, since we do not offer Stretch there.

MichaIng commented 6 years ago

Tiny, if Wifi got deselected:

/DietPi/dietpi/func/dietpi-set_hardware: line 1446: /etc/wpa_supplicant/wpa_supplicant.conf: No such file or directory
/DietPi/dietpi/func/dietpi-set_hardware: line 1464: /etc/wpa_supplicant/wpa_supplicant.conf: No such file or directory

Fourdee commented 6 years ago

Hmm, weird: https://github.com/Fourdee/DietPi/blob/testing/dietpi/func/dietpi-set_hardware#L1446 https://github.com/Fourdee/DietPi/blob/testing/dietpi/func/dietpi-set_hardware#L1464

MichaIng commented 6 years ago

@Fourdee Seems to be due to your latest commits. On my system: 1446: cat << EOF > /etc/wpa_supplicant/wpa_supplicant.conf This is meant of course 😆: https://github.com/Fourdee/DietPi/blob/testing/dietpi/func/dietpi-set_hardware#L1276-L1308

Fourdee commented 6 years ago

@MichaIng Probably needs a mkdir -p /etc/wpa_supplicant before it

MichaIng commented 6 years ago

@Fourdee I would do it the other way round: Check if the folder exist, before making any adjustments. If WiFi was chosen, wpa_supplicant package was installed and the folder does exist anyway. If WiFi was not chosen, then no need to exit/create some files/folders there.

Fourdee commented 6 years ago

@MichaIng Yep, makes sense. I need to check the code, see why i've done it this way (relies on file to exist)

Fourdee commented 6 years ago

Ok, i've uploaded C2 + RPi for testing: http://dietpi.com/downloads/testing/v6.0/

Both running stable, so far.

🈯️ RPi BT fixed with commit: https://github.com/Fourdee/DietPi/commit/9797eb1e856e79d2c6489fa4860c9310aa8ec00b

root@DietPi:~# bluetoothctl
[NEW] Controller B8:27:EB:24:F9:F1 DietPi [default]
[bluetooth]# scan
Missing on/off argument
[bluetooth]# scan on
Discovery started
[CHG] Controller B8:27:EB:24:F9:F1 Discovering: yes
[bluetooth]#

Fourdee commented 6 years ago

Next image creation, test: https://github.com/Fourdee/DietPi/issues/1379

k-plan commented 6 years ago

@Fourdee

Ok, i've uploaded C2 + RPi for testing:

Quick test on RPi Zero W:

dietpi.txt: (before first run)

https://github.com/Fourdee/DietPi/blob/testing/dietpi.txt#L100-L102

setting: AUTO_SETUP_TIMEZONE=Europe/Berlin did not work. End up with Etc/UTC

dietpi-config:

wifimodules (enable)

DietPi-Set_Hardware
─────────────────────────────────────────────────────
 Mode: wifimodules (enable)

 [   Info   ] Checking for pre-req APT packages: crda firmware-atheros firmware-brcm80211 firmware-ralink iw rfkill wireless-tools wpasupplicant
 [   Info   ] (crda) | Currently installed
 [   Info   ] (firmware-atheros) | Currently installed
 [   Info   ] (firmware-brcm80211) | Currently installed
 [   Info   ] (firmware-ralink) | Not found, flagging pre-req APT package for installation
 [   Info   ] (iw) | Currently installed
 [   Info   ] (rfkill) | Currently installed
 [   Info   ] (wireless-tools) | Currently installed
 [   Info   ] (wpasupplicant) | Currently installed
 [    Ok    ] G_AGI: firmware-ralink
 [   Info   ] Please wait, enabling WiFi Modules...
 [    Ok    ] wifimodules enable | Completed

root@RPi-Zero-W-v6:~# apt-get install firmware-r*
Paketlisten werden gelesen... Fertig
Abhängigkeitsbaum wird aufgebaut.
Statusinformationen werden eingelesen.... Fertig
Note, selecting 'firmware-realtek' for glob 'firmware-r*'
Note, selecting 'firmware-ralink' for glob 'firmware-r*'
Hinweis: »firmware-misc-nonfree« wird an Stelle von »firmware-ralink« gewählt.
firmware-misc-nonfree ist schon die neueste Version (1:20161130-3+rpi2).
firmware-realtek ist schon die neueste Version (1:20161130-3+rpi2).
0 aktualisiert, 0 neu installiert, 0 zu entfernen und 0 nicht aktualisiert.

DietPi-Services
─────────────────────────────────────────────────────
 Mode: dietpi_controlled

cronocessing] Please wait..

Ups ...

If both Ethernet and Wifi are enabled, Wifi will take priority and Ethernet will be disabled.

No. If you setup via dietpi-config eth0 (LAN) and wlan0 (WiFi) simultaneously to two different networks, you get in hassel. (DNS, routing IPv4 and IPv6, DHCP, ...)

Think it's an old problem since metric and netplug are canceled. So better leave it alone for now. Not wanted to open next case of worms.

Fourdee commented 6 years ago

@k-plan If this system is still running, can you please paste results of:

cat /etc/timezone

Just want to see if it was applied.

MichaIng commented 6 years ago

@Fourdee Before releasing (first for public testing), we should add some more detailed information about how to shrink image size and which base images are recommended for which machines: https://github.com/Fourdee/DietPi/issues/599

Info should be added to Forum and Readme.

k-plan commented 6 years ago

@Fourdee

If this system is still running, can you please paste results of:

root@RPi-Zero-W-v6:~# cat /boot/dietpi.txt | grep TIMEZONE
AUTO_SETUP_TIMEZONE=Europe/Berlin

root@RPi-Zero-W-v6:~# date
Tue  9 Jan 14:58:09 UTC 2018

root@RPi-Zero-W-v6:~# cat /etc/timezone
Etc/UTC

root@RPi-Zero-W-v6:~# dpkg-reconfigure tzdata

180109-0001

Fourdee commented 6 years ago

@k-plan Legend, thank you 👍

Found issue, will fix:

root@DietPi:~# echo -e "Europe/London" > /etc/timezone
root@DietPi:~# dpkg-reconfigure -f noninteractive tzdata

Current default time zone: 'Europe/Amsterdam'
Local time is now:      Tue Jan  9 16:13:42 CET 2018.
Universal Time is now:  Tue Jan  9 15:13:42 UTC 2018.

root@DietPi:~# cat /etc/timezone
Europe/Amsterdam

root@DietPi:~# ls -lha /etc/localtime
lrwxrwxrwx 1 root root 36 Jan  9 16:14 /etc/localtime -> /usr/share/zoneinfo/Europe/Amsterdam

Test:

INPUT='Europe/London'
rm /etc/localtime
ln -fs /usr/share/zoneinfo/$INPUT /etc/localtime
dpkg-reconfigure -f noninteractive tzdata

🈯️

root@DietPi:~# dpkg-reconfigure -f noninteractive tzdata

Current default time zone: 'Europe/London'
Local time is now:      Tue Jan  9 15:18:47 GMT 2018.
Universal Time is now:  Tue Jan  9 15:18:47 UTC 2018.

Fourdee commented 6 years ago

@k-plan AUTO_SETUP_TIMEZONE resolved (tested latest images): https://github.com/Fourdee/DietPi/commit/b8c46df12dc883287f6e303b156cb4fd0116b26e

Fourdee commented 6 years ago

🈯️ https://github.com/Fourdee/DietPi/commit/4e10e8b2c7df6aa8412d253797d1eb9b69a52274

[  OK  ] Step 7: Prep system for DietPi ENV:
[ INFO ] -----------------------------------------------------------------------------------
[ INFO ] Deleting list of known users, not required by DietPi
[ INFO ] Removing misc files/folders/services, not required by DietPi
[ INFO ] Creating DietPi core environment
[  OK  ] /boot/dietpi/func/dietpi-set_core_environment
[ INFO ] Deleting all log files /var/log
[ INFO ] Generating DietPi /etc/fstab
[  OK  ] /boot/dietpi/dietpi-drive_manager 4
[ INFO ] Starting DietPi-RAMdisk service
[  OK  ] systemctl start dietpi-ramdisk.service
[ INFO ] Starting DietPi-RAMlog service
[  OK  ] systemctl start dietpi-ramlog.service
[ INFO ] Updating DietPi HW_INFO
/DietPi/dietpi/dietpi-obtain_hw_model: line 605: ((: /etc/armbian-image-release:0
/etc/os-release:0 : syntax error: operand expected (error token is "/etc/armbian-image-release:0
/etc/os-release:0 ")
/DietPi/dietpi/dietpi-obtain_hw_model: line 609: ((: /etc/armbian-image-release:0
/etc/os-release:1 : syntax error: operand expected (error token is "/etc/armbian-image-release:0
/etc/os-release:1 ")
/DietPi/dietpi/dietpi-obtain_hw_model: line 613: ((: /etc/armbian-image-release:0
/etc/os-release:0 : syntax error: operand expected (error token is "/etc/armbian-image-release:0
/etc/os-release:0 ")

root@nanopineo:~# cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 9 (stretch)"
NAME="Debian GNU/Linux"
VERSION_ID="9"
VERSION="9 (stretch)"
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

Fourdee commented 6 years ago

NanoPi M1+ official desktop image, should be intresting:

(Reading database ... 77799 files and directories currently installed.)

...

/dev/mmcblk0p2  7.2G  2.4G  4.9G  33% /

🥂

0 upgraded, 0 newly installed, 932 to remove and 141 not upgraded.
 After this operation, 1,214 MB disk space will be freed.

🈯️ https://github.com/Fourdee/DietPi/commit/59383d944fc125cdf25304fc86ff24790bb2ec60 jessie > stretch

#G_AGUP
Fetched 13.3 MB in 49s (269 kB/s)
W: There is no public key available for the following key IDs:
EF0F382A1A7B6500
W: Failed to fetch http://deb.debian.org/debian-security/dists/stretch/updates/main/binary-armhf/Packages  503  Backend is unhealthy

W: Failed to fetch http://deb.debian.org/debian-security/dists/stretch/updates/contrib/binary-armhf/Packages  503  Backend is unhealthy

W: Failed to fetch http://deb.debian.org/debian-security/dists/stretch/updates/non-free/binary-armhf/Packages  503  Backend is unhealthy

E: Some index files failed to download. They have been ignored, or old ones used instead.

MichaIng / DietPi