Compilation environment

Benjamin-Loison commented 2 months ago

https://wiki.lineageos.org/devices/FP4/build/#what-youll-need recommends:

Ubuntu 20.04
32 GB of RAM
300 GB of disk

Using work IPOL computation server Ubuntu 18.04 with 32 threads, 126 GB of RAM would help very much but as I do not see much any link to my work so it does not seem justified.

Otherwise I have:

Pegasus Debian 12 with 24 threads and 16 GB of RAM
OC3K Debian 12 with 8 threads and 32 GB of RAM
Framework 13 Linux Mint 21.3 with 16 threads and 32 GB of RAM
OVH free/cost https://www.ovhcloud.com/fr/public-cloud/prices/#13575, see Robust_image_source_identification_on_modern_smartphones/issues/53, it proposes Ubuntu 20.04:
- free: at best 15 GB RAM 4 vCores (3 GHz) 100 GB SSD 250 Mbit/s
- cost: c3-128 128 Go 64 400 Go NVMe 8 Gbit/s 8 Gbit/s max. 1,3274 € (public network, then private network) in fact it may cost more to increase available setups
- own OVH account limits is vCPU 40 RAM 430 GB, on my secondary account the limits are vCPU 34 RAM 430 GB and on the account of a relative it requires payment method to unlock anything. Related to Improve_websites_thanks_to_open_source/issues/{314,746}.
  - c3-64 64 Go 32 (2.3 GHz) 400 Go NVMe 4 Gbit/s 4 Gbit/s max. 0,6637 €
  - c2-120 120 Go 32 (3 GHz) 400 Go SSD 10 Gbit/s 4 Gbit/s max. 1,48 €
  - According to Improve_websites_thanks_to_open_source/issues/746 we should pay 500 € to unlock c3-128. So let us look at alternatives to OVH. I would like to avoid not French companies like AWS and Google.
- Scaleway is an alternative that I already heard about and it is French, source: Wikipedia: Scaleway, could compare the price with OVH if goes with 32 threads:
  - Compute (just checking Paris 1, as others seem to have same or less):
  - https://www.scaleway.com/en/production-optimized-instances/: best ENT1-2XL 96 vCPUS €3.53518/hour, 64 vCPUs 2.35€/hour
  - https://www.scaleway.com/en/workload-optimized-instances/: best 64 vCPUs 1.7024 €/hour
  - https://www.scaleway.com/en/cost-optimized-instances/: best GP1-XL 48 vCPUs
  - Dedibox and Bare Metal
  - Dedibox - dedicated servers
    - https://www.scaleway.com/en/dedibox/start/: none with 32 threads
    - https://www.scaleway.com/en/dedibox/pro/: PRO-5-L is the only one with 32 threads
    - https://www.scaleway.com/en/dedibox/core/: are the only dedicated servers with strictly more than 32 threads up to 64 threads seem only chargeable by month
    - https://www.scaleway.com/en/dedibox/store/: STORE-9-{L,XL} are the only ones with 32 threads
    - https://www.scaleway.com/en/dedibox-vps/: none or 2 have with 32 threads
  - Elastic Metal - bare metal cloud
    - https://www.scaleway.com/en/elastic-metal/aluminium/: none with 32 threads
    - https://www.scaleway.com/en/elastic-metal/beryllium/: none with 32 threads
    - https://www.scaleway.com/en/elastic-metal/iridium/: one with 32 threads
    - https://www.scaleway.com/en/elastic-metal/lithium/: none with 32 threads

I can use a dedicated SSD SATA 1 TB for this purpose. For the Framework it could only be used with USB adaptator which is maybe not worth it then.

OVH is maybe enough with its 32 threads and 64 GB of RAM.

Related to Benjamin_Loison/Improve_websites_thanks_to_open_source/issues/{786,787}.

Benjamin-Loison commented 2 months ago

Ideally having enough RAM like 300 GB to make it behave like the disk to make the process faster.

Should try first using Debian 12, then if I am not able to make it work, then move to Ubuntu 24.04, then 22.04 and finally 20.04.

Benjamin-Loison commented 1 month ago

On OVH c3-64:

# are useless statements.

sudo apt update
sudo apt upgrade -y
#sudo apt autoremove -y
#sudo apt dist-upgrade -y
if [ -e /var/run/reboot-required ]
then
    sudo reboot
fi

sudo apt install -y htop

Skipped:

https://wiki.lineageos.org/devices/FP4/build/#install-the-platform-tools
https://wiki.lineageos.org/devices/FP4/build/#install-the-build-packages
mkdir -p ~/android/lineage from https://wiki.lineageos.org/devices/FP4/build/#create-the-directories
git config --global trailer.changeid.key 'Change-Id' from https://wiki.lineageos.org/devices/FP4/build/#configure-git
https://wiki.lineageos.org/devices/FP4/build/#turn-on-caching-to-speed-up-build
Use lunch instead of breakfast
https://wiki.lineageos.org/devices/FP4/build/#start-the-build

sudo apt install repo does not work.

mkdir -p ~/bin
curl https://storage.googleapis.com/git-repo-downloads/repo > ~/bin/repo
chmod a+x ~/bin/repo

cat >> ~/.bashrc<< EOF
# set PATH so it includes user's private bin if it exists
if [ -d "$HOME/bin" ] ; then
    PATH="$HOME/bin:$PATH"
fi
EOF

source ~/.bashrc
sudo apt install -y git
git config --global user.email 'benjamin.loison@example.com'
git config --global user.name 'Benjamin Loison'
sudo apt install -y git-lfs

Benjamin-Loison commented 1 month ago

Benjamin-Loison commented 1 week ago

If need to re-compile to integrate app updates and security patches and clear steps to proceed to for first build and a following one, then can proceed on own computer as the workload should not be that significant. However, first need a powerful setup to quickly iterate on possibly significant changes at least as far as I understand things yet.

Benjamin-Loison / android

Compilation environment #63