This Dockerfile repackages the Ubuntu 20.04 focal .deb file (currently s3fs_1.86-1_amd64.deb) with updated source code from the s3fs-fuse GitHub repository. This is all done at Docker build time.
s3fs-fuse: https://github.com/s3fs-fuse/s3fs-fuse
Ubuntu 18.04's outdated version of s3fs-fuse (resulting from apt-get install s3fs) did not seem to work for me on AWS. Thus I started this project with a Dockerfile which compiles s3fs from a specified GitHub commit.
I need to deploy this to several instances, so I much prefer the speed and
convenience of installing from a .deb file as opposed to compiling from source.
For security reasons, I avoid downloading software compiled by random people.
If you trust me1, you can download the .deb from the above link. Otherwise, follow the instructions below to build it yourself.
I no longer use this project myself. Nowadays my preferred installation method is to use conda-forge, which provides open-source infrastructure for package management. In particular, I use mamba to install the s3fs-fuse package with the command
mamba install -c conda-forge s3fs-fuseIf you don't want to mess with setting up a Conda environment, the following should work on Ubuntu 22.04 (not thoroughly tested):
sudo apt-get install -y curl bzip2 fuse mime-support libxml2 libcurl4 libssl3
curl -Ls https://anaconda.org/conda-forge/s3fs-fuse/1.91/download/linux-64/s3fs-fuse-1.91-h66f7299_0.tar.bz2 | sudo tar -xvj --strip-components=1 --directory=/usr/local/bin bin/s3fsOn Ubuntu 20.04, libssl3 is not available, but the following procedure should install it from Conda-Forge (not thoroughly tested):
DEBIAN_FRONTEND=noninteractive sudo apt-get install -y curl bzip2 fuse mime-support libxml2 libcurl4
curl -Ls https://anaconda.org/conda-forge/openssl/3.0.3/download/linux-64/openssl-3.0.3-h166bdaf_0.tar.bz2 | sudo tar -xvj --strip-components=1 --directory=/usr/local/lib --wildcards "lib/lib*"
curl -Ls https://anaconda.org/conda-forge/s3fs-fuse/1.91/download/linux-64/s3fs-fuse-1.91-h66f7299_0.tar.bz2 | sudo tar -xvj --strip-components=1 --directory=/usr/local/bin bin/s3fsOnce you have the .deb file, run
sudo apt-get install -y fuse mime-support libxml2 libcurl4 libssl1.1
sudo dpkg -i s3fs_….debIf you wish to validate my .deb file or to generate it yourself, then follow these steps.
Download Dockerfile and change to the corresponding directory.
git clone https://github.com/maresb/docker-build-s3fs.git && cd docker-build-s3fsTo render an untagged commit such as e0712f4,
docker build -t build-s3fs --build-arg COMMIT_ID=e0712f4 --build-arg S3FS_VERSION=1.85 .or for a tagged commit such as a release version, for example v1.91,
docker build -t build-s3fs --build-arg COMMIT_ID=v1.91 --build-arg S3FS_VERSION=1.91 .The argument S3FS_VERSION should refer to the latest version number as of the commit specified under COMMIT_ID.
id=$(docker create build-s3fs)
docker cp $id:s3fs-debian-package.tar .
docker rm -v $id
tar xvf s3fs-debian-package.tar && rm s3fs-debian-package.tardocker rmi build-s3fs
docker system pruneIf the image successfully builds, you can tag the build stage and look inside with
docker build -t build-s3fs:build --target build [ADD BUILD ARGS HERE] .
docker run --rm -it build-s3fs:build /bin/bashOtherwise, in the output of a partial build, look for a line with an arrow directly followed by a hash such as
---> df7f92f1a162Then you can look inside at the corresponding point with
docker run --rm -it df7f92f1a162 /bin/bashNormally, due to last-modified times of files and the timestamp in the changelog,
no two .deb files are expected to be exactly the same, even if they have the
exact same content. However, by fixing a build-time, the .deb files produced
by this container are reproducible. Thus I can provide a checksum which can be
verified from the download, and/or a build on your own computer.
NOTE: After some time, discrepancies in the checksums could arise due to updated
dependencies. To compare, I provide logs under builds/.
0f511a762f22c0c00d75e40515dca142 usr/bin/s3fs
e225a2dfdaadb1c4c484614df28cdfdf usr/share/doc/s3fs/changelog.Debian.gz
2c85defc6568bd463d3dc9c5342faab0 usr/share/doc/s3fs/copyright
7ba8239dcc20cbbbe29a0fcb80cc27ed usr/share/doc/s3fs/examples/passwd-s3fs
0b395c729d822fdfd60bcf0d13169c49 usr/share/man/man1/s3fs.1.gzs3fs_1.91+git-v1.91-3_amd64.deb size and checksum$ stat --printf="%s bytes\n" s3fs_1.91+git-v1.91-3_amd64.deb
222340 bytes
$ md5sum s3fs_1.91+git-v1.91-3_amd64.deb
95192b8c47c931623eb1ce49282338eb s3fs_1.91+git-v1.91-3_amd64.deb
$ sha256sum s3fs_1.91+git-v1.91-3_amd64.deb
9eca7cb1e9bb08b8e3ae9b476287712a8293493630c76d9102c5ac0058b098c0 s3fs_1.91+git-v1.91-3_amd64.deb
$ b2sum s3fs_1.91+git-v1.91-3_amd64.deb
46befabcd4ffce0000db99d71b1d51d6cef2bab8816fc540bc2e7aaaed921ad545f61d661190b96d219648f69688a7ea65ce6142a6524ec3af5a6f7f9f2ea97f s3fs_1.91+git-v1.91-3_amd64.debs3fs size and checksum$ stat --printf="%s bytes\n" s3fs
604608 bytes
$ md5sum s3fs
0f511a762f22c0c00d75e40515dca142 s3fs
$ sha256sum s3fs
9f205d172c8e23dcf1fa1f31d999ad469116d032ef5238e29a0d290edd91ec07 s3fs
$ b2sum s3fs
c9df12b25a3d577f958b5bb1fd15c406c42344b22fd1e172fb2f1672eca1c0b10b0a3487099f9951ebfaf55a3c81e64ce8a9d2cad1275612d15c5ac1713bae92 s3fsOriginally these files were reproducible by Docker Hub. Unfortunately Docker Hub Autobuilds have been deactivated, so I can no longer offer this service. I would be interested in autogenerating the checksums/binary through another CI service if someone else puts together a pull request.
[1] On principle, you should check my Dockerfile and make sure that I'm not doing anything suspicious.