PedroRegisPOAR
commented
3 years ago WIP: retried it all
- buildInputs, does it still true https://github.com/NixOS/nix/issues/2854#issuecomment-463635903 ?
- nativeBuildInputs
- propagateBuildInputs
Details
nix profile install nixpkgs#python3
nix profile install --no-write-lock-file github:nix-community/poetry2nix/869580c729e658ffe74d8d1d0c3cb132d33a6126#poetry
mkdir -p ~/troubleshoot-pandas-flake \
&& cd ~/troubleshoot-pandas-flake \
&& poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.5.0mkdir -p "$HOME"/troubleshoot-pandas-flake \
&& cd "$HOME"/troubleshoot-pandas-flake
cat <<WRAP > "$HOME"/troubleshoot-pandas-flake/flake.nix
{
description = "A usefull description";
inputs.nixpkgs.url = "github:NixOS/nixpkgs";
inputs.flake-utils.url = "github:numtide/flake-utils";
inputs.poetry2nix-src.url = "github:nix-community/poetry2nix/869580c729e658ffe74d8d1d0c3cb132d33a6126";
outputs = { self, nixpkgs, flake-utils, poetry2nix-src }:
flake-utils.lib.eachDefaultSystem (system:
let
pkgsAllowUnfree = import nixpkgs {
system = "x86_64-linux";
config = { allowUnfree = true; };
};
pkgs = import nixpkgs { inherit system; overlays = [ poetry2nix-src.overlay ]; };
env = pkgsAllowUnfree.poetry2nix.mkPoetryEnv {
poetrylock = ./poetry.lock;
projectDir = ./.;
python = pkgsAllowUnfree.python3;
};
in
{
devShell = pkgsAllowUnfree.mkShell {
buildInputs = with pkgsAllowUnfree; [
poetry
env
];
shellHook = ''
unset SOURCE_DATE_EPOCH
'';
};
});
}
WRAP
command -v nix 1> /dev/null 2> /dev/null || echo 'The nix binary was not found'
test -x git || nix profile install nixpkgs#git
git init
git add .
# Lock it, time passes and things get out of synchronization
# nix flake update --override-input nixpkgs nixpkgs/dca55d9a451fba34c87e8adea7a3782d667149fa
nix flake lock
git add .
poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.5.0 \
&& poetry lock \
&& poetry show --tree
git add .
nix develop --command python -c 'import pandas'Other
nix profile install nixpkgs#poetry nixpkgs#python3 nixpkgs#gcc nixpkgs#stdenv.cc.cc.lib
mkdir -p ~/troubleshoot-pandas \
&& cd ~/troubleshoot-pandas \
&& poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5nix profile install nixpkgs#poetry nixpkgs#python3 nixpkgs#gcc
mkdir -p ~/troubleshoot-pandas \
&& cd ~/troubleshoot-pandas \
&& poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5nix profile install nixpkgs/7138a338b58713e0dea22ddab6a6785abec7376a#poetry nixpkgs#python3
mkdir -p ~/troubleshoot-pandas \
&& cd ~/troubleshoot-pandas \
&& poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5mkdir -p ~/troubleshoot-pandas \
&& cd ~/troubleshoot-pandas \
&& poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5 \
&& poetry lock \
&& poetry show --tree \
&& poetry run python -c 'import pandas; print(pandas.__package__)'python -c 'import pandas'Test
mkdir -p "$HOME"/troubleshoot-pandas-flake \
&& cd "$HOME"/troubleshoot-pandas-flake
curl http://ix.io/49FS > flake.nix
curl http://ix.io/49FQ > flake.lock
curl http://ix.io/49FR > pyproject.toml
curl http://ix.io/49FT > poetry.lock
git init
git add .
nix develop --command python -c 'import pandas'mkdir -p "$HOME"/troubleshoot-pandas-flake \
&& cd "$HOME"/troubleshoot-pandas-flake
cat <<WRAP > "$HOME"/troubleshoot-pandas-flake/flake.nix
{
description = "A usefull description";
inputs.nixpkgs.url = "github:NixOS/nixpkgs";
inputs.flake-utils.url = "github:numtide/flake-utils";
inputs.poetry2nix-src.url = "github:nix-community/poetry2nix";
outputs = { self, nixpkgs, flake-utils, poetry2nix-src }:
flake-utils.lib.eachDefaultSystem (system:
let
pkgsAllowUnfree = import nixpkgs {
system = "x86_64-linux";
config = { allowUnfree = true; };
};
pkgs = import nixpkgs { inherit system; overlays = [ poetry2nix-src.overlay ]; };
env = pkgsAllowUnfree.poetry2nix.mkPoetryEnv {
poetrylock = ./poetry.lock;
projectDir = ./.;
python = pkgsAllowUnfree.python3;
};
in
{
devShell = pkgsAllowUnfree.mkShell {
buildInputs = with pkgsAllowUnfree; [
poetry
env
];
shellHook = ''
unset SOURCE_DATE_EPOCH
'';
};
});
}
WRAP
command -v nix 1> /dev/null 2> /dev/null || echo 'The nix binary was not found'
test -x git || nix profile install nixpkgs#git
test -x poetry || nix profile install nixpkgs#poetry
git init
git add .
# Lock it, time passes and things get out of synchronization
nix flake update --override-input nixpkgs nixpkgs/dca55d9a451fba34c87e8adea7a3782d667149fa
nix flake lock
git add .
poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5 \
&& poetry lock \
&& poetry show --tree
git add .
nix develop --command python -c 'import pandas'buildInputs
mkdir -p "$HOME"/troubleshoot-pandas-flake \
&& cd "$HOME"/troubleshoot-pandas-flake
cat <<WRAP > "$HOME"/troubleshoot-pandas-flake/flake.nix
{
description = "A usefull description";
inputs.nixpkgs.url = "github:NixOS/nixpkgs";
inputs.flake-utils.url = "github:numtide/flake-utils";
inputs.poetry2nix-src.url = "github:nix-community/poetry2nix";
outputs = { self, nixpkgs, flake-utils, poetry2nix-src }:
flake-utils.lib.eachDefaultSystem (system:
let
pkgsAllowUnfree = import nixpkgs {
system = "x86_64-linux";
config = { allowUnfree = true; };
};
pkgs = import nixpkgs { inherit system; overlays = [ poetry2nix-src.overlay ]; };
env = pkgsAllowUnfree.poetry2nix.mkPoetryEnv {
poetrylock = ./poetry.lock;
projectDir = ./.;
python = pkgsAllowUnfree.python3;
overrides = [
pkgsAllowUnfree.poetry2nix.defaultPoetryOverrides
(self: super: {
pandas = super.pandas.overridePythonAttrs (old: {
buildInputs = old.buildInputs ++ [
self.stdenv.cc.cc.lib
];
});
})
];
};
in
{
devShell = pkgsAllowUnfree.mkShell {
buildInputs = with pkgsAllowUnfree; [
poetry
env
];
shellHook = ''
unset SOURCE_DATE_EPOCH
'';
};
});
}
WRAP
command -v nix 1> /dev/null 2> /dev/null || echo 'The nix binary was not found'
test -x git || nix profile install nixpkgs#git
test -x poetry || nix profile install nixpkgs#poetry
git init
git add .
# Lock it, time passes and things get out of synchronization
nix flake update --override-input nixpkgs nixpkgs/dca55d9a451fba34c87e8adea7a3782d667149fa
nix flake lock
git add .
poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5 \
&& poetry lock \
&& poetry show --tree
git add .
nix develop --command python -c 'import pandas'nativeBuildInputs
mkdir -p "$HOME"/troubleshoot-pandas-flake \
&& cd "$HOME"/troubleshoot-pandas-flake
cat <<WRAP > "$HOME"/troubleshoot-pandas-flake/flake.nix
{
description = "A usefull description";
inputs.nixpkgs.url = "github:NixOS/nixpkgs";
inputs.flake-utils.url = "github:numtide/flake-utils";
inputs.poetry2nix-src.url = "github:nix-community/poetry2nix";
outputs = { self, nixpkgs, flake-utils, poetry2nix-src }:
flake-utils.lib.eachDefaultSystem (system:
let
pkgsAllowUnfree = import nixpkgs {
system = "x86_64-linux";
config = { allowUnfree = true; };
};
pkgs = import nixpkgs { inherit system; overlays = [ poetry2nix-src.overlay ]; };
env = pkgsAllowUnfree.poetry2nix.mkPoetryEnv {
poetrylock = ./poetry.lock;
projectDir = ./.;
python = pkgsAllowUnfree.python3;
overrides = [
pkgsAllowUnfree.poetry2nix.defaultPoetryOverrides
(self: super: {
pandas = super.pandas.overridePythonAttrs (old: {
nativeBuildInputs = old.nativeBuildInputs ++ [
self.stdenv.cc.cc.lib
];
});
})
];
};
in
{
devShell = pkgsAllowUnfree.mkShell {
buildInputs = with pkgsAllowUnfree; [
poetry
env
];
shellHook = ''
unset SOURCE_DATE_EPOCH
'';
};
});
}
WRAP
command -v nix 1> /dev/null 2> /dev/null || echo 'The nix binary was not found'
test -x git || nix profile install nixpkgs#git
test -x poetry || nix profile install nixpkgs#poetry
git init
git add .
# Lock it, time passes and things get out of synchronization
nix flake update --override-input nixpkgs nixpkgs/dca55d9a451fba34c87e8adea7a3782d667149fa
nix flake lock
git add .
poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5 \
&& poetry lock \
&& poetry show --tree
git add .
nix develop --command python -c 'import pandas'nix develop --command poetry init --no-interaction \
&& poetry show --tree \
&& poetry add pandas==1.1.5 \
&& poetry lock \
&& poetry show --tree \
&& poetry run python -c 'import pandas; print(pandas.__package__)'Maybe with: propagatedBuildInputs = (old.propagatedBuildInputs or [ ]) ++ [ self.stdenv.cc.cc.lib ];
mkdir -p "$HOME"/troubleshoot-pandas-flake \
&& cd "$HOME"/troubleshoot-pandas-flake
cat <<WRAP > "$HOME"/troubleshoot-pandas-flake/flake.nix
{
description = "A usefull description";
inputs.nixpkgs.url = "github:NixOS/nixpkgs";
inputs.flake-utils.url = "github:numtide/flake-utils";
inputs.poetry2nix-src.url = "github:nix-community/poetry2nix";
outputs = { self, nixpkgs, flake-utils, poetry2nix-src }:
flake-utils.lib.eachDefaultSystem (system:
let
pkgsAllowUnfree = import nixpkgs {
system = "x86_64-linux";
config = { allowUnfree = true; };
};
pkgs = import nixpkgs { inherit system; overlays = [ poetry2nix-src.overlay ]; };
env = pkgsAllowUnfree.poetry2nix.mkPoetryEnv {
poetrylock = ./poetry.lock;
projectDir = ./.;
python = pkgsAllowUnfree.python3;
overrides = [
pkgsAllowUnfree.poetry2nix.defaultPoetryOverrides
(self: super: {
pandas = super.pandas.defaultPythonOverrides (old: {
propagatedBuildInputs = (old.propagatedBuildInputs or [ ]) ++ [ self.stdenv.cc.cc.lib ];
});
})
];
};
in
{
devShell = pkgsAllowUnfree.mkShell {
buildInputs = with pkgsAllowUnfree; [
poetry
# env
];
shellHook = ''
unset SOURCE_DATE_EPOCH
'';
};
});
}
WRAP
command -v nix 1> /dev/null 2> /dev/null || echo 'The nix binary was not found'
test -x git || nix profile install nixpkgs#git
test -x poetry || nix profile install nixpkgs#poetry
git init
git add .
# Lock it, time passes and things get out of synchronization
nix flake update --override-input nixpkgs nixpkgs/dca55d9a451fba34c87e8adea7a3782d667149fa
# nix flake lock
command -v sed 1> /dev/null 2> /dev/null || echo 'The sed binary was not found'
sed -i 's/# env/env/' flake.nix
git add .
poetry config virtualenvs.in-project true \
&& poetry config virtualenvs.path . \
&& poetry init --no-interaction \
&& poetry lock \
&& poetry show --tree \
&& poetry add pandas==1.1.5 \
&& poetry lock \
&& poetry show --tree
git add .
nix develop --command python -c 'import pandas as pd; pd.DataFrame(); print(pd.__version__)'
TL;DR
It is an really hard problem, an NP-hard problem...
Refs.:
TODOs
Re read it: https://stackoverflow.com/a/47149524
TODO: join all that is linked here, might be enough, to fix this painfull problem!!
https://github.com/ES-Nix/environments/issues/1
++
Document how to work around dynamic linking problems caused by glibc updates
++ TODO: help there https://ask.replit.com/t/cant-build-package-because-it-needs-glibc-2-34-older-than-what-is-installed/39215/4 ++
Refs.:
Some references
TODO:
TODO:
See how to check for wheels:
Refs.:
Inspecting binaries
Refs.:
https://functor.tokyo/blog/2021-10-20-nix-cross-static
What package provides libstdc++.so.6?
TODO:
1)
Refs.:
2)
3)
4)
5)
6)
7)
8) TODO: re-reead it and make more examples
Refs.:
TODO: https://stackoverflow.com/questions/4133674/glibcxx-versions?rq=3
TODO: https://stackoverflow.com/a/3436360
TODO
TODO:
Make something like this work:
https://github.com/NixOS/nixpkgs/blob/fe76645aaf2fac3baaa2813fd0089930689c53b5/pkgs/applications/editors/sublime/4/common.nix#L26
combined with
https://github.com/NixOS/nixpkgs/blob/fe76645aaf2fac3baaa2813fd0089930689c53b5/pkgs/applications/editors/sublime/4/common.nix#L63-L68
combined with
https://github.com/archaict/Project/blob/b117de8260eb00008d9a148d12b5edb9c75fac8d/NixOS/incantation/python/shell.nix#L11-L19
combined with
https://github.com/Mic92/nix-ld/tree/29f15b1f7e37810689974ef169496c51f6403a1b#my-pythonnodejsrubyinterpreter-libraries-do-not-find-the-libraries-configured-by-nix-ld
combined with
nix run github:nixified-ai/flake/0c58f8cba3fb42c54f2a7bf9bd45ee4cbc9f2477#koboldai-nvidia
LD_LIBRARY_PATH
List:
TODO: watch and make examples
NIX_LDFLAGS, NIX_CFLAGS_COMPILE, NIX_CFLAGS_LINK
https://stackoverflow.com/questions/77487821/nixos-newer-glibc-version-forced-by-environment-outside-nix-shell
Seriouslly?
LD_PRELOAD
List:
ldd
TODO: Linkers, Loaders and Shared Libraries in Windows, Linux, and C++ - Ofek Shilon - CppCon 2023 triage it!
https://reverseengineering.stackexchange.com/questions/6657/why-does-ldd-and-gdb-info-sharedlibrary-show-a-different-library-base-addr#comment19796_6665
https://i.stack.imgur.com/FF1Zv.png https://reverseengineering.stackexchange.com/a/14639
libgcc_s
https://github.com/NixOS/nixpkgs/blob/cf28ee258fd5f9a52de6b9865cdb93a1f96d09b7/pkgs/tools/networking/iftop/default.nix#L12-L14
strace
chroot
Refs.:
nm
Everything you need to build your own nm and otool
Refs.:
TODOs:
DT_RPATH vs DT_RUNPATH
List:
Refs.:
Refs.:
Refs.:
Refs.:
The C macros GLIBC and __GLIBC_MINOR__
TODO:
Refs.:
How to find dlopen calls?
Refs.:
For example:
Refs.:
C example: https://unix.stackexchange.com/a/462710
Refs.:
Refs.:
TODO: https://stackoverflow.com/questions/25785212/how-to-print-all-the-shared-objects-in-memory-at-a-particular-time
Refs.:
https://docs.rs/dlopen/latest/dlopen/
Python libs for tests
TODO: the polars lib https://search.nixos.org/packages?channel=unstable&from=0&size=50&sort=relevance&type=packages&query=polars
python310Packages.pwntools
cryptography
nix build --print-out-paths --print-build-logs nixpkgs#python3Packages.localstack.dist
Mixed
List:
Maybe it is another way to have the same error?