Open Cam-Baker opened 2 years ago
Hi Cameron,
Can you try modifying the ext_modules
section of setup.py: https://github.com/getzlab/CApy/blob/27db25c428130876e0f9222c2457fbafc5ded530/setup.py#L34-L38
To instead be
ext_modules = [Extension(
'fastmmap',
sources = ['capy/fastmmap.c'],
include_dirs = [np.get_include()],
extra_compile_args = ["-std=c99"],
)]
Thanks, —Julian
Hi Julian,
Thanks for the quick response. That lifted up the initial roadblock and now I'm tussling with additional dependencies related to cython
and cmake
.
I will update if I run into any issues or when it is fully resolved.
Best,
Cameron
Please let me know what other roadblocks you encounter, and we can make a PR to amend setup.py
accordingly! (I have already drafted one to include the c99 flag.)
Hi Julian,
Another stumbling block you may have a better view into.
I've added cython
and cmake
to the conda environment.
It appears that there are some issues related to arrow
. See logs below
running install
/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/setuptools/command/easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running bdist_egg
running egg_info
writing capy.egg-info/PKG-INFO
writing dependency_links to capy.egg-info/dependency_links.txt
writing requirements to capy.egg-info/requires.txt
writing top-level names to capy.egg-info/top_level.txt
reading manifest file 'capy.egg-info/SOURCES.txt'
writing manifest file 'capy.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
creating build/bdist.linux-x86_64/egg
copying build/lib.linux-x86_64-cpython-311/fastmmap.cpython-311-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/egg
creating build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/mut.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/plots.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/k9.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/txt.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/firecloud.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/__init__.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/liftover.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/num.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/df.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/context.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/seq.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/fwb.py -> build/bdist.linux-x86_64/egg/capy
copying build/lib.linux-x86_64-cpython-311/capy/java.py -> build/bdist.linux-x86_64/egg/capy
byte-compiling build/bdist.linux-x86_64/egg/capy/mut.py to mut.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/plots.py to plots.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/k9.py to k9.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/txt.py to txt.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/firecloud.py to firecloud.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/__init__.py to __init__.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/liftover.py to liftover.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/num.py to num.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/df.py to df.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/context.py to context.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/seq.py to seq.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/fwb.py to fwb.cpython-311.pyc
byte-compiling build/bdist.linux-x86_64/egg/capy/java.py to java.cpython-311.pyc
creating stub loader for fastmmap.cpython-311-x86_64-linux-gnu.so
byte-compiling build/bdist.linux-x86_64/egg/fastmmap.py to fastmmap.cpython-311.pyc
creating build/bdist.linux-x86_64/egg/EGG-INFO
copying capy.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO
copying capy.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying capy.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying capy.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying capy.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
writing build/bdist.linux-x86_64/egg/EGG-INFO/native_libs.txt
zip_safe flag not set; analyzing archive contents...
__pycache__.fastmmap.cpython-311: module references __file__
creating 'dist/capy-0.1-py3.11-linux-x86_64.egg' and adding 'build/bdist.linux-x86_64/egg' to it
removing 'build/bdist.linux-x86_64/egg' (and everything under it)
Processing capy-0.1-py3.11-linux-x86_64.egg
removing '/gpfs/fs2/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/capy-0.1-py3.11-linux-x86_64.egg' (and everything under it)
creating /gpfs/fs2/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/capy-0.1-py3.11-linux-x86_64.egg
Extracting capy-0.1-py3.11-linux-x86_64.egg to /gpfs/fs2/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages
capy 0.1 is already the active version in easy-install.pth
Installed /gpfs/fs2/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/capy-0.1-py3.11-linux-x86_64.egg
Processing dependencies for capy==0.1
Searching for pyarrow>=0.17.0
Reading https://pypi.org/simple/pyarrow/
/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/pkg_resources/__init__.py:123: PkgResourcesDeprecationWarning: is an invalid version and will not be supported in a future release
warnings.warn(
Downloading https://files.pythonhosted.org/packages/bd/3d/9594c09e1e2fe2e5ed7ef5c22e4347fee2ea243bccd960442e2c97731fd2/pyarrow-10.0.0.tar.gz#sha256=b153b05765393557716e3729cf988442b3ae4f5567364ded40d58c07feed27c2
Best match: pyarrow 10.0.0
Processing pyarrow-10.0.0.tar.gz
Writing /scratch/cbaker27/tmp/easy_install-2ujw1gk_/pyarrow-10.0.0/setup.cfg
Running pyarrow-10.0.0/setup.py -q bdist_egg --dist-dir /scratch/cbaker27/tmp/easy_install-2ujw1gk_/pyarrow-10.0.0/egg-dist-tmp-zqcmx9kw
/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/setuptools/installer.py:27: SetuptoolsDeprecationWarning: setuptools.installer is deprecated. Requirements should be satisfied by a PEP 517 installer.
warnings.warn(
listing git files failed - pretending there aren't any
warning: no files found matching '../LICENSE.txt'
warning: no files found matching '../NOTICE.txt'
warning: no previously-included files matching '*.so' found anywhere in distribution
warning: no previously-included files matching '*.pyc' found anywhere in distribution
warning: no previously-included files matching '*~' found anywhere in distribution
warning: no previously-included files matching '#*' found anywhere in distribution
warning: no previously-included files matching '.git*' found anywhere in distribution
warning: no previously-included files matching '.DS_Store' found anywhere in distribution
no previously-included directories found matching '.asv'
/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/lib/python3.11/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
-- The C compiler identification is GNU 4.8.5
-- The CXX compiler identification is GNU 4.8.5
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Error at CMakeLists.txt:63 (find_package):
By not providing "FindArrow.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "Arrow", but
CMake did not find one.
Could not find a package configuration file provided by "Arrow" with any of
the following names:
ArrowConfig.cmake
arrow-config.cmake
Add the installation prefix of "Arrow" to CMAKE_PREFIX_PATH or set
"Arrow_DIR" to a directory containing one of the above files. If "Arrow"
provides a separate development package or SDK, be sure it has been
installed.
-- Configuring incomplete, errors occurred!
See also "/gpfs/fs2/scratch/cbaker27/tmp/easy_install-2ujw1gk_/pyarrow-10.0.0/build/cpp/CMakeFiles/CMakeOutput.log".
-- Running CMake for PyArrow C++
error: Setup script exited with error: command '/scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB/bin/cmake' failed with exit code 1
Additional information into how I'm building the environment. Building CApy as a dependency for https://github.com/yizhak-lab-ccg/RNA_MUTECt_WMN
conda create --prefix /scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB -c conda-forge mamba
conda activate /scratch/grc_group/.conda/envs/RNA-Mutect-WMN-TMB
mamba install cython pandas numpy scikit-learn matplotlib gatk samtools cmake arrow
Hello,
I am trying to install CApy into my conda environment and am running into issues.
Install command:
python setup.py install
Command output:
Conda environment:
Best,
Cameron