RomoL2 / RegVar

Characterize 3'UTR variants
8 stars 2 forks source link

Unable to install on linux #5

Closed centimorgan22 closed 7 months ago

centimorgan22 commented 1 year ago

When trying to install on linux for use in an HPC environment. I get to the step here:

library(RegVar) install_reqs('/Library/Frameworks/R.framework/Versions/4.0/Resources/library/RegVar')

And then I get this error:

R version 4.2.2 (2022-10-31) -- "Innocent and Trusting"
Copyright (C) 2022 The R Foundation for Statistical Computing
Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library(RegVar)
> install_reqs('/opt/conda/envs/regvar_env/lib/R/library/RegVar')
--2023-09-22 15:09:47--  https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz
Resolving hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)... 128.114.119.163
Connecting to hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)|128.114.119.163|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 983659424 (938M) [application/x-gzip]
Saving to: ‘hg38.fa.gz’

hg38.fa.gz                                      100%[================================================================================================================>] 938.09M  43.0MB/s    in 23s     

2023-09-22 15:10:10 (41.4 MB/s) - ‘hg38.fa.gz’ saved [983659424/983659424]

+ /opt/conda/bin/conda env create --quiet --name 'RBPamp' -f 'environment.yml'
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... failed

ResolvePackageNotFound: 
  - libgfortran=5.0.0

Error: Error creating conda environment [exit code 1]

I suspect this has something to do with the way the conda environment specifies the exact version of packages, that may or may not be compatible with both linux & macOS:

For example:

  - _r-mutex=1.0.1=anacondar_1
  - anyio=3.6.1=py38h50d1736_0
  - appnope=0.1.3=pyhd8ed1ab_0
  - argon2-cffi=21.3.0=pyhd8ed1ab_0
  - argon2-cffi-bindings=21.2.0=py38hed1de0f_2

If possible could you create a docker image for RegVar? This would ensure all users get the same installation environment.

Thank you & interesting paper!

RomoL2 commented 1 year ago

I have installed the RBPamp conda environment (alone and within RegVar) on our cluster so it's working on my linux, but it does look like yours can't find that version of Libgfortran. I will work on streamlining things, but in the meantime you could edit the yml to delete the version requirement on Libgfortran or move it to pip. I am co-opting RBPamp from another member of our lab who wrote it, but it should work without specifying the version.

On Fri, Sep 22, 2023 at 2:01 PM centimorgan22 @.***> wrote:

When trying to install on linux for use in an HPC environment. I get to the step here:

library(RegVar)

install_reqs('/Library/Frameworks/R.framework/Versions/4.0/Resources/library/RegVar')

And then I get this error:

R version 4.2.2 (2022-10-31) -- "Innocent and Trusting" Copyright (C) 2022 The R Foundation for Statistical Computing Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R.

library(RegVar) install_reqs('/opt/conda/envs/regvar_env/lib/R/library/RegVar') --2023-09-22 15:09:47-- https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz Resolving hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)... 128.114.119.163 Connecting to hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)|128.114.119.163|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 983659424 (938M) [application/x-gzip] Saving to: ‘hg38.fa.gz’

hg38.fa.gz 100%[================================================================================================================>] 938.09M 43.0MB/s in 23s

2023-09-22 15:10:10 (41.4 MB/s) - ‘hg38.fa.gz’ saved [983659424/983659424]

  • /opt/conda/bin/conda env create --quiet --name 'RBPamp' -f 'environment.yml' Collecting package metadata (repodata.json): ...working... done Solving environment: ...working... failed

ResolvePackageNotFound:

  • libgfortran=5.0.0

Error: Error creating conda environment [exit code 1]

I suspect this has something to do with the way the conda environment specifies the exact version of packages, that may or may not be compatible with both linux & macOS:

For example:

  • _r-mutex=1.0.1=anacondar_1
  • anyio=3.6.1=py38h50d1736_0
  • appnope=0.1.3=pyhd8ed1ab_0
  • argon2-cffi=21.3.0=pyhd8ed1ab_0
  • argon2-cffi-bindings=21.2.0=py38hed1de0f_2

If possible could you create a docker image for RegVar? This would ensure all users get the same installation environment.

Thank you & interesting paper!

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDAURYE6APWFE5BXTNTX3XHA3ANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

centimorgan22 commented 1 year ago

Thanks for the quick replies! Yes that is what I'm trying now actually. I removed all the version numbers, because I tried just Libgfortran, but then I got

Found conflicts! Looking for incompatible packages. This can take several minutes.

Which did not resolve. So fingers crossed that removing all version numbers works! The command has been stuck here for 4 hours however:

R version 4.2.2 (2022-10-31) -- "Innocent and Trusting"
Copyright (C) 2022 The R Foundation for Statistical Computing
Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library(RegVar)
> install_reqs('/opt/conda/envs/regvar_env/lib/R/library/RegVar')
--2023-09-22 15:57:01--  https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz
Resolving hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)... 128.114.119.163
Connecting to hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)|128.114.119.163|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 983659424 (938M) [application/x-gzip]
Saving to: ‘hg38.fa.gz.3’

hg38.fa.gz.3                                       100%[================================================================================================================>] 938.09M  42.3MB/s    in 23s     

2023-09-22 15:57:24 (41.3 MB/s) - ‘hg38.fa.gz.3’ saved [983659424/983659424]

+ /opt/conda/bin/conda env create --quiet --name 'RBPamp' -f 'environment.yml'
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... 
RomoL2 commented 1 year ago

Hmm that is a long time. It did take a while for me to load all the packages, but not 4 hours. However, this is something you should only have to do once. Like I said, bedtools should just be installed wherever you're running the functions (not in a conda env) and it should only use the conda env for RBPamp, so it shouldn't be something you have to do over and over. But as this has been a problem for a few people, I'm going to work on simplifying things so it's more universally applicable.

On Fri, Sep 22, 2023 at 2:40 PM centimorgan22 @.***> wrote:

Thanks for the quick replies! Yes that is what I'm trying now actually. I removed all the version numbers, because I tried just Libgfortran, but then I got

Found conflicts! Looking for incompatible packages. This can take several minutes.

Which did not resolve. So fingers crossed that removing all version numbers works! The command has been stuck here for 4 hours however:

R version 4.2.2 (2022-10-31) -- "Innocent and Trusting" Copyright (C) 2022 The R Foundation for Statistical Computing Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R.

library(RegVar) install_reqs('/opt/conda/envs/regvar_env/lib/R/library/RegVar') --2023-09-22 15:57:01-- https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz Resolving hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)... 128.114.119.163 Connecting to hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)|128.114.119.163|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 983659424 (938M) [application/x-gzip] Saving to: ‘hg38.fa.gz.3’

hg38.fa.gz.3 100%[================================================================================================================>] 938.09M 42.3MB/s in 23s

2023-09-22 15:57:24 (41.3 MB/s) - ‘hg38.fa.gz.3’ saved [983659424/983659424]

  • /opt/conda/bin/conda env create --quiet --name 'RBPamp' -f 'environment.yml' Collecting package metadata (repodata.json): ...working... done Solving environment: ...working...

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1731887262, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDBLYSWBBZWFTVI7ON3X3XLQJANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 1 year ago

I too had trouble with the conda environment today. Some version of something must have been updated. I'm fixing it now. I'm also trying to make it easier to download the annotation files. Will keep you posted once everything is done.

On Fri, Sep 22, 2023 at 2:48 PM Lindsay Romo @.***> wrote:

Hmm that is a long time. It did take a while for me to load all the packages, but not 4 hours. However, this is something you should only have to do once. Like I said, bedtools should just be installed wherever you're running the functions (not in a conda env) and it should only use the conda env for RBPamp, so it shouldn't be something you have to do over and over. But as this has been a problem for a few people, I'm going to work on simplifying things so it's more universally applicable.

On Fri, Sep 22, 2023 at 2:40 PM centimorgan22 @.***> wrote:

Thanks for the quick replies! Yes that is what I'm trying now actually. I removed all the version numbers, because I tried just Libgfortran, but then I got

Found conflicts! Looking for incompatible packages. This can take several minutes.

Which did not resolve. So fingers crossed that removing all version numbers works! The command has been stuck here for 4 hours however:

R version 4.2.2 (2022-10-31) -- "Innocent and Trusting" Copyright (C) 2022 The R Foundation for Statistical Computing Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R.

library(RegVar) install_reqs('/opt/conda/envs/regvar_env/lib/R/library/RegVar') --2023-09-22 15:57:01-- https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz Resolving hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)... 128.114.119.163 Connecting to hgdownload.soe.ucsc.edu (hgdownload.soe.ucsc.edu)|128.114.119.163|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 983659424 (938M) [application/x-gzip] Saving to: ‘hg38.fa.gz.3’

hg38.fa.gz.3 100%[================================================================================================================>] 938.09M 42.3MB/s in 23s

2023-09-22 15:57:24 (41.3 MB/s) - ‘hg38.fa.gz.3’ saved [983659424/983659424]

  • /opt/conda/bin/conda env create --quiet --name 'RBPamp' -f 'environment.yml' Collecting package metadata (repodata.json): ...working... done Solving environment: ...working...

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1731887262, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDBLYSWBBZWFTVI7ON3X3XLQJANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

centimorgan22 commented 1 year ago

Appreciate it, thank you!

RomoL2 commented 1 year ago

Ok, everything should be working again now! I moved the conda environment install outside of R so it's easier for people to see what's happening while they're installing (I was trying to make it simpler by wrapping it in R for people that aren't familiar with command line, but clearly that failed). I made a new requirements file, and everything is installing fine now for me locally and on unix. I updated the readme, so you should be able to follow the instructions now and get it to work. The conda environment solve did take around an hour for me. Let me know if it's working for you now! Now I'm going to work on fixing the annotation file downloads. :)

Lindsay

On Fri, Sep 22, 2023 at 3:09 PM centimorgan22 @.***> wrote:

Appreciate it, thank you!

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1731918170, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDH3YNCXFWAXW522MQ3X3XO5RANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

centimorgan22 commented 1 year ago

Unfortunately this is not working for me :( Unsure why. I did a fresh install of R and installed devtools. Then on the devtools::install_github("RomoL2/RegVar") #note, does not install large files I got this new error and can not continue. I tried this with both R version 4.0.5 & 4.3.1.

** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
*** copying figures
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
** checking absolute paths in shared objects and dynamic libraries
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* DONE (reticulate)

The downloaded source packages are in
        ‘/tmp/RtmpAs7p4P/downloaded_packages’
Updating HTML index of packages in '.Library'
Making 'packages.html' ... done
✔  checking for file ‘/tmp/RtmpAs7p4P/remotes74425d8c9d4/RomoL2-RegVar-de0fdc1/DESCRIPTION’ ...
─  preparing ‘RegVar’:
✔  checking DESCRIPTION meta-information ...
─  checking for LF line-endings in source and make files and shell scripts
─  checking for empty or unneeded directories
─  building ‘RegVar_0.0.0.9000.tar.gz’
   Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L,  :
     storing paths of more than 100 bytes is not portable:
     ‘RegVar/inst/extdata/eCLIP_GRCh38_reps_1_2_narrow_peak_ALL_RBP_cell_line_pairs.RBPs_with_amp_NEW_motifs.lines_assayed.lines_w_peak.NEW_aff_sum_peak_pm_10.in_top_motif.BY_BASE_BY_RBP.bed.gz’
   Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L,  :
     storing paths of more than 100 bytes is not portable:
     ‘RegVar/inst/extdata/LR_all_APA_peak_coords_hg38_by_base.phylop_100.phylop_17.phastcons_100.phastcons_17.txt.gz’
   Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L,  :
     using GNU extension for long pathname

* installing *source* package ‘RegVar’ ...
** using staged installation
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded from temporary location
Error: package or namespace load failed for ‘RegVar’ in namespaceExport(ns, exports):
 undefined exports: installRBPamp, install_reqs
Error: loading failed
Execution halted
ERROR: loading failed
* removing ‘/opt/conda/lib/R/library/RegVar’
Warning message:
In i.p(...) :
  installation of package ‘/tmp/RtmpAs7p4P/file7441566252f/RegVar_0.0.0.9000.tar.gz’ had non-zero exit status
RomoL2 commented 1 year ago

Oh I know what happened. Let me fix.

On Sat, Sep 23, 2023 at 2:58 PM centimorgan22 @.***> wrote:

Unfortunately this is not working for me :( Unsure why. I did a fresh install of R and installed devtools. Then on the devtools::install_github("RomoL2/RegVar")

note, does not install large files I got this new error and can not

continue. I tried this with both R version 4.0.5 & 4.3.1.

R inst byte-compile and prepare package for lazy loading help installing help indices copying figures building package indices installing vignettes testing if installed package can be loaded from temporary location checking absolute paths in shared objects and dynamic libraries testing if installed package can be loaded from final location testing if installed package keeps a record of temporary installation path

  • DONE (reticulate)

The downloaded source packages are in ‘/tmp/RtmpAs7p4P/downloaded_packages’ Updating HTML index of packages in '.Library' Making 'packages.html' ... done ✔ checking for file ‘/tmp/RtmpAs7p4P/remotes74425d8c9d4/RomoL2-RegVar-de0fdc1/DESCRIPTION’ ... ─ preparing ‘RegVar’: ✔ checking DESCRIPTION meta-information ... ─ checking for LF line-endings in source and make files and shell scripts ─ checking for empty or unneeded directories ─ building ‘RegVar_0.0.0.9000.tar.gz’ Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L, : storing paths of more than 100 bytes is not portable: ‘RegVar/inst/extdata/eCLIP_GRCh38_reps_1_2_narrow_peak_ALL_RBP_cell_line_pairs.RBPs_with_amp_NEW_motifs.lines_assayed.lines_w_peak.NEW_aff_sum_peak_pm_10.in_top_motif.BY_BASE_BY_RBP.bed.gz’ Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L, : storing paths of more than 100 bytes is not portable: ‘RegVar/inst/extdata/LR_all_APA_peak_coords_hg38_by_base.phylop_100.phylop_17.phastcons_100.phastcons_17.txt.gz’ Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L, : using GNU extension for long pathname

  • installing source package ‘RegVar’ ... using staged installation R inst byte-compile and prepare package for lazy loading ** help * installing help indices building package indices ** testing if installed package can be loaded from temporary location Error: package or namespace load failed for ‘RegVar’ in namespaceExport(ns, exports): undefined exports: installRBPamp, install_reqs Error: loading failed Execution halted ERROR: loading failed
  • removing ‘/opt/conda/lib/R/library/RegVar’ Warning message: In i.p(...) : installation of package ‘/tmp/RtmpAs7p4P/file7441566252f/RegVar_0.0.0.9000.tar.gz’ had non-zero exit status

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1732387962, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDH5ET4V6XKD7HKJL6TX34WODANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 1 year ago

Should be fixed. Sorry I accidentally removed two files. Now they are back.

On Sat, Sep 23, 2023 at 3:10 PM Lindsay Romo @.***> wrote:

Oh I know what happened. Let me fix.

On Sat, Sep 23, 2023 at 2:58 PM centimorgan22 @.***> wrote:

Unfortunately this is not working for me :( Unsure why. I did a fresh install of R and installed devtools. Then on the devtools::install_github("RomoL2/RegVar")

note, does not install large files I got this new error and can not

continue. I tried this with both R version 4.0.5 & 4.3.1.

R inst byte-compile and prepare package for lazy loading help installing help indices copying figures building package indices installing vignettes testing if installed package can be loaded from temporary location checking absolute paths in shared objects and dynamic libraries testing if installed package can be loaded from final location testing if installed package keeps a record of temporary installation path

  • DONE (reticulate)

The downloaded source packages are in ‘/tmp/RtmpAs7p4P/downloaded_packages’ Updating HTML index of packages in '.Library' Making 'packages.html' ... done ✔ checking for file ‘/tmp/RtmpAs7p4P/remotes74425d8c9d4/RomoL2-RegVar-de0fdc1/DESCRIPTION’ ... ─ preparing ‘RegVar’: ✔ checking DESCRIPTION meta-information ... ─ checking for LF line-endings in source and make files and shell scripts ─ checking for empty or unneeded directories ─ building ‘RegVar_0.0.0.9000.tar.gz’ Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L, : storing paths of more than 100 bytes is not portable: ‘RegVar/inst/extdata/eCLIP_GRCh38_reps_1_2_narrow_peak_ALL_RBP_cell_line_pairs.RBPs_with_amp_NEW_motifs.lines_assayed.lines_w_peak.NEW_aff_sum_peak_pm_10.in_top_motif.BY_BASE_BY_RBP.bed.gz’ Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L, : storing paths of more than 100 bytes is not portable: ‘RegVar/inst/extdata/LR_all_APA_peak_coords_hg38_by_base.phylop_100.phylop_17.phastcons_100.phastcons_17.txt.gz’ Warning in utils::tar(filepath, pkgname, compression = compression, compression_level = 9L, : using GNU extension for long pathname

  • installing source package ‘RegVar’ ... using staged installation R inst byte-compile and prepare package for lazy loading ** help * installing help indices building package indices ** testing if installed package can be loaded from temporary location Error: package or namespace load failed for ‘RegVar’ in namespaceExport(ns, exports): undefined exports: installRBPamp, install_reqs Error: loading failed Execution halted ERROR: loading failed
  • removing ‘/opt/conda/lib/R/library/RegVar’ Warning message: In i.p(...) : installation of package ‘/tmp/RtmpAs7p4P/file7441566252f/RegVar_0.0.0.9000.tar.gz’ had non-zero exit status

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1732387962, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDH5ET4V6XKD7HKJL6TX34WODANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

centimorgan22 commented 1 year ago

Now I got to this step:

cd /Library/Frameworks/R.framework/Versions/4.0/Resources/library/RegVar/extdata/RBPamp
conda create --name RBPamp --file requirements.txt -c conda-forge

But there is no requirements.txt to be found. Followed the instructions as listed.

(base) root@5b31:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# ls
LICENSE  MANIFEST  MANIFEST.in  RBPamp  RBPamp.yml  README.md  beacon  bin  bitbucket-pipelines.yml  docker  environment.yml  install_RBPamp.sh  nsRBNS  rRBNS  setup.py  tests
(base) root@5b31:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# conda create --name RBPamp --file requirements.txt -c conda-forge

CondaFileIOError: 'requirements.txt'. [Errno 2] No such file or directory: 'requirements.txt'

I'll assume you meant environment.yml and continue

RomoL2 commented 1 year ago

Ugh somehow the requirements.txt file was not in the tar on zenodo. I have fixed that, but in the meantime I've attached the requirements.txt. The environment.yml might work, but I know the txt file works for the dependencies.

On Mon, Sep 25, 2023 at 10:25 AM centimorgan22 @.***> wrote:

Now I got to this step:

cd /Library/Frameworks/R.framework/Versions/4.0/Resources/library/RegVar/extdata/RBPamp conda create --name RBPamp --file requirements.txt -c conda-forge

But there is no requirements.txt to be found. Followed the instructions as listed.

(base) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# ls LICENSE MANIFEST MANIFEST.in RBPamp RBPamp.yml README.md beacon bin bitbucket-pipelines.yml docker environment.yml install_RBPamp.sh nsRBNS rRBNS setup.py tests (base) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# conda create --name RBPamp --file requirements.txt -c conda-forge

CondaFileIOError: 'requirements.txt'. [Errno 2] No such file or directory: 'requirements.txt'

I'll assume you meant environment.yml and continue

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1733819406, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDCCPFZQETQD52TWO7LX4GH4XANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

python>=3.6

setuptools==41.2.0 numpy>=1.13 scipy>=0.19.1 pandas>=0.22.0 matplotlib>=2.1.1 seaborn==0.8.1 svgpath2mpl>=0.2.1 Cython>=0.29.13 pyzmq==17.1.2

pysam==0.15.3 needs zlib1g-dev and libbzip2 etc...

ncls==0.0.43

Jinja2==2.10.1 simplejson==3.16.0

pdfkit==0.6.1

centimorgan22 commented 1 year ago

I did a fresh install and then retried with the updated file and this command conda create --name RBPamp --file requirements.txt -c conda-forge but still am running into issues. Below is the output. Admittedly, I am getting a bit frustrated, so I'll need to step away from this for a bit.

(base) root@5b31:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# conda activate RBPamp
(RBPamp) root@5b31:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# export CC=gcc
(RBPamp) root@5b31:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# python setup.py build #there will be a lot of warnings in the window; don't worry unless build fails
/opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/__init__.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8
  warnings.warn(msg)
/opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/__init__.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8
  warnings.warn(msg)
/opt/conda/envs/RBPamp/lib/python3.7/distutils/extension.py:131: UserWarning: Unknown Extension options: 'language_level'
  warnings.warn(msg)
running build
running build_py
creating build/lib.linux-x86_64-3.7
creating build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/params.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/sc.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/subsampling.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/pwm.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/analysis.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/track_allocations.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/partfunc.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/footprint.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/util.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/kmer_interactions.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/gradient.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/cmdline.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/psamgrad.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/affinity.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/__init__.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/cyska.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/comparison.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/affinitylogo.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/seed.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/caching.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/simulator.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/zmq_logging.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/scheduler.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/reads.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/errors.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/ska_runner.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/digitize.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/tests.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/report.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/fold.py -> build/lib.linux-x86_64-3.7/RBPamp
copying RBPamp/status.py -> build/lib.linux-x86_64-3.7/RBPamp
running build_ext
skipping 'RBPamp/cython/kmers.c' Cython extension (up-to-date)
skipping 'RBPamp/cython/model.c' Cython extension (up-to-date)
skipping 'RBPamp/cython/fastrand.c' Cython extension (up-to-date)
building 'RBPamp.cy.cy_kmers' extension
creating build/temp.linux-x86_64-3.7
creating build/temp.linux-x86_64-3.7/RBPamp
creating build/temp.linux-x86_64-3.7/RBPamp/cython
gcc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/envs/RBPamp/lib/python3.7/site-packages/numpy/core/include -I/opt/conda/envs/RBPamp/include/python3.7m -c RBPamp/cython/kmers.c -o build/temp.linux-x86_64-3.7/RBPamp/cython/kmers.o -fopenmp -O3 -ffast-math -march=native -mtune=native
unable to execute 'gcc': No such file or directory
error: command 'gcc' failed with exit status 1
(RBPamp) root@5b31:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# python setup.py install
/opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/__init__.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8
  warnings.warn(msg)
/opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/__init__.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8
  warnings.warn(msg)
/opt/conda/envs/RBPamp/lib/python3.7/distutils/extension.py:131: UserWarning: Unknown Extension options: 'language_level'
  warnings.warn(msg)
running install
/opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/__init__.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8
  warnings.warn(msg)
/opt/conda/envs/RBPamp/lib/python3.7/site-packages/setuptools/command/easy_install.py:342: UserWarning: Unbuilt egg for .-RBPamp [unknown version] (/opt/conda/lib/R/library/RegVar/extdata/RBPamp)
  self.local_index = Environment(self.shadow_path + sys.path)
running bdist_egg
running egg_info
writing RBPamp.egg-info/PKG-INFO
writing dependency_links to RBPamp.egg-info/dependency_links.txt
writing requirements to RBPamp.egg-info/requires.txt
writing top-level names to RBPamp.egg-info/top_level.txt
reading manifest file 'RBPamp.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'RBPamp/ska_kmers.pyx'
writing manifest file 'RBPamp.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
skipping 'RBPamp/cython/kmers.c' Cython extension (up-to-date)
skipping 'RBPamp/cython/model.c' Cython extension (up-to-date)
skipping 'RBPamp/cython/fastrand.c' Cython extension (up-to-date)
building 'RBPamp.cy.cy_kmers' extension
gcc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/envs/RBPamp/lib/python3.7/site-packages/numpy/core/include -I/opt/conda/envs/RBPamp/include/python3.7m -c RBPamp/cython/kmers.c -o build/temp.linux-x86_64-3.7/RBPamp/cython/kmers.o -fopenmp -O3 -ffast-math -march=native -mtune=native
unable to execute 'gcc': No such file or directory
error: command 'gcc' failed with exit status 1

(base) root@5b31:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# R

R version 4.3.1 (2023-06-16) -- "Beagle Scouts"
Copyright (C) 2023 The R Foundation for Statistical Computing
Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library(RegVar)
> CharacterizeVariants_single_input('~/')
Enter 3'UTR single nucleotide variant chromosome number: 1
Enter variant position in 1-based coordinates: 24357511
Enter hg38 reference base (capitalized) at variant position: G
Enter variant base (capitalized): A
Enter a name for this variant (no spaces): 2
[1] "incorporating eCLIP"
[1] "incorporating eQTLS"
[1] "incorporating GWAS"
[1] "incorporating microRNAs"
[1] "incorporating RBP motifs"
processing TRNAU1AP.txt
Error in py_run_file_impl(file, local, convert) : 
  ModuleNotFoundError: No module named 'RBPamp.params'
Run `reticulate::py_last_error()` for details.
RomoL2 commented 1 year ago

I'm sorry; it looks like it is failing at the gcc command. You may not have that installed. If you type "gcc --version" and nothing comes up that is the problem. When you are ready to try again, you can try running without that (we were just having an issue with the compiler which is why I entered that). You can also install gcc on linux:

sudo apt-get update

sudo apt install build-essential

gcc --version

On Mon, Sep 25, 2023 at 11:29 AM centimorgan22 @.***> wrote:

I did a fresh install and then retried with the updated file and this command conda create --name RBPamp --file requirements.txt -c conda-forge but still am running into issues. Below is the output. Admittedly, I am getting a bit frustrated, so I'll need to step away from this for a bit.

(base) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# conda activate RBPamp (RBPamp) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# export CC=gcc (RBPamp) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# python setup.py build #there will be a lot of warnings in the window; don't worry unless build fails /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/distutils/extension.py:131: UserWarning: Unknown Extension options: 'language_level' warnings.warn(msg) running build running build_py creating build/lib.linux-x86_64-3.7 creating build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/params.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/sc.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/subsampling.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/pwm.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/analysis.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/track_allocations.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/partfunc.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/footprint.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/util.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/kmer_interactions.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/gradient.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/cmdline.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/psamgrad.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/affinity.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/init.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/cyska.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/comparison.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/affinitylogo.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/seed.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/caching.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/simulator.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/zmq_logging.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/scheduler.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/reads.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/errors.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/ska_runner.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/digitize.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/tests.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/report.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/fold.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/status.py -> build/lib.linux-x86_64-3.7/RBPamp running build_ext skipping 'RBPamp/cython/kmers.c' Cython extension (up-to-date) skipping 'RBPamp/cython/model.c' Cython extension (up-to-date) skipping 'RBPamp/cython/fastrand.c' Cython extension (up-to-date) building 'RBPamp.cy.cy_kmers' extension creating build/temp.linux-x86_64-3.7 creating build/temp.linux-x86_64-3.7/RBPamp creating build/temp.linux-x86_64-3.7/RBPamp/cython gcc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/envs/RBPamp/lib/python3.7/site-packages/numpy/core/include -I/opt/conda/envs/RBPamp/include/python3.7m -c RBPamp/cython/kmers.c -o build/temp.linux-x86_64-3.7/RBPamp/cython/kmers.o -fopenmp -O3 -ffast-math -march=native -mtune=native unable to execute 'gcc': No such file or directory error: command 'gcc' failed with exit status 1 (RBPamp) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# python setup.py install /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/distutils/extension.py:131: UserWarning: Unknown Extension options: 'language_level' warnings.warn(msg) running install /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/site-packages/setuptools/command/easy_install.py:342: UserWarning: Unbuilt egg for .-RBPamp [unknown version] (/opt/conda/lib/R/library/RegVar/extdata/RBPamp) self.local_index = Environment(self.shadow_path + sys.path) running bdist_egg running egg_info writing RBPamp.egg-info/PKG-INFO writing dependency_links to RBPamp.egg-info/dependency_links.txt writing requirements to RBPamp.egg-info/requires.txt writing top-level names to RBPamp.egg-info/top_level.txt reading manifest file 'RBPamp.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching 'RBPamp/ska_kmers.pyx' writing manifest file 'RBPamp.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py running build_ext skipping 'RBPamp/cython/kmers.c' Cython extension (up-to-date) skipping 'RBPamp/cython/model.c' Cython extension (up-to-date) skipping 'RBPamp/cython/fastrand.c' Cython extension (up-to-date) building 'RBPamp.cy.cy_kmers' extension gcc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/envs/RBPamp/lib/python3.7/site-packages/numpy/core/include -I/opt/conda/envs/RBPamp/include/python3.7m -c RBPamp/cython/kmers.c -o build/temp.linux-x86_64-3.7/RBPamp/cython/kmers.o -fopenmp -O3 -ffast-math -march=native -mtune=native unable to execute 'gcc': No such file or directory error: command 'gcc' failed with exit status 1

(base) @.***:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# R

R version 4.3.1 (2023-06-16) -- "Beagle Scouts" Copyright (C) 2023 The R Foundation for Statistical Computing Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R.

library(RegVar) CharacterizeVariants_single_input('~/') Enter 3'UTR single nucleotide variant chromosome number: 1 Enter variant position in 1-based coordinates: 24357511 Enter hg38 reference base (capitalized) at variant position: G Enter variant base (capitalized): A Enter a name for this variant (no spaces): 2 [1] "incorporating eCLIP" [1] "incorporating eQTLS" [1] "incorporating GWAS" [1] "incorporating microRNAs" [1] "incorporating RBP motifs" processing TRNAU1AP.txt Error in py_run_file_impl(file, local, convert) : ModuleNotFoundError: No module named 'RBPamp.params' Run reticulate::py_last_error() for details.

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1733956409, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDDAUWM7FA2WU7T5T7LX4GPNFANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 1 year ago

Also, for what it's worth, I really appreciate you debugging all of this with me!

On Mon, Sep 25, 2023 at 11:45 AM Lindsay Romo @.***> wrote:

I'm sorry; it looks like it is failing at the gcc command. You may not have that installed. If you type "gcc --version" and nothing comes up that is the problem. When you are ready to try again, you can try running without that (we were just having an issue with the compiler which is why I entered that). You can also install gcc on linux:

sudo apt-get update

sudo apt install build-essential

gcc --version

On Mon, Sep 25, 2023 at 11:29 AM centimorgan22 @.***> wrote:

I did a fresh install and then retried with the updated file and this command conda create --name RBPamp --file requirements.txt -c conda-forge but still am running into issues. Below is the output. Admittedly, I am getting a bit frustrated, so I'll need to step away from this for a bit.

(base) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# conda activate RBPamp (RBPamp) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# export CC=gcc (RBPamp) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# python setup.py build #there will be a lot of warnings in the window; don't worry unless build fails /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/distutils/extension.py:131: UserWarning: Unknown Extension options: 'language_level' warnings.warn(msg) running build running build_py creating build/lib.linux-x86_64-3.7 creating build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/params.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/sc.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/subsampling.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/pwm.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/analysis.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/track_allocations.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/partfunc.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/footprint.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/util.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/kmer_interactions.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/gradient.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/cmdline.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/psamgrad.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/affinity.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/init.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/cyska.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/comparison.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/affinitylogo.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/seed.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/caching.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/simulator.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/zmq_logging.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/scheduler.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/reads.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/errors.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/ska_runner.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/digitize.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/tests.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/report.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/fold.py -> build/lib.linux-x86_64-3.7/RBPamp copying RBPamp/status.py -> build/lib.linux-x86_64-3.7/RBPamp running build_ext skipping 'RBPamp/cython/kmers.c' Cython extension (up-to-date) skipping 'RBPamp/cython/model.c' Cython extension (up-to-date) skipping 'RBPamp/cython/fastrand.c' Cython extension (up-to-date) building 'RBPamp.cy.cy_kmers' extension creating build/temp.linux-x86_64-3.7 creating build/temp.linux-x86_64-3.7/RBPamp creating build/temp.linux-x86_64-3.7/RBPamp/cython gcc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/envs/RBPamp/lib/python3.7/site-packages/numpy/core/include -I/opt/conda/envs/RBPamp/include/python3.7m -c RBPamp/cython/kmers.c -o build/temp.linux-x86_64-3.7/RBPamp/cython/kmers.o -fopenmp -O3 -ffast-math -march=native -mtune=native unable to execute 'gcc': No such file or directory error: command 'gcc' failed with exit status 1 (RBPamp) @.:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# python setup.py install /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/distutils/extension.py:131: UserWarning: Unknown Extension options: 'language_level' warnings.warn(msg) running install /opt/conda/envs/RBPamp/lib/python3.7/site-packages/pkg_resources/init.py:1908: UserWarning: /opt/conda/lib/R/library/RegVar/extdata/RBPamp/._RBPamp.egg-info could not be properly decoded in UTF-8 warnings.warn(msg) /opt/conda/envs/RBPamp/lib/python3.7/site-packages/setuptools/command/easy_install.py:342: UserWarning: Unbuilt egg for .-RBPamp [unknown version] (/opt/conda/lib/R/library/RegVar/extdata/RBPamp) self.local_index = Environment(self.shadow_path + sys.path) running bdist_egg running egg_info writing RBPamp.egg-info/PKG-INFO writing dependency_links to RBPamp.egg-info/dependency_links.txt writing requirements to RBPamp.egg-info/requires.txt writing top-level names to RBPamp.egg-info/top_level.txt reading manifest file 'RBPamp.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching 'RBPamp/ska_kmers.pyx' writing manifest file 'RBPamp.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py running build_ext skipping 'RBPamp/cython/kmers.c' Cython extension (up-to-date) skipping 'RBPamp/cython/model.c' Cython extension (up-to-date) skipping 'RBPamp/cython/fastrand.c' Cython extension (up-to-date) building 'RBPamp.cy.cy_kmers' extension gcc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/envs/RBPamp/lib/python3.7/site-packages/numpy/core/include -I/opt/conda/envs/RBPamp/include/python3.7m -c RBPamp/cython/kmers.c -o build/temp.linux-x86_64-3.7/RBPamp/cython/kmers.o -fopenmp -O3 -ffast-math -march=native -mtune=native unable to execute 'gcc': No such file or directory error: command 'gcc' failed with exit status 1

(base) @.***:/opt/conda/lib/R/library/RegVar/extdata/RBPamp# R

R version 4.3.1 (2023-06-16) -- "Beagle Scouts" Copyright (C) 2023 The R Foundation for Statistical Computing Platform: x86_64-conda-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R.

library(RegVar) CharacterizeVariants_single_input('~/') Enter 3'UTR single nucleotide variant chromosome number: 1 Enter variant position in 1-based coordinates: 24357511 Enter hg38 reference base (capitalized) at variant position: G Enter variant base (capitalized): A Enter a name for this variant (no spaces): 2 [1] "incorporating eCLIP" [1] "incorporating eQTLS" [1] "incorporating GWAS" [1] "incorporating microRNAs" [1] "incorporating RBP motifs" processing TRNAU1AP.txt Error in py_run_file_impl(file, local, convert) : ModuleNotFoundError: No module named 'RBPamp.params' Run reticulate::py_last_error() for details.

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1733956409, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDDAUWM7FA2WU7T5T7LX4GPNFANCNFSM6AAAAAA5DOJ7CA . You are receiving this because you commented.Message ID: @.***>

apaul7 commented 8 months ago

Hi, was there a solution found? I'm having difficulty creating a docker image that has RegVar working. I've done my best to go through all the install steps. Docker image is hosted on docker hub at apaul7/regvar:test

error I'm seeing about a undefined symbol

(base) root@dd4f475271e0:/# R

R version 4.0.4 (2021-02-15) -- "Lost Library Book"
Copyright (C) 2021 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> library("RegVar")
> CharacterizeVariants_single_input('~/')
Enter 3'UTR single nucleotide variant chromosome number: 1
Enter variant position in 1-based coordinates: 24357511
Enter hg38 reference base (capitalized) at variant position: G
Enter variant base (capitalized): A
Enter a name for this variant (no spaces): test1
gzip: clinvar_for_script.bed already exists; do you wish to overwrite (y or n)? y
[1] "incorporating eCLIP"
[1] "incorporating eQTLS"
[1] "incorporating GWAS"
[1] "incorporating microRNAs"
[1] "incorporating RBP motifs"
processing SF1.txt
Error in py_run_file_impl(file, local, convert) :
  ImportError: /opt/conda/envs/RBPamp/lib/python3.7/site-packages/RBPamp-0.9.20-py3.7-linux-x86_64.egg/RBPamp/cy/cy_model.cpython-37m-x86_64-linux-gnu.so: undefined symbol: _ZGVbN2v_exp
Run `reticulate::py_last_error()` for details.
> q()

current docker file:

FROM continuumio/miniconda3:23.3.1-0
MAINTAINER Alexander Paul <alex.paul@wustl.edu>

LABEL \
  version="0.0.1" \
  description="Image for RegVar(https://github.com/RomoL2/RegVar)"

RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y \
    build-essential \
    curl \
    gcc \
    git \
    git-lfs \
    libcurl4-openssl-dev \
    libfontconfig1-dev \
    libfreetype6-dev \
    libfribidi-dev \
    libharfbuzz-dev \
    libjpeg-dev \
    libpng-dev \
    libssl-dev \
    libtiff5-dev \
    libxml2-dev \
    python3 \
    python3-pip \
    r-base \
    vim \
    wget \
    && apt-get clean \
    && rm -rf /var/lib/apt/lists/*

# bedtools
ENV BEDTOOLS_VERSION="2.31.0"
RUN cd /usr/local/bin/ && \
    wget https://github.com/arq5x/bedtools2/releases/download/v${BEDTOOLS_VERSION}/bedtools.static && \
    mv bedtools.static bedtools && \
    chmod +x bedtools

RUN conda install -n base -c conda-forge mamba

RUN R -e "install.packages('devtools', dependencies=TRUE)"
RUN R -e "devtools::install_github('RomoL2/RegVar')"

WORKDIR /usr/local/lib/R/site-library/RegVar
RUN rm -r extdata \
  && wget https://zenodo.org/record/8377025/files/extdata.tar.gz \
  && tar -xf extdata.tar.gz \
  && rm extdata.tar.gz \
  && cd extdata \
  && wget https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz \
  && gunzip hg38.fa.gz

# install RBPamp
WORKDIR /usr/local/lib/R/site-library/RegVar/extdata/RBPamp
RUN mamba create --name RBPamp --file requirements.txt -c conda-forge --yes

RUN /opt/conda/envs/RBPamp/bin/pip install future-fstrings --force-reinstall \
  && export CC=gcc \
  && /opt/conda/envs/RBPamp/bin/python setup.py build \
  && /opt/conda/envs/RBPamp/bin/python setup.py install

WORKDIR /
RomoL2 commented 8 months ago

The problem is definitely at the rbpamp step. Were you able to install rbpamp conda environment without errors?

install RBPamp

WORKDIR /usr/local/lib/R/site-library/RegVar/extdata/RBPamp RUN mamba create --name RBPamp --file requirements.txt -c conda-forge --yes

RUN /opt/conda/envs/RBPamp/bin/pip install future-fstrings --force-reinstall \ && export CC=gcc \ && /opt/conda/envs/RBPamp/bin/python setup.py build \ && /opt/conda/envs/RBPamp/bin/python setup.py install

On Fri, Feb 2, 2024 at 4:55 PM Alex Paul @.***> wrote:

Hi, was there a solution found? I'm having difficulty creating a docker image that has RegVar working. I've done my best to go through all the install steps. Docker image is hosted on docker hub at apaul7/regvar:test

error I'm seeing about a undefined symbol

(base) @.***:/# R

R version 4.0.4 (2021-02-15) -- "Lost Library Book" Copyright (C) 2021 The R Foundation for Statistical Computing Platform: x86_64-pc-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details.

R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R.

library("RegVar") CharacterizeVariants_single_input('~/') Enter 3'UTR single nucleotide variant chromosome number: 1 Enter variant position in 1-based coordinates: 24357511 Enter hg38 reference base (capitalized) at variant position: G Enter variant base (capitalized): A Enter a name for this variant (no spaces): test1 gzip: clinvar_for_script.bed already exists; do you wish to overwrite (y or n)? y [1] "incorporating eCLIP" [1] "incorporating eQTLS" [1] "incorporating GWAS" [1] "incorporating microRNAs" [1] "incorporating RBP motifs" processing SF1.txt Error in py_run_file_impl(file, local, convert) : ImportError: /opt/conda/envs/RBPamp/lib/python3.7/site-packages/RBPamp-0.9.20-py3.7-linux-x86_64.egg/RBPamp/cy/cy_model.cpython-37m-x86_64-linux-gnu.so: undefined symbol: _ZGVbN2v_exp Run reticulate::py_last_error() for details. q()

current docker file:

FROM continuumio/miniconda3:23.3.1-0 MAINTAINER Alexander Paul @.***>

LABEL \ version="0.0.1" \ description="Image for RegVar(https://github.com/RomoL2/RegVar)"

RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y \ build-essential \ curl \ gcc \ git \ git-lfs \ libcurl4-openssl-dev \ libfontconfig1-dev \ libfreetype6-dev \ libfribidi-dev \ libharfbuzz-dev \ libjpeg-dev \ libpng-dev \ libssl-dev \ libtiff5-dev \ libxml2-dev \ python3 \ python3-pip \ r-base \ vim \ wget \ && apt-get clean \ && rm -rf /var/lib/apt/lists/*

bedtools

ENV BEDTOOLS_VERSION="2.31.0" RUN cd /usr/local/bin/ && \ wget https://github.com/arq5x/bedtools2/releases/download/v${BEDTOOLS_VERSION}/bedtools.static && \ mv bedtools.static bedtools && \ chmod +x bedtools

RUN conda install -n base -c conda-forge mamba

RUN R -e "install.packages('devtools', dependencies=TRUE)" RUN R -e "devtools::install_github('RomoL2/RegVar')"

WORKDIR /usr/local/lib/R/site-library/RegVar RUN rm -r extdata \ && wget https://zenodo.org/record/8377025/files/extdata.tar.gz \ && tar -xf extdata.tar.gz \ && rm extdata.tar.gz \ && cd extdata \ && wget https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz \ && gunzip hg38.fa.gz

install RBPamp

WORKDIR /usr/local/lib/R/site-library/RegVar/extdata/RBPamp RUN mamba create --name RBPamp --file requirements.txt -c conda-forge --yes

RUN /opt/conda/envs/RBPamp/bin/pip install future-fstrings --force-reinstall \ && export CC=gcc \ && /opt/conda/envs/RBPamp/bin/python setup.py build \ && /opt/conda/envs/RBPamp/bin/python setup.py install

WORKDIR /

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1924761485, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDG5WRP74AZ5K5OYMWDYRVOGVAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRUG43DCNBYGU . You are receiving this because you commented.Message ID: @.***>

apaul7 commented 8 months ago

I believe so. I can import it in a python session.

(base) root@f7dbec9b73c1:/# conda activate RBPamp
(RBPamp) root@f7dbec9b73c1:/# python
Python 3.7.12 | packaged by conda-forge | (default, Oct 26 2021, 06:08:21)
[GCC 9.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import RBPamp
>>>
RomoL2 commented 8 months ago

Ok- give me a few moments. I have definitely gotten that error before in RBPamp and I can't remember how I fixed it but i'll work on it right now.

Lindsay

On Fri, Feb 2, 2024 at 5:20 PM Alex Paul @.***> wrote:

I believe so. I can import it in a python session.

(base) @.:/# conda activate RBPamp (RBPamp) @.:/# python Python 3.7.12 | packaged by conda-forge | (default, Oct 26 2021, 06:08:21) [GCC 9.4.0] on linux Type "help", "copyright", "credits" or "license" for more information.

import RBPamp

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1924784945, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDCFLI6LOEPTBYTPFH3YRVRBBAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRUG44DIOJUGU . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 8 months ago

OK, if I remember correctly, this was a cython problem that I fixed by updating cython. Can you try updating and re-running?

pip install cython --upgrade

On Fri, Feb 2, 2024 at 5:20 PM Alex Paul @.***> wrote:

I believe so. I can import it in a python session.

(base) @.:/# conda activate RBPamp (RBPamp) @.:/# python Python 3.7.12 | packaged by conda-forge | (default, Oct 26 2021, 06:08:21) [GCC 9.4.0] on linux Type "help", "copyright", "credits" or "license" for more information.

import RBPamp

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1924784945, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDCFLI6LOEPTBYTPFH3YRVRBBAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRUG44DIOJUGU . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 8 months ago

(in the RBPamp conda environment)

On Fri, Feb 2, 2024 at 6:38 PM Lindsay Romo @.***> wrote:

OK, if I remember correctly, this was a cython problem that I fixed by updating cython. Can you try updating and re-running?

pip install cython --upgrade

On Fri, Feb 2, 2024 at 5:20 PM Alex Paul @.***> wrote:

I believe so. I can import it in a python session.

(base) @.:/# conda activate RBPamp (RBPamp) @.:/# python Python 3.7.12 | packaged by conda-forge | (default, Oct 26 2021, 06:08:21) [GCC 9.4.0] on linux Type "help", "copyright", "credits" or "license" for more information.

import RBPamp

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1924784945, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDCFLI6LOEPTBYTPFH3YRVRBBAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRUG44DIOJUGU . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 8 months ago

It is working for me in a docker image with basically the same code as yours (just moved the zenodo files so that number is updated). Not sure why it's not working for you? I did update cython in the environment, so maybe that's it? Granted I don't really use docker. But it is working in the container locally. docker pull romol2/regvar FROM continuumio/miniconda3:23.3.1-0 MAINTAINER Lindsay Romo @.***>

LABEL \ version="0.0.1" \ description="Image for RegVar(https://github.com/RomoL2/RegVar)"

RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y \ build-essential \ curl \ gcc \ git \ git-lfs \ libcurl4-openssl-dev \ libfontconfig1-dev \ libfreetype6-dev \ libfribidi-dev \ libharfbuzz-dev \ libjpeg-dev \ libpng-dev \ libssl-dev \ libtiff5-dev \ libxml2-dev \ python3 \ python3-pip \ r-base \ vim \ wget \ && apt-get clean \ && rm -rf /var/lib/apt/lists/*

bedtools

ENV BEDTOOLS_VERSION="2.31.0" RUN cd /usr/local/bin/ && \ wget https://github.com/arq5x/bedtools2/releases/download/v ${BEDTOOLS_VERSION}/bedtools.static && \ mv bedtools.static bedtools && \ chmod +x bedtools

RUN conda install -n base -c conda-forge mamba

RUN R -e "install.packages('devtools', dependencies=TRUE)" RUN R -e "devtools::install_github('RomoL2/RegVar')"

WORKDIR /usr/local/lib/R/site-library/RegVar RUN rm -r extdata \ && wget https://zenodo.org/record/10612152/files/extdata.tar.gz \ && tar -xf extdata.tar.gz \ && rm extdata.tar.gz \ && cd extdata \ && wget https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz \ && gunzip hg38.fa.gz

install RBPamp

WORKDIR /usr/local/lib/R/site-library/RegVar/extdata/RBPamp RUN mamba create --name RBPamp --file requirements.txt -c conda-forge --yes

RUN /opt/conda/envs/RBPamp/bin/pip install future-fstrings --force-reinstall \ && export CC=gcc \ && /opt/conda/envs/RBPamp/bin/python setup.py build \ && /opt/conda/envs/RBPamp/bin/python setup.py install

WORKDIR /

When I run this docker image, I'm able to run the whole code in the container (including RBPamp).

On Fri, Feb 2, 2024 at 6:46 PM Lindsay Romo @.***> wrote:

(in the RBPamp conda environment)

On Fri, Feb 2, 2024 at 6:38 PM Lindsay Romo @.***> wrote:

OK, if I remember correctly, this was a cython problem that I fixed by updating cython. Can you try updating and re-running?

pip install cython --upgrade

On Fri, Feb 2, 2024 at 5:20 PM Alex Paul @.***> wrote:

I believe so. I can import it in a python session.

(base) @.:/# conda activate RBPamp (RBPamp) @.:/# python Python 3.7.12 | packaged by conda-forge | (default, Oct 26 2021, 06:08:21) [GCC 9.4.0] on linux Type "help", "copyright", "credits" or "license" for more information.

import RBPamp

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1924784945, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDCFLI6LOEPTBYTPFH3YRVRBBAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRUG44DIOJUGU . You are receiving this because you commented.Message ID: @.***>

apaul7 commented 8 months ago

Ahh I didn't notice the zenodo file was updated. I recreated my docker image using the updated file. I also reinstalled python using pip in the RBPamp env. Still get the same error.

I also got the same error using your docker image. Looks like your dockerfile is exactly like mine after updating the correct zenodo tar file?

RomoL2 commented 8 months ago

Did you try updating cython? Yes mine is exactly the same but working on my computer, which makes me think it’s a version issue with one of the dependencies. What cython and python versions are you using?

Lindsay

On Mon, Feb 5, 2024 at 2:30 PM Alex Paul @.***> wrote:

Ahh I didn't notice the zenodo file was updated. I recreated my docker image using the updated file. I also reinstalled python using pip in the RBPamp env. Still get the same error.

I also got the same error using your docker image. Looks like your dockerfile is exactly like mine after updating the correct zenodo tar file?

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1927887012, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDDKME2TPFRN6V3WHBTYSEXOTAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRXHA4DOMBRGI . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 8 months ago

The last time I had this issue this is how I fixed it:

Reinstalled cython

conda install -c anaconda python

Ran build file in RBPamp folder

python setup.py build

Pip install in RBPamp folder

pip install .

On Mon, Feb 5, 2024 at 4:39 PM Lindsay Romo @.***> wrote:

Did you try updating cython? Yes mine is exactly the same but working on my computer, which makes me think it’s a version issue with one of the dependencies. What cython and python versions are you using?

Lindsay

On Mon, Feb 5, 2024 at 2:30 PM Alex Paul @.***> wrote:

Ahh I didn't notice the zenodo file was updated. I recreated my docker image using the updated file. I also reinstalled python using pip in the RBPamp env. Still get the same error.

I also got the same error using your docker image. Looks like your dockerfile is exactly like mine after updating the correct zenodo tar file?

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1927887012, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDDKME2TPFRN6V3WHBTYSEXOTAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRXHA4DOMBRGI . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 8 months ago

Also (sorry for bajillion emails here) Marvin had a docker for rbpamp that you could try to incorporate. I’ll mess with that tonight:

https://bitbucket.org/marjens/rbpamp/src/master/docker/Dockerfile

On Mon, Feb 5, 2024 at 5:06 PM Lindsay Romo @.***> wrote:

The last time I had this issue this is how I fixed it:

Reinstalled cython

conda install -c anaconda python

Ran build file in RBPamp folder

python setup.py build

Pip install in RBPamp folder

pip install .

On Mon, Feb 5, 2024 at 4:39 PM Lindsay Romo @.***> wrote:

Did you try updating cython? Yes mine is exactly the same but working on my computer, which makes me think it’s a version issue with one of the dependencies. What cython and python versions are you using?

Lindsay

On Mon, Feb 5, 2024 at 2:30 PM Alex Paul @.***> wrote:

Ahh I didn't notice the zenodo file was updated. I recreated my docker image using the updated file. I also reinstalled python using pip in the RBPamp env. Still get the same error.

I also got the same error using your docker image. Looks like your dockerfile is exactly like mine after updating the correct zenodo tar file?

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1927887012, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDDKME2TPFRN6V3WHBTYSEXOTAVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRXHA4DOMBRGI . You are receiving this because you commented.Message ID: @.***>

apaul7 commented 8 months ago

Yes, as you previously mentioned, I updated cython. version 3.0.8 was installed.

Now I'm confused. Is cython supposed to be updated with pip or conda? Is it updated before building rbpamp or after? Is rbpamp installed using python setup.py install or pip install .

I'm pretty sure the 1st and 3rd question don't matter as they do the same thing. I'm just trying to make sure I install the correct way.

I have been able to get rbpamp installed in a docker image using that dockerfile as a guide. The issue was it made a command line tool install. I could not figure out how to set up the environment so the import RBPamp runs successfully from python scripts in regvar.

apaul7 commented 8 months ago

If I upgrade cython to 3.0.8 first and run python setup.py build it fails to cythonize Cython.Compiler.Errors.CompileError: RBPamp/cython/kmers.pyx

RomoL2 commented 8 months ago

Argh, this is very frustrating because I cannot get this error duplicated on my end, even though I've had it before and someone else is getting the same error. Even when I am running your dockerfile I don't get the error, and I don't understand why, since that should be a self-contained environment, correct? What would cause an error on your computer but not mine? It's so hard to troubleshoot when I can't duplicate it. I will keep trying, but I am not sure why this is happening. I'm also trying to reach out to Marvin, who wrote the RBPamp code. So hopefully I will figure it out soon.

Lindsay

On Mon, Feb 5, 2024 at 5:41 PM Alex Paul @.***> wrote:

If I upgrade cython to 3.0.8 first and run python setup.py build it fails to cythonize Cython.Compiler.Errors.CompileError: RBPamp/cython/kmers.pyx

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1928395477, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDC7D6KQVCBLMVHKXH3YSFNZ5AVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRYGM4TKNBXG4 . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 8 months ago

Ok I repulled the docker and am finally getting an error. I think it has to do with conda env dependencies. I’m going to work on cloning my working conda environment into the docker and will share the dockerfile once working.

On Mon, Feb 5, 2024 at 7:41 PM Lindsay Romo @.***> wrote:

Argh, this is very frustrating because I cannot get this error duplicated on my end, even though I've had it before and someone else is getting the same error. Even when I am running your dockerfile I don't get the error, and I don't understand why, since that should be a self-contained environment, correct? What would cause an error on your computer but not mine? It's so hard to troubleshoot when I can't duplicate it. I will keep trying, but I am not sure why this is happening. I'm also trying to reach out to Marvin, who wrote the RBPamp code. So hopefully I will figure it out soon.

Lindsay

On Mon, Feb 5, 2024 at 5:41 PM Alex Paul @.***> wrote:

If I upgrade cython to 3.0.8 first and run python setup.py build it fails to cythonize Cython.Compiler.Errors.CompileError: RBPamp/cython/kmers.pyx

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1928395477, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDC7D6KQVCBLMVHKXH3YSFNZ5AVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRYGM4TKNBXG4 . You are receiving this because you commented.Message ID: @.***>

RomoL2 commented 8 months ago

Ok; I think it is working now. It was a cython issue but hopefully it is fixed. Try running this dockerfile. Let me know if you run into any issues:

FROM continuumio/miniconda3:23.3.1-0 MAINTAINER Lindsay Romo @.***>

LABEL \ version="0.0.1" \ description="Image for RegVar(https://github.com/RomoL2/RegVar)"

RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y \ build-essential \ curl \ git \ gcc-4.8\ git-lfs \ libcurl4-openssl-dev \ libfontconfig1-dev \ libfreetype6-dev \ libfribidi-dev \ libharfbuzz-dev \ libjpeg-dev \ libpng-dev \ libssl-dev \ libtiff5-dev \ libxml2-dev \ python3 \ bedtools \ python3-pip \ r-base \ vim \ wget \ && apt-get clean \ && rm -rf /var/lib/apt/lists/*

RUN conda install -n base -c conda-forge mamba

RUN R -e "install.packages('devtools', dependencies=TRUE)" RUN R -e "devtools::install_github('RomoL2/RegVar')"

WORKDIR /usr/local/lib/R/site-library/RegVar RUN rm -r extdata \ && wget https://zenodo.org/record/10646785/files/extdata.tar.gz \ && tar -xf extdata.tar.gz \ && rm extdata.tar.gz \ && cd extdata \ && wget https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz \ && gunzip hg38.fa.gz

install RBPamp

WORKDIR /usr/local/lib/R/site-library/RegVar/extdata/RBPamp RUN mamba create --name RBPamp --file requirements.txt -c conda-forge --yes

RUN /opt/conda/envs/RBPamp/bin/pip install future-fstrings --force-reinstall \ && export CC=gcc \ && /opt/conda/envs/RBPamp/bin/python setup.py build \ && /opt/conda/envs/RBPamp/bin/python setup.py install

WORKDIR /

On Tue, Feb 6, 2024 at 8:20 AM Lindsay Romo @.***> wrote:

Ok I repulled the docker and am finally getting an error. I think it has to do with conda env dependencies. I’m going to work on cloning my working conda environment into the docker and will share the dockerfile once working.

On Mon, Feb 5, 2024 at 7:41 PM Lindsay Romo @.***> wrote:

Argh, this is very frustrating because I cannot get this error duplicated on my end, even though I've had it before and someone else is getting the same error. Even when I am running your dockerfile I don't get the error, and I don't understand why, since that should be a self-contained environment, correct? What would cause an error on your computer but not mine? It's so hard to troubleshoot when I can't duplicate it. I will keep trying, but I am not sure why this is happening. I'm also trying to reach out to Marvin, who wrote the RBPamp code. So hopefully I will figure it out soon.

Lindsay

On Mon, Feb 5, 2024 at 5:41 PM Alex Paul @.***> wrote:

If I upgrade cython to 3.0.8 first and run python setup.py build it fails to cythonize Cython.Compiler.Errors.CompileError: RBPamp/cython/kmers.pyx

— Reply to this email directly, view it on GitHub https://github.com/RomoL2/RegVar/issues/5#issuecomment-1928395477, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZOARDC7D6KQVCBLMVHKXH3YSFNZ5AVCNFSM6AAAAAA5DOJ7CCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRYGM4TKNBXG4 . You are receiving this because you commented.Message ID: @.***>