Closed ntadimeti closed 3 years ago
@wookyung For this error :
For one of the errors, it looks like I have to modify 'infer_config.yaml':
hg19.50000.genome_intervals.bed --> hg38.50000.genome_intervals.bed.
Unfortunately, I couldn't edit it in 'claraomics/atacworks:test'. Would you
please change the dockerfile so that I can edit .yaml file under your
docker? Or can you directly provide the dockerfile?
are you able to find the config file under /data/kimw/ATAC/ATAC_2019/atacworks/tutorial2/configs/infer_config.yaml
? If you can find this file, are you able to open it using vim? Like
vi /data/kimw/ATAC/ATAC_2019/atacworks/tutorial2/configs/infer_config.yaml
? If you are able to open it, can you edit it ?
Let's solve one problem at a time, so we can make better progress.
Hi @ntadimeti,
I am happy to be able to try AtacWorks with my data finally. I appreciate your help! For editing config files, vim/vi command didn't work on the docker system. Could you let me use vim commands or other editting commands on the system? Thanks!
Best, Wookyung
2020년 6월 22일 (월) 오후 5:13, ntadimeti notifications@github.com님이 작성:
Let's solve one problem at a time, so we can make better progress.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/clara-parabricks/AtacWorks/issues/175#issuecomment-647795395, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADFBRTNZCH3RLZUNUAZOAGTRX7JQJANCNFSM4OFCL6RA .
@wookyung You can install vim inside your docker container using apt install vim
. And then you will be able to open the file using the vi
command. Please let me know if the installation worked for you.
Hi,
In my docker with 'claraomics/atacworks:test', I couldn't install vim due to 'permission denied'. 'apt install' doesn't work in my docker. I know it is weird and annoying. So normally I do add vim in the dockerfile so that vim can be installed once the docker opens. Does it work for 'claraomics/atacworks:test' or is there any idea? Thanks.
Wookyung
2020년 6월 24일 (수) 오전 11:19, ntadimeti notifications@github.com님이 작성:
@wookyung https://github.com/wookyung You can install vim inside your docker container using apt install vim. And then you will be able to open the file using the vi command. Please let me know if the installation worked for you.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/clara-parabricks/AtacWorks/issues/175#issuecomment-648921225, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADFBRTKAX3LKLEURLIAXBE3RYIRPNANCNFSM4OFCL6RA .
@wookyung There's two potential solutions. One is to just modify the Dockerfile and create a new image. Other option is to try running the docker container with root permissions.
Is the second option possible in your case ? Here's how you can do that:
docker exec --user="root" -it test /bin/bash
. This will open an interactive shell into the docker container but with root permissions. If the above doesn't work for you, you can clone the AtacWorks repository from here: https://github.com/clara-parabricks/AtacWorks/tree/master. You will find a Dockerfile in the parent directory. Feel free to modify it, create your own containers to work with.
Let me know which option worked for you. Sorry for the delayed response.
Hi @ntadimeti,
I'm sorry for the late reply. I was busy with other things for a while. I realized there was big progress in the tool development. This is very COOL! It became much easier for a user like me to use. Thanks! I already tried your new version with both your tutorial file and my own data and hope I can give you good feedbacks also with a question.
As you know, I am using a docker version. There are two versions that I know: a) claraomics/atacworks (maybe latest by default) @ https://clara-parabricks.github.io/AtacWorks/Dockerfile.html; b) the one you modified for me before (and also I think you updated after that )- claraomics/atacworks:test.
1. When I tried a) and I couldn't find the path to /AtacWorks folder. However, I remembered there's a test version that I can try. The test version (b)claraomics/atacworks:test) worked well when I tried it with both your new tutorial2 and my data.
command run atacworks denoise \ --noisybw ATAC_seq_step3.2_normalized_per_10M_H501_S4_R1_001.bw \ --genome $atacworks/data/reference/hg38.auto.sizes \ --weights_path /data/kimw/ATAC/ATAC_2019/atacworks/models/model.pth.tar \ --out_home "./" \ --exp_name "atacworks_denoise" \ --distributed \ --num_workers 0
d---------. 2 kimw domain users 8192 Aug 5 22:12 intervals
d---------. 2 kimw domain users 8192 Aug 5 22:12 bw2h5
----------. 1 kimw domain users 677124524 Dec 24 2019 s3.2_10M_H501_S4_R1_001.bw
----------. 1 kimw domain users 44884372923 Aug 6 02:18 ATAC_seq_step3_infer.track.bedGraph
----------. 1 kimw domain users 8833899461 Aug 6 03:18 ATAC_seq_step3_infer.track.bw http://ATAC_seq_step3_infer.track.bw
----------. 1 kimw domain users 447589964 Aug 6 03:18 ATAC_seq_step3_infer.peaks.bedGraph
----------. 1 kimw domain users 84201999 Aug 6 03:19 ATAC_seq_step3_infer.peaks.bw
----------. 1 kimw domain users 39387398 Aug 6 11:36 step3.2_10M_H50l_peak_calls.bed
Thanks in advance.
-Wookyung
2020년 6월 29일 (월) 오후 12:09, ntadimeti notifications@github.com님이 작성:
@wookyung https://github.com/wookyung There's two potential solutions. One is to just modify the Dockerfile and create a new image. Other option is to try running the docker container with root permissions.
Is the second option possible in your case ? Here's how you can do that:
- Launch the docker container with docker run command, add --name test to it.
- In a new terminal, run the following command : docker exec --user="root" -it test /bin/bash. This will open an interactive shell into the docker container but with root permissions.
If the above doesn't work for you, you can clone the AtacWorks repository from here: https://github.com/clara-parabricks/AtacWorks/tree/master. You will find a Dockerfile in the parent directory. Feel free to modify it, create your own containers to work with.
Let me know which option worked for you. Sorry for the delayed response.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/clara-parabricks/AtacWorks/issues/175#issuecomment-651248405, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADFBRTLKWFDQXXW7KYQ27GDRZDDE3ANCNFSM4OFCL6RA .
Hello! Thanks for testing out our new version @wookyung. You can read all about atacworks Dockerfiles here: https://clara-parabricks.github.io/AtacWorks/Dockerfile.html
In short, we have two dockerfiles now. 1) claraomics/atacworks:latest -- This contains pre-installed atacworks (pip install atacworks). This image does not contain source code. Most useful for running atacworks train and denoise commands
2) claraomics/atacworks:source-latest -- This contains atacworks source code. Use this image for running tutorials etc. It should work just as well as the claraomics/atacworks:test.
Congratulations on being able to run atacworks on your data. Thanks for being patient with us.
Regarding the file size and experiment specific questions, I'll let @avantikalal get back to you.
@feefee20 In my experiments I typically see track.bw
outputs of 300-400 MB. So this does seem quite large. Could you share the chromosome sizes file that you used for inference, and also the top few lines of the track.bedGraph
output file?
Closing this issue, since it is inactive. @feefee20 please feel free to open this issue or open a new issue if you need help anytime.
Hi @ntadimeti,
I have some quick questions. Since my sequencing samples are aligned to hg38, I should prepare some files required for hg38 like an interval file. So I made the hg38.interval file and .h5 file based on the following commands.
However, when main.py infer ran, I got the following errors.
1) For one of the errors, it looks like I have to modify 'infer_config.yaml': hg19.50000.genome_intervals.bed --> hg38.50000.genome_intervals.bed. Unfortunately, I couldn't edit it in 'claraomics/atacworks:test'. Would you please change the dockerfile so that I can edit .yaml file under your docker? Or can you directly provide the dockerfile?
2) For other errors, do you have any ideas?
3) In tutorial2, you set 50,000 for intervals of genome. Is it a common setting? For real data, what would you recommend for intervals? 1000? 500?
Thanks for your answers!
Best, Wookyung