steuernb / AgRenSeq

GNU General Public License v3.0
12 stars 5 forks source link

AgRenSeq #2

Open duhuipeng opened 4 years ago

duhuipeng commented 4 years ago

Why not have the AgRenSeq_CreatePresenceMatrix.jar, I can not find it in src hope answer the question

steuernb commented 4 years ago

Jar files are in the latest release https://github.com/steuernb/AgRenSeq/releases/

From: duhuipeng notifications@github.com Reply-To: steuernb/AgRenSeq reply@reply.github.com Date: Tuesday, 10 December 2019 at 14:46 To: steuernb/AgRenSeq AgRenSeq@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [steuernb/AgRenSeq] AgRenSeq (#2)

Why not have the AgRenSeq_CreatePresenceMatrix.jar, I can not find it in src hope answer the question

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/steuernb/AgRenSeq/issues/2?email_source=notifications&email_token=AB6MUFB2FFY3NXTGK5BDHZLQX6TT3A5CNFSM4JY7U2FKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4H7PJ7YA, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AB6MUFBZLQOM3M52DI5VNBLQX6TT3ANCNFSM4JY7U2FA.

duhuipeng commented 4 years ago

thank you,I am very appreciated for you

duhuipeng commented 4 years ago

java -jar AgRenSeq_CreatePresenceMatrix.jar -i accession.txt -o AgRenSeq_k51_presencematrix.txt -t 3 -n 10 The one above is my command code. however, it's made a mistake as follow. java.lang.ArrayIndexOutOfBoundsException: 1 at commandLineInterface.AgRenSeq_CreateMatrix.main(AgRenSeq_CreateMatrix.java:62) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58) hope answer the question

steuernb commented 4 years ago

The ArrayIndexOutOfBoundsException could come from a wrong separator in the accessions.txt. As it is now, it will only accept a tab separator. Any chance, that solves it?

duhuipeng commented 4 years ago

Follow your advice, it's also made a mistake as follow
java -jar AgRenSeq_CreatePresenceMatrix.jar -i accession.txt -o AgRenSeq_k51_presencematrix.txt -t 3 -n 10(Input command) reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession1.dump.txt finished reading accession1.dump.txt. Found 0 problems. Size of data: 2790 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession2.dump.txt finished reading accession2.dump.txt. Found 0 problems. Size of data: 9675883 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession3.dump.txt finished reading accession3.dump.txt. Found 0 problems. Size of data: 10855197 java.lang.ArrayIndexOutOfBoundsException: 1 at commandLineInterface.AgRenSeq_CreateMatrix.main(AgRenSeq_CreateMatrix.java:62) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58) (Show the results) I looked at the generated file and there was nothing,I am very puzzled

steuernb commented 4 years ago

Hi, you still get the ArrayIndexOutOfBoundsException in line 62. This is within a loop, reading line by line through accession.txt. It is very happy with the first 3 lines. In the fourth line, there is either no tab separator or no text after the first tab. The size of your data in accession1 looks also very small. I guess, that there is something wrong. Then, if you have -t 3 (kmer must be present in at least three accessions), you will not have much output.

duhuipeng commented 4 years ago

I still have this problem. I want to send a picture about the code for you.I don't know what to do . Do you have wechat?I would like to have a further communication with you on the code step, my wechat is Dhp940818, I hope you can agree

steuernb commented 4 years ago

I am not working in that group anymore where AgRenSeq has been developed. You probably get best help if you contact the corresponding author of the paper. If you post your accession.txt here I can still have a look what is going wrong with this particular step of the pipeline.

duhuipeng commented 4 years ago

I downloaded the process of three individuals to run,Is it because my individual data is too small because of the above reason?I'm going to download 20 individual data and try again.Do you feel like it can solve this problem?

duhuipeng commented 4 years ago

java -jar AgRenSeq_CreatePresenceMatrix.jar -i accession.txt -o AgRenSeq_k51_presencematrix.txt -t 3 -n 10 or java -jar AgRenSeq_CreatePresenceMatrix.jar -i accession.txt -o ./AgRenSeq_k51_presencematrix.txt -t 3 -n 10 The one above is my command code reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession2.dump.txt finished reading accession2.dump.txt. Found 0 problems. Size of data: 9675843 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession3.dump.txt finished reading accession3.dump.txt. Found 0 problems. Size of data: 10855157 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession6.dump.txt finished reading accession6.dump.txt. Found 0 problems. Size of data: 13700852 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession10.dump.txt finished reading accession10.dump.txt. Found 0 problems. Size of data: 15222557 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession13.dump.txt finished reading accession13.dump.txt. Found 0 problems. Size of data: 17508120 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession14.dump.txt finished reading accession14.dump.txt. Found 0 problems. Size of data: 18778615 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession15.dump.txt finished reading accession15.dump.txt. Found 0 problems. Size of data: 19469245 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession19.dump.txt finished reading accession19.dump.txt. Found 0 problems. Size of data: 20891927 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession20.dump.txt finished reading accession20.dump.txt. Found 0 problems. Size of data: 21714367 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession21.dump.txt finished reading accession21.dump.txt. Found 0 problems. Size of data: 21979623 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession24.dump.txt finished reading accession24.dump.txt. Found 0 problems. Size of data: 22484776 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession25.dump.txt finished reading accession25.dump.txt. Found 0 problems. Size of data: 23268070 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession33.dump.txt finished reading accession33.dump.txt. Found 0 problems. Size of data: 23679513 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession36.dump.txt finished reading accession36.dump.txt. Found 0 problems. Size of data: 24729058 reading /home/Duhuipeng/DHP/database/AgRenSeq_CreateMatrix/accession38.dump.txt finished reading accession38.dump.txt. Found 0 problems. Size of data: 25481635 java.lang.ArrayIndexOutOfBoundsException: 0 at commandLineInterface.AgRenSeq_CreateMatrix.main(AgRenSeq_CreateMatrix.java:61) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58) AgRenSeq_CreateMatrix version 1.0-i -o -t kmers present in less than or all but will not be recorded. -n The above is the result of the output after the run.Why I can't see my output file in the current directory.

steuernb commented 4 years ago

Can you please attach the file accessions.txt?

duhuipeng commented 4 years ago

accession.txt

steuernb commented 4 years ago

Thanks! Line 16 has a tab character. Can you try removing line number 16? accession.txt

duhuipeng commented 4 years ago

how to remove line number 16,I don't understand

duhuipeng commented 4 years ago

WeChat0ee06aa04602bbb0d25dfcd58fba7af4

steuernb commented 4 years ago

try running with the file I attached. In your file, you have a tab character in the line under the one with accession38. Unfortunately, this is interpreted as the accession "" with the path "".

duhuipeng commented 4 years ago

image is this the same after the deletion?

duhuipeng commented 4 years ago

image In your way, I ran out,Thank you very much for solving the problem I haven't dealt with for three weeks

duhuipeng commented 4 years ago

image I'd like to know how this transformation score was structured. I didn't find this method code

steuernb commented 4 years ago

Trial and error. This one works nicely for stem rust. For other systems, you might want to change it.

duhuipeng commented 4 years ago

I just built the missing matrix, now I want to build the phenotypic file, I'm running with the data you provide, I downloaded a small part, but I don't know how to construct this phenotypic file, I can't find the location of the code, I want to know where the transformation model can be found, I can't find the website.

steuernb commented 4 years ago

Please have a look at the paper again. In there you will find that the step you are starting now has been improved and is described here: https://github.com/kgaurav1208/AgRenSeq_GLM.

duhuipeng commented 4 years ago

I see that the software you use to assemble from scratch is expensive, so I can't go on now. I want to know how I assemble k-mer from scratch. I see that ABYSS can assemble k-mer from scratch, but he can only identify the format of fastq. What am I supposed to do?

steuernb commented 4 years ago

I had reasonable results with masurca. We have not tested it in this project so no promises but it should work.

duhuipeng commented 4 years ago

Can you provide a source of code for this Masurca software? I'm stuck in this process now. I can't go on.

steuernb commented 4 years ago

http://www.genome.umd.edu/masurca.html It has been a while since I used it. You will have to figure it out yourself. Or give ABYSS a go.

duhuipeng commented 4 years ago

If I'm going to use abyss, do you know how to convert k-mer to fastq, can I continue to use your code for a follow-up process

steuernb commented 4 years ago

You would do the de novo assembly with ABYSS on the fastq data of that accession you chose. You had fastq in the first place before you extracted kmers. The idea is to project the kmer matrix you created onto a de novo assembly of a resistant accession. Doing so, you will see signals on the contigs of your resistance gene.

If you continue using the pipeline on this github account you run AgRenSeq without regarding population structure. You will get some of the target genes but not all of them. I would recommend using AgRenSeq_GLM

duhuipeng commented 4 years ago

I'm beginning to assemble every accession, so how can I get RenSeq about the R gene, and Should I assemble all the accession from scratch into a total output file?

duhuipeng commented 4 years ago

I really want to add your WeChat, want to have a further communication with you, can you give a chance to be in scientific research and white exchange, this is my WeChat:Dhp940818, I sincerely hope you can add me, no matter whether you agree, you are very grateful for this time to answer my question

------------------ 原始邮件 ------------------ 发件人: "Burkhard Steuernagel"<notifications@github.com>; 发送时间: 2019年12月19日(星期四) 晚上8:39 收件人: "steuernb/AgRenSeq"<AgRenSeq@noreply.github.com>; 抄送: "七匹狼"<1561857525@qq.com>;"Author"<author@noreply.github.com>; 主题: Re: [steuernb/AgRenSeq] AgRenSeq (#2)

I had reasonable results with masurca. We have not tested it in this project so no promises but it should work.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.

steuernb commented 4 years ago

I feel like the level of support you need is beyond the pipeline in this repository. I urge you again to contact the corresponding author of the paper. If you are seeking a collaboration it should be with him.

duhuipeng commented 4 years ago

I'm still a student, don't seek cooperation, just want to run this process, I'm using ABTYSS to run a try, thank you very much for your answers, do not understand that through this platform in time to communicate with you.

duhuipeng commented 4 years ago

image I have made a de novo assembly of the accession2 and accsessions 3, and the output results are again assembled, as shown in the figure above, I want to use NLR-parser for non-fragment filtering now, but I can't find this jar file. I'd like to ask where I can find it. image

duhuipeng commented 4 years ago

image Why can't I get out of the bin under this path after I download it?,(As shown below)no matter what I am root or not root image

duhuipeng commented 4 years ago

image I finished the seventh step, because I assembled the ABYSS software from the walk. I don't know if the result of the seventh step is in the same form as the file content output by the CLC software you provided. At the same time, I have a software AgRenSeq_RunAssociation.jar that's not found, can I have a link to this software?

duhuipeng commented 4 years ago

java -jar AgRenSeq_RunAssociation.jar -i prenseceMatrix -p phenotype -o AgRenSeqResult.txt Can I and p in this step make the txt file I generated above?

duhuipeng commented 4 years ago

I want to know what went wrong with me. I came in this forma image

duhuipeng commented 4 years ago

image I don't know what's wrong with me. Can you help me? I can't think of it. It's stuck here again.

duhuipeng commented 4 years ago

image I draw a picture like this. How does it feel strange? can you point out where there is a problem?

laura45678 commented 3 years ago

image I don't know what's wrong with me. Can you help me? I can't think of it. It's stuck here again.

Dear @duhuipeng, when I run the AgRenSeq_RunAssociation.jar I am facing the same problem you had on Dec 21, 2019 (java.lang.NullPointerException). Do you remember how you solved it and would you tell me the solution? I would be very grateful for an answer

YFKIB commented 2 months ago

image I don't know what's wrong with me. Can you help me? I can't think of it. It's stuck here again.

Dear @duhuipeng, when I run the AgRenSeq_RunAssociation.jar I am facing the same problem you had on Dec 21, 2019 (java.lang.NullPointerException). Do you remember how you solved it and would you tell me the solution? I would be very grateful for an answer

You need to input the parameter nlr.txt, which is the result of the NLR-Parser,Can you add my WeChat? I stiil have some questions I want to discuss. My WeChat is fy1935107151。