clarkkev / deep-coref

270 stars 59 forks source link

need a details guide on how to train the model #1

Closed SeekPoint closed 7 years ago

SeekPoint commented 7 years ago

"Run the NeuralCorefDataExporter class in version Stanford's CoreNLP using the neural-coref-conll properties file. This does mention detection and feature extraction on the CoNLL data and then outputs the results as json"

how to do this, which command and its parameter?

SeekPoint commented 7 years ago

sorry , I really has no idea on java

mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ ll total 170 drwxrwxrwx 1 mldl mldl 4096 1月 25 22:57 ./ drwxrwxrwx 1 mldl mldl 8192 1月 25 15:41 ../ lrwxrwxrwx 1 mldl mldl 78 1月 25 22:57 alltools -> /home/mldl/data/deep-coref--dataset/ -rwxrwxrwx 1 mldl mldl 4047 11月 14 14:54 build_datasets.py -rwxrwxrwx 1 mldl mldl 13027 11月 14 14:54 clustering_learning.py -rwxrwxrwx 1 mldl mldl 5988 11月 14 14:54 clustering_models.py -rwxrwxrwx 1 mldl mldl 6308 11月 14 14:54 clustering_preprocessing.py -rwxrwxrwx 1 mldl mldl 1144 11月 14 14:54 custom_neural_implementations.py -rwxrwxrwx 1 mldl mldl 24868 11月 14 14:54 datasets.py -rwxrwxrwx 1 mldl mldl 940 11月 14 14:54 directories.py -rwxrwxrwx 1 mldl mldl 5364 11月 14 14:54 document.py -rwxrwxrwx 1 mldl mldl 3630 11月 14 14:54 evaluation.py drwxrwxrwx 1 mldl mldl 4096 1月 25 15:41 .git/ -rwxrwxrwx 1 mldl mldl 6653 11月 14 14:54 model_properties.py drwxrwxrwx 1 mldl mldl 4096 1月 25 15:41 modified_keras/ -rwxrwxrwx 1 mldl mldl 3464 11月 14 14:54 output_utils.py -rwxrwxrwx 1 mldl mldl 16112 11月 14 14:54 pairwise_learning.py -rwxrwxrwx 1 mldl mldl 10393 11月 14 14:54 pairwise_models.py -rwxrwxrwx 1 mldl mldl 2609 11月 14 14:54 preprocessing.py -rwxrwxrwx 1 mldl mldl 2639 11月 14 14:54 README.md -rwxrwxrwx 1 mldl mldl 2809 11月 14 14:54 run_all.py -rwxrwxrwx 1 mldl mldl 559 11月 14 14:54 timer.py -rwxrwxrwx 1 mldl mldl 4432 11月 14 14:54 utils.py -rwxrwxrwx 1 mldl mldl 3675 11月 14 14:54 word_vectors.py -rwxrwxrwx 1 mldl mldl 0 12月 21 14:32 yknote_BLOCKED_BY_JAVA mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ java -Xmx2g -cp alltools/stanford-corenlp-full-2016-10-31/stanford-corenlp.jar:alltools/stanford-corenlp-full-2016-10-31/stanford-corenlp-models-3.7.0.jar: edu.stanford.nlp.coref.NeuralCorefDataExporter alltools/neural-english-conll.properties output.json Error: Could not find or load main class edu.stanford.nlp.coref.NeuralCorefDataExporter mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ java -Xmx2g -cp alltools/stanford-corenlp-full-2016-10-31/stanford-corenlp.jar:alltools/stanford-corenlp-full-2016-10-31/stanford-corenlp-models-3.7.0.jar: NeuralCorefDataExporter alltools/neural-english-conll.properties output.json Error: Could not find or load main class NeuralCorefDataExporter mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ java -Xmx2g -cp alltools/stanford-corenlp-full-2016-10-31/stanford-corenlp.jar:alltools/stanford-corenlp-full-2016-10-31/stanford-corenlp-models-3.7.0.jar:* NeuralCorefDataExporter.java alltools/neural-english-conll.properties output.json Error: Could not find or load main class NeuralCorefDataExporter.java mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$ mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref$

mldl@mldlUB1604:/media/mldl/data1t/osprj/deep-coref/alltools$ tree . ├── conll.cemantix.org-2012-data │   ├── conll-2012-development.v4.tar.gz │   ├── CoNLL-2012 Shared Task Data.mht │   ├── conll-2012-submissions.tar.gz │   ├── conll-2012-test-key.tar.gz │   ├── conll-2012-test-official.v9.tar.gz │   ├── conll-2012-test-supplementary.v9.tar.gz │   └── conll-2012-train.v4.tar.gz ├── NeuralCorefDataExporter.java ├── neural-english-conll.properties ├── polyglot-zh.pkl ├── stanford-corenlp-full-2016-10-31 │   ├── build.xml │   ├── corenlp.sh │   ├── CoreNLP-to-HTML.xsl │   ├── ejml-0.23.jar │   ├── ejml-0.23-src.zip │   ├── input.txt │   ├── input.txt.xml │   ├── javax.json-api-1.0-sources.jar │   ├── javax.json.jar │   ├── joda-time-2.9-sources.jar │   ├── joda-time.jar │   ├── jollyday-0.4.9-sources.jar │   ├── jollyday.jar │   ├── LIBRARY-LICENSES │   ├── LICENSE.txt │   ├── Makefile │   ├── patterns │   │   ├── example.properties │   │   ├── goldnames.txt │   │   ├── goldplaces.txt │   │   ├── names.txt │   │   ├── otherpeople.txt │   │   ├── places.txt │   │   ├── presidents.txt │   │   └── stopwords.txt │   ├── pom.xml │   ├── protobuf.jar │   ├── README.txt │   ├── SemgrexDemo.java │   ├── ShiftReduceDemo.java │   ├── slf4j-api.jar │   ├── slf4j-simple.jar │   ├── stanford-corenlp-3.7.0.jar │   ├── stanford-corenlp-3.7.0-javadoc.jar │   ├── stanford-corenlp-3.7.0-models.jar │   ├── stanford-corenlp-3.7.0-sources.jar │   ├── StanfordCoreNlpDemo.java │   ├── StanfordDependenciesManual.pdf │   ├── sutime │   │   ├── defs.sutime.txt │   │   ├── english.holidays.sutime.txt │   │   └── english.sutime.txt │   ├── tokensregex │   │   ├── color.input.txt │   │   ├── color.properties │   │   ├── color.rules.txt │   │   └── retokenize.txt │   ├── xom-1.2.10-src.jar │   └── xom.jar └── w2v_50d.txt

5 directories, 57 files mldl@mldlUB1604:/media/mldl/data1t/os_prj/deep-coref/alltools$