feralvam / easse

Easier Automatic Sentence Simplification Evaluation
GNU General Public License v3.0
158 stars 36 forks source link

How to apply easse to custom data? #101

Open vegebun opened 2 years ago

vegebun commented 2 years ago

I am trying to evaluate a customized set of asset data. However, I am not very sure how to use the syntax. Currently I am using this syntax

!easse evaluate --refs_sents_paths ref_data --orig_sents_path orig_data --sys_sents_path test_pred_dir -t custom -m 'bleu,sari,fkgl' -q < easse/easse/resources/data/system_outputs/asset/test

which will report this error:

`

Fatal Python error: _PySys_BeginInit: is a directory, cannot continue

Current thread 0x00007f5625e9b780 (most recent call first): `

I am using google collar, and all the path can correctly access the files.

image

image

image

Can you please let me know at which step is my syntax wrong ? Thank you so much!

louismartin commented 2 years ago

I think there are multiple errors: