search

koaning / gli

my gleeful scripts for the cli
https://koaning.github.io/gli/
MIT License
2 stars 0 forks source link

model annotate #12

Open koaning opened 1 year ago

koaning commented 1 year ago

It'd be really nice if we could have models just add predictions to a file.

python -m annotate --model en_core_web_md --file-in texts.jsonl --ner org:organisation,loc:location --file-out annot.jsonl
koaning commented 1 year ago

This might be especially useful via:

python -m annotate --model en_core_web_sm --file-in texts.jsonl --ner org:organisation,loc:location --file-out annot-sm.jsonl
python -m annotate --model en_core_web_md --file-in texts.jsonl --ner org:organisation,loc:location --file-out annot-md.jsonl
python -m annotate --model pattern_model  --file-in texts.jsonl --ner org:organisation,loc:location --file-out annot-pattern.jsonl

From here, we could attach session keys and then use db-in to get a dataset ready to review.