search

tetherless-world / mowgli-etl

DARPA Machine Common Sense (MCS) Multi-modal Open World Grounded Learning and Inference (MOWGLI) Extract-Transform-Load sub-project
MIT License
6 stars 1 forks source link

RDF pipeline is failing in CI #80

Closed stouffers closed 4 years ago

stouffers commented 4 years ago

https://circleci.com/gh/tetherless-world/mowgli/174

It seems to be taking too long or running out of memory.

if [ "${CIRCLE_BRANCH}" == "master" ]; then
  python3 -m mowgli.cli etl rdf --skip-whole-graph-check --data-dir-path cskg --nodes-csv-file-path cskg/combined/loaded/nodes.csv --edges-csv-file-path cskg/combined/loaded/edges.csv --pipeline-id combined-rdf
fi

2020-04-28 14:53:17,778:pipeline_wrapper:54:PipelineWrapper:INFO: Skipping graph checking during transform
2020-04-28 14:53:17,778:cskg_csv_transformer:29:CskgCsvTransformer:INFO: Reading CSKG nodes from cskg/combined/loaded/nodes.csv
2020-04-28 14:53:19,349:cskg_csv_transformer:45:CskgCsvTransformer:INFO: Reading CSKG edges from cskg/combined/loaded/edges.csv

Too long with no output (exceeded 10m0s): context deadline exceeded
gordom6 commented 4 years ago

Disabling, not used currently.