search

weinberger / nosql-tests

NoSQL benchmark tests for documents and graphs
Apache License 2.0
288 stars 94 forks source link

OrientDB transformers return null #23

Open scaleoutsean opened 6 years ago

scaleoutsean commented 6 years ago

Ubuntu 16.04 on VMware 6.5 U1. Some OrientDB transformers failed. Anyone see this? I'll try again to see if this is reproducible. Is this warning is safe to ignore?

DOWNLOAD DIRECTORY: /tmp/nosqlbenchmark/downloads
Downloading PROFILES
--2018-02-15 13:49:24--  https://snap.stanford.edu/data/soc-pokec-profiles.txt.gz
Resolving snap.stanford.edu (snap.stanford.edu)... 171.64.75.80
Connecting to snap.stanford.edu (snap.stanford.edu)|171.64.75.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 435512787 (415M) [application/x-gzip]
Saving to: ‘/tmp/nosqlbenchmark/downloads/soc-pokec-profiles.txt.gz.tmp’

/tmp/nosqlbenchmark/downloa 100%[==========================================>] 415.34M  1.16MB/s    in 8m 32s  

2018-02-15 13:57:57 (830 KB/s) - ‘/tmp/nosqlbenchmark/downloads/soc-pokec-profiles.txt.gz.tmp’ saved [435512787/435512787]

Downloading RELATIONS
--2018-02-15 13:58:58--  https://snap.stanford.edu/data/soc-pokec-relationships.txt.gz
Resolving snap.stanford.edu (snap.stanford.edu)... 171.64.75.80
Connecting to snap.stanford.edu (snap.stanford.edu)|171.64.75.80|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 132454730 (126M) [application/x-gzip]
Saving to: ‘/tmp/nosqlbenchmark/downloads/soc-pokec-relationships.txt.gz’

/tmp/nosqlbenchmark/downloa 100%[==========================================>] 126.32M  1.23MB/s    in 2m 53s  

2018-02-15 14:01:52 (747 KB/s) - ‘/tmp/nosqlbenchmark/downloads/soc-pokec-relationships.txt.gz’ saved [132454730/132454730]

Converting PROFILES
Converting RELATIONS
OrientDB etl v.2.2.29 (build 9914189f972103907c24377a1567897e68642920) https://www.orientdb.com
[file] INFO Load from file /tmp/nosqlbenchmark/downloads/soc-pokec-profiles-orientdb.txt
[file] INFO Reading from file /tmp/nosqlbenchmark/downloads/soc-pokec-profiles-orientdb.txt with encoding UTF-8

2018-02-15 14:02:47:629 WARNI {db=pokec} Transformer [csv] returned null, skip rest of pipeline execution [OETLPipeline]
2018-02-15 14:02:47:630 WARNI {db=pokec} Transformer [vertex] returned null, skip rest of pipeline execution [OETLPipeline]
2018-02-15 14:09:19:868 WARNI {db=pokec} Transformer [vertex] returned null, skip rest of pipeline execution [OETLPipeline]
2018-02-15 14:09:19:868 WARNI {db=pokec} Transformer [edge] returned null, skip rest of pipeline execution [OETLPipeline]
...
mvollmary commented 6 years ago

Hi @scaleoutsean

I had the same warnings when running the import. Since all data were imported and results were right in all test cases, the warnings can be ignored safely. I was also confused the first time, especially because there is no additional output and the import takes a lot of time (almost 3 hours) but everything worked for me.

best Mark