kbss-cvut / s-pipes

Tool for execution of RDF-based pipelines.
GNU Lesser General Public License v3.0
4 stars 5 forks source link

Tabular module ignores ending quote #223

Open blcham opened 11 months ago

blcham commented 11 months ago

0) Download input.csv file into ~/Download directory

1) Configure SPipes in config-core.properties: contexts.scriptPaths=$MY_PROJECTS/git/s-pipes-modules;$MY_PROJECTS/git/aircraft-maintenance-planning-system/aircraft-maintenance-planning-model/data;

2) Run SPipes from bash:

cd $MY_PROJECTS/git/aircraft-maintenance-planning-system
cd aircraft-maintenance-planning-model/data/time-analysis
cp ~/Download/input.csv ./target/input.csv
./bin/retrieve-data.sh

3) You should see the following error in SPipes log:

17-10-2023 01:42:36.704 [http-nio-8080-exec-3] ERROR c.c.s.modules.TabularModule - Reading input file failed when reading record #2 (may not reflect the line #).
 It was expected that the current record contains 28 values, but 17. element was not retrieved before whole record was processed.
The problematic record: 

Note, that the following pipeline fails only if acceptInvalidQuoting=true.


A/C: 1) formulate when and why it happens 2) propose a fix and validate with me 3) in case we agree on the fix, implement it otherwise make appropriate comment to the module and the option acceptInvalidQuoting