0) Download input.csv file into ~/Download directory
1) Configure SPipes in config-core.properties:
contexts.scriptPaths=$MY_PROJECTS/git/s-pipes-modules;$MY_PROJECTS/git/aircraft-maintenance-planning-system/aircraft-maintenance-planning-model/data;
2) Run SPipes from bash:
cd $MY_PROJECTS/git/aircraft-maintenance-planning-system
cd aircraft-maintenance-planning-model/data/time-analysis
cp ~/Download/input.csv ./target/input.csv
./bin/retrieve-data.sh
3) You should see the following error in SPipes log:
17-10-2023 01:42:36.704 [http-nio-8080-exec-3] ERROR c.c.s.modules.TabularModule - Reading input file failed when reading record #2 (may not reflect the line #).
It was expected that the current record contains 28 values, but 17. element was not retrieved before whole record was processed.
The problematic record:
Note, that the following pipeline fails only if acceptInvalidQuoting=true.
A/C:
1) formulate when and why it happens
2) propose a fix and validate with me
3) in case we agree on the fix, implement it otherwise make appropriate comment to the module and the option acceptInvalidQuoting
0) Download input.csv file into
~/Download
directory1) Configure SPipes in config-core.properties: contexts.scriptPaths=$MY_PROJECTS/git/s-pipes-modules;$MY_PROJECTS/git/aircraft-maintenance-planning-system/aircraft-maintenance-planning-model/data;
2) Run SPipes from bash:
3) You should see the following error in SPipes log:
Note, that the following pipeline fails only if acceptInvalidQuoting=true.
A/C: 1) formulate when and why it happens 2) propose a fix and validate with me 3) in case we agree on the fix, implement it otherwise make appropriate comment to the module and the option
acceptInvalidQuoting