yulqen / datamaps

MOVED: Command line interface to yulqen/bcompiler-engine. Used by DfT to collect and clean data using Excel spreadsheets.
https://git.sr.ht/~yulqen/datamaps
MIT License
2 stars 2 forks source link

Datamap containing a missing line critical error #20

Closed banillie closed 3 years ago

banillie commented 3 years ago

Recent testing of datamaps export master command raised the following error

CRITICAL - Datamap contains a missing line. Please fix datamap before proceeding.

was able to resolve this issue by deleting rows (~10) from the bottom of the datamap. Therefore likely issue with datamaps calculating last row in dm.cvs. Will send dm.cvs file causing error to you for testing. cmd is datamaps export master [PATH to master] and dm.cvs file in datamaps\input file. Any dummy master can be used.

yulqen commented 3 years ago

...have asked on Teams to be emailed a copy of the offending CSV file (to personal email please). Thank you!

banillie commented 3 years ago

done.

yulqen commented 3 years ago

The offending file contains thousands of empty rows. I will need to include a check for this is in the suite of checks that take place on a datamap prior to processing.

yulqen commented 3 years ago

Fixed in v1.1.5.