lazierthanthou / sqlite-manager

Manage all your sqlite databases using this lightweight extension for firefox, thunderbird, seamonkey, komodo etc.
http://lazierthanthou.github.io/sqlite-manager/
325 stars 133 forks source link

Failed to import lines #86

Open reichaves opened 7 years ago

reichaves commented 7 years ago

Hello

This is Reinaldo Chaves, from São Paulo, Brazil.

I am now analyzing the accountability of 2014 candidates from throughout Brazil (http://www.tse.jus.br/eleicoes/estatisticas/repositorio-de-dados-eleitorais). It is a TXT file. I opened it in Excel and did some wiping (I cut columns, I changed columns name to remove whitespace and accents and I changed CNPJ values in scientific notation to number without decimals) - it has 427,490 lines - and I saved it as CSV But when opening in SQLite does not matter all the lines - it has 426.559 lines - and it shows the message: Failed to import 21 lines. Row numbers: 52304, 52313, 52315, 55354 ...

Could the file have been damaged when opening in Excel and saved as CSV?

Then I tried to open TXT straight, but it does not matter a few lines: Failed to import 4 lines. Row numbers: 52304, 52313, 52315, 55354

In very large files can SQLite have import errors?

Best regards

Reinaldo Chaves reichaves@gmail.com