search

openlab / OGDI-DataLab

Open Government Data Initiative
http://ogdi.codeplex.com
Microsoft Public License
57 stars 17 forks source link

Catalog upload #34

Open mmiladinovicrs opened 11 years ago

mmiladinovicrs commented 11 years ago

Hi, I installed ogdi for test purpose. For now, I put the information that is available from datahub. But each csv file has an error... "Failed to process entity.

Entity Start: Name = 'EntityId' Value = '80ee7cda-9871-4ce6-88d2-68bf9f98e645' Name = 'DATE' Value = '1970-01-01' Name = 'VALUE' Value = '55.8' Name = 'RdfSnippet' Value = 'rdf:Description1970-01-01/ogdi:date55.8/ogdi:value/rdf:Description/rdf:RDF' Entity End

Value cannot be null. Parameter name: field

Failed to process entity."

Ok, some of these files, regardless to the errors,was successfully uploaded. Can someone explain what's going on? Of course, I used DataLoaderGuiApp...

nikg commented 11 years ago

Typically something like this happens when the fields contain data type different from what was configured, i.e. string in a numeric field, or double in the integer / int32 field.

It's difficult to troubleshoot without knowing the specifics of your .CFG file and the data you're loading.

MiroJ commented 11 years ago

Also, have in mind that the rows that had errors are not uploaded so you will be missing data. You need to find the problematic records before uploading a production DB.

mmiladinovicrs commented 11 years ago

Can someone to upload a valid csv file to try? In my case always appears the same error...

nikg commented 11 years ago

sure: https://github.com/openlab/OpenDataInstaller/blob/master/blob%20files/BurlingtonParks.csv

and the .cfg: https://github.com/openlab/OpenDataInstaller/blob/master/blob%20files/BurlingtonParks.cfg

end result: http://datadotgc2.cloudapp.net/DataBrowser/Hack%20OpenData/BurlingtonParks

mmiladinovicrs commented 11 years ago

There is definitely a problem. Look at attached image. BurlingtonParks I used csv in posted above.

nikg commented 11 years ago

did you use the attached CSV AND .cfg ?

mmiladinovicrs commented 11 years ago

I used posted csv file above. Copy/Paste in new file and than upload using DataLoader. Also, I tried to download file from http://datadotgc2.cloudapp.net/DataBrowser/Hack%20OpenData/BurlingtonParks . I don't see any other way.

mmiladinovicrs commented 11 years ago

Hi Nik, can you tell me what is the problem, so I know where I made mistake?

nikg commented 11 years ago

Hi - sorry for the delay, maybe we're miscommunicating. The CSV is one part of the DataLoader. CFG that's created by the DataLoader is another part. If you are using your (custom CFG) created by the DataLoader, delete the CFG file in the same folder as the .CSV and then try to download / lolad the CFG from here https://github.com/openlab/OpenDataInstaller/blob/master/blob%20files/BurlingtonParks.cfg

LMK if this makes sense.