Klimatbyran / garbo

1 stars 5 forks source link

Ensure wikidata is returned as is, and NOT interpreted or reformatted #169

Open Greenheart opened 2 weeks ago

Greenheart commented 2 weeks ago

For example for SSAB (https://www.wikidata.org/wiki/Q54075), the wikidata entry has references to the report https://mb.cision.com/Public/980/3947344/99d2b4a9f24f12eb.pdf

However, in the API response (screenshot below), we instead get the wikidata URL as the reference (which is incorrect - it should be the URL to the original report). We also get null for scope 3 for some reason, but the response for this wikidata entry includes scope3 emissions. This is very strange. Is Garbo reformatting and changing what is returned with the wikidata property? In that case the wikidata property is not as reliable as I had hoped it was.

image

Greenheart commented 16 hours ago

Another example is when the wikidata emissions often includes example values like 1234, which then shows up as verified data in the frontend. Either we stop trusting wikidata, and only use the manually validated facit that didn't pass through get the LLM.

Or we move the wikidata steps outside of the LLM and just provide the wikidataId all the way from the start, to always use the correct validated data when it's available. This would save so much confusion and frustration.