ExposuresProvider / cam-pipeline

Data loading pipeline for CAM database
https://exposuresprovider.github.io/cam-pipeline/
MIT License
2 stars 4 forks source link

De-duplicate model URLs in CAM-KP Frontend #141

Open gaurav opened 5 months ago

gaurav commented 5 months ago

CAM-KP Frontend currently duplicates model URLs (because of how they are stored in the backend). There should be some way to deduplicate them, but that will require some thinking.

gaurav commented 4 months ago

I've implemented some basic de-duplication logic in PR #138, but I haven't yet found an example that finds a duplication within the top hundred nodes, so I haven't been able to test this yet.