search

linkedpipes / discovery-legacy

The LinkedPipes Discovery implementation here is deprecated and replaced by a new one.
1 stars 3 forks source link

It takes 30 minutes to get the results of a discovery with 999 pipelines #17

Closed jakubklimek closed 6 years ago

jakubklimek commented 6 years ago

The discovery runs for 1 minute. But to get the 50 kb zip file with the results, I have to wait for 30 minutes.

https://discovery.linkedpipes.com/resource/experiment/all-and-generated/config

jirihelmich commented 6 years ago

It's the performance of 2.csv, 3.csv and 4.csv. Looking into it.

jirihelmich commented 6 years ago

Now takes around 9 seconds on my notebook. I just hope it produces the same data, could you compare? Shouldn't have lost anything.