HazyResearch / fonduer

A knowledge base construction engine for richly formatted data
https://fonduer.readthedocs.io/
MIT License
409 stars 77 forks source link

Its dead slow with Win10 + PY 3.6 #533

Closed nageshsvs closed 3 years ago

nageshsvs commented 3 years ago

[2021-02-08 15:37:45,034][INFO] fonduer.meta:49 - Setting logging directory to: logs\2021-02-08_15-37-45 [2021-02-08 15:37:45,112][INFO] fonduer.meta:135 - Connecting user:None to localhost:None/pob_presidents [2021-02-08 15:37:47,216][INFO] fonduer.meta:162 - Initializing the storage schema [2021-02-08 15:37:48,354][INFO] fonduer.utils.udf:67 - Running UDF...

lukehsiao commented 3 years ago

Naturally, the performance of your KBC pipeline will depend on the hardware you're running it on, as well as the size and complexity of your KBC pipeline.

This issue unfortunately doesn't provide any actionable information.

However, in general, performance improvements always valuable and welcome. If you would like to do some profiling for more useful information, or even contribute to Fonduer by opening a PR, we'd welcome it.

I will close this issue for now as just a general request for performance improvements. If you have more specific details or a contribution to make, feel free to follow up here or open a PR.