search

openknowledge-archive / dpm-py

DEPRECATED Data package manager written in Python
http://frictionlessdata.io/tools/
MIT License
8 stars 6 forks source link

dpmpy is slow to start #23

Open Fak3 opened 7 years ago

Fak3 commented 7 years ago

When dpmpy is invoked from the command-line, there is a noticable delay before any actual code is executed. On an old laptop it is up to 3 seconds.

Upstream bugs: https://github.com/frictionlessdata/jsontableschema-py/issues/118 https://github.com/frictionlessdata/tabulator-py/issues/106 https://github.com/pypa/setuptools/issues/510

Fak3 commented 7 years ago

Tabulator import is now fixed, but not yet released on pypi. Jsontableschema issue on github is marked as duplicate of tabulator one, but it still causes a delay and should probably be reopened and addresed. (see https://github.com/frictionlessdata/jsontableschema-py/issues/118#issuecomment-257341487) Another source of dealy is the notorious setuptools entry_points handling for cmdline scripts. The wirkaround for it is in the PR #24

roll commented 7 years ago

@Fak3 tabulator is on PyPi but jts needs a fix still

rufuspollock commented 7 years ago

@Fak3 any updates here?

Fak3 commented 7 years ago

@rufuspollock https://github.com/frictionlessdata/jsontableschema-py/issues/118 is still open. The other possible source of delay is requests library, that dpmpy uses. It is known to internally import pkg_resources from setupltools. I still have to check that.