pygobject / pgi-docgen

API Documentation Generator for PyGObject
https://lazka.github.io/pgi-docs/
GNU Lesser General Public License v2.1
129 stars 36 forks source link

Possibility to append previous intermediate docs? #40

Closed tumagonx closed 10 years ago

tumagonx commented 10 years ago

In my python 32-bit I hit MemoryError when queuing 100+ girs. Unfortunately python for windows hit the limit earlier (about 1.1 GB) as reported here http://stackoverflow.com/questions/19156377/memory-for-python-exe-on-windows-7-python-32-numpy-uses-half-of-the-available.

Is it possible to split the workload? otherwise I will complete it on Win7 64 :)

tumagonx commented 10 years ago

Oops I forgot that pgi-docgen also need to import gi which i haven't ported to 64bit yet. So I'm stuck at the moment.

lazka commented 10 years ago

It shouldn't need gi, only pgi.

lazka commented 10 years ago

I'll try to work on reducing memory usage.

tumagonx commented 10 years ago

yes but pgi seems try to load gi:

<^> python2764 setup.py install Traceback (most recent call last): File "setup.py", line 18, in import pgi File "d:\Sources\pgi\pgiinit.py", line 10, in from .importer import require_version, get_required_version File "d:\Sources\pgi\pgi\importer.py", line 13, in from .clib.gir import GIRepositoryPtr File "d:\Sources\pgi\pgi\clib\girinit.py", line 9, in from .gibaseinfo import * File "d:\Sources\pgi\pgi\clib\gir\gibaseinfo.py", line 12, in from .gitypelib import GITypelibPtr File "d:\Sources\pgi\pgi\clib\gir\gitypelib.py", line 14, in _gir = find_library("girepository-1.0") File "d:\Sources\pgi\pgi\clib\ctypesutil.py", line 51, in find_library _internal[name] = cdll.LoadLibrary(_so_mapping[name]) File "c:\python27-64\lib\ctypesinit.py", line 443, in LoadLibrary return self._dlltype(name) File "c:\python27-64\lib\ctypesinit.py", line 365, in init self._handle = _dlopen(self._name, mode) WindowsError: [Error 126] The specified module could not be found

and if I put 32bit gi in 64bit python:

<^> python2764 setup.py install Traceback (most recent call last): File "setup.py", line 18, in import pgi File "d:\Sources\pgi\pgiinit.py", line 10, in from .importer import require_version, get_required_version File "d:\Sources\pgi\pgi\importer.py", line 13, in from .clib.gir import GIRepositoryPtr File "d:\Sources\pgi\pgi\clib\girinit.py", line 9, in from .gibaseinfo import * File "d:\Sources\pgi\pgi\clib\gir\gibaseinfo.py", line 12, in from .gitypelib import GITypelibPtr File "d:\Sources\pgi\pgi\clib\gir\gitypelib.py", line 14, in _gir = find_library("girepository-1.0") File "d:\Sources\pgi\pgi\clib\ctypesutil.py", line 51, in find_library _internal[name] = cdll.LoadLibrary(_so_mapping[name]) File "c:\python27-64\lib\ctypesinit.py", line 443, in LoadLibrary return self._dlltype(name) File "c:\python27-64\lib\ctypesinit.py", line 365, in init self._handle = _dlopen(self._name, mode) WindowsError: [Error 193] %1 is not a valid Win32 application

lazka commented 10 years ago

It should be < 1 GB now

tumagonx commented 10 years ago

Great job! All docs (except Goffice) completed now. The peak is no more than 0.5 GB in my case.