icann / czds-api-client-python

A Python reference implementation for CZDS download zone file API
Other
102 stars 39 forks source link

error on .COM zone #9

Open iptwins opened 4 years ago

iptwins commented 4 years ago

Hello, since the addition of the zonefile .COM which is huge, the python script download.py continue to work well, but except for this zone. when it arrives on this one, I have this message:

2020-07-28 11:12:32.401829: Downloading zone file from https://czds-api.icann.org/czds/downloads/com.zone ./script-czds.sh: line 3: 1095 Killed python3 download.py

did you have an update or info to help me to fix this problem ? thank you for your help.

cocaman commented 3 years ago

Same issue here, I get the following error message:

  File "/usr/lib/python3/dist-packages/requests/models.py", line 823, in content
    self._content = bytes().join(self.iter_content(CONTENT_CHUNK_SIZE)) or bytes()
MemoryError

This indicates not enough memory for storing the large com zonefile.

pspacek commented 3 years ago

The download seems to work with the latest version, using python-requests 2.26.0-1.

erkansen commented 3 years ago

Is there any progress on this issue. I have the same exact problem.

erkansen commented 3 years ago

After update python-requests 2.26.0-1 I am getting 104 request reset by peer error for some TLDs. There should be a problem on it.