SIDN / CycleHunter

Python software that reads zone files, extract NS records, and detect cyclic dependencies
https://tsuname.io
BSD 2-Clause "Simplified" License
37 stars 14 forks source link

aborting during step 4 #32

Open dk379 opened 2 years ago

dk379 commented 2 years ago

I just run CycleHunter (on FreeBSD) against com.ua zone file and got this:

$ python CycleHunter.py --zonefile com.ua/zone --origin com.ua. --save-file com.ua/hunt --base-dir com.ua --workers 8 [...] at else not foundZone result: False at else not foundZone result: False at else not foundZone result: False reading line 1400000 of zone file reading line 1500000 of zone file troubleddomains: {} step 8b: writing it to json set() {} ERROR: could not match domain names to NS records; please check zoneMatcher.py $ $ pip list | egrep 'async|dns|multip|tqdm' async-lru 1.0.3 dnspython 2.2.1 multiprocess 0.70.12.2 tqdm 4.64.0 $

the zone file length is just over 1.5M lines: $ wc -l com.ua/zone 1590970 com.ua/zone $ ls -l com.ua/ total 59800 -rw-r--r-- 1 dk staff 307261 May 11 15:25 com.ua.2022-05-11.step1.txt -rw-r--r-- 1 dk staff 474714 May 11 15:37 com.ua.2022-05-11.step2.txt -rw-r--r-- 1 dk staff 373 May 11 15:37 com.ua.2022-05-11.step3.json -rw-r--r-- 1 dk staff 42 May 11 15:37 com.ua.2022-05-11.step4.json -rw-r--r-- 1 dk staff 60347063 May 11 15:23 zone $

dk379 commented 2 years ago

Trying on a smaller zone, still aborts, but with different error:

note -- perhaps the --origin should be using kiev.ua or is .kiev.ua needed? I found it strange...

100%|����������| 4766/4766 [00:49<00:00, 96.32it/s] Step 1: read timed out zones Step 2: create Authority objects Step 3: get only zones without in-bailiwick/in-zone authoritative servers Step 4: sort which ones are cyclic analyzing .domain1. Domain 1 from 31 [...] analyzing .domain2. Domain 31 from 31 step 7: writing down results step 8: read cyclic domains kiev.ua/kiev.ua.2022-05-12.step4.json does not exist; exiting [dk@delta2 ~/github/CycleHunter]$ ls kiev.ua kiev.ua.2022-05-12.step1.txt kiev.ua.2022-05-12.step2.txt kiev.ua.2022-05-12.step3.json zone [dk@delta2 ~/github/CycleHunter]$

so again, failure on step 4 (or step 8?)