OverflowError: enumerate() is limited to LONG_MAX items

[GoogleCodeExporter]

What steps will reproduce the problem?
$ ./crunch 10 10 0123456789| pyrit -i- import_unique_passwords

What is the expected output? What do you see instead?
Connecting to storage at 'file://'...  connected.

2147400000 lines read (167543.5 lines/s)... Traceback (most recent call last):
  File "/usr/bin/pyrit", line 6, in <module>
    pyrit_cli.Pyrit_CLI().initFromArgv()
  File "/usr/lib/python2.5/site-packages/pyrit_cli.py", line 105, in
initFromArg
v
    func(self, **options)
  File "/usr/lib/python2.5/site-packages/pyrit_cli.py", line 285, in
import_unique_passwords
    self.import_passwords(storage, infile, unique_check=False)
  File "/usr/lib/python2.5/site-packages/pyrit_cli.py", line 273, in
import_passwords
    for i, line in enumerate(reader):
OverflowError: enumerate() is limited to LONG_MAX items

What version of the product are you using? On what operating system?
r215...cygwin =D

Original issue reported on code.google.com by adam.k...@gmail.com on 19 Feb 2010 at 11:43

[GoogleCodeExporter]

Your crunch command will generate 10 billion passwords taking up about 110 Gig 
of
space if it were captured into file(s).

Only a suggestion, try breaking it into smaller chunks for importing:

crunch 10 10 0123456789 -t 0@@@@@@@@@ | pyrit -i- import_unique_passwords
crunch 10 10 0123456789 -t 1@@@@@@@@@ | pyrit -i- import_unique_passwords
...
crunch 10 10 0123456789 -t 9@@@@@@@@@ | pyrit -i- import_unique_passwords

--> So do you have the disk drive space to handle all this?

Original comment by cpmitc...@gmail.com on 20 Feb 2010 at 3:57

[GoogleCodeExporter]

thanks for reporting. This is a problem in the interpreter itself; it has been 
fixed
in python 2.6

Please split the lists as cpmitch23 described or update your python 
installation :-)

btw: the database won't take 110gb as pyrit uses compression. i'll give it 60gb

Original comment by lukas.l...@gmail.com on 20 Feb 2010 at 9:03

• Changed state: WontFix

[GoogleCodeExporter]

Of course I have enough space Mitch =P I have 4TB of hdds =D. I'll try 
splitting them
for now because I'm too lazy to bother to mess with updating on cygwin, too 
lazy in
fact to reboot into Ubuntu. Unless there are any other benefits to 2.6? Such as 
speed? 

Original comment by adam.k...@gmail.com on 20 Feb 2010 at 9:34

[GoogleCodeExporter]

not really

Original comment by lukas.l...@gmail.com on 20 Feb 2010 at 9:37

[GoogleCodeExporter]

Just going to add the second lot from the 'split password list' and getting 
some errors.
$ ~/crunch/crunch 10 10 0123456789 -t 1@@@@@@@@@ | pyrit -i- 
import_unique_passwords
Pyrit 0.2.5-dev (svn r216) (C) 2008-2010 Lukas Lueg http://pyrit.googlecode.com
This code is distributed under the GNU General Public License v3+

Connecting to storage at 'file://'...  connected.
Traceback (most recent call last):
  File "/usr/bin/pyrit", line 6, in <module>
    pyrit_cli.Pyrit_CLI().initFromArgv()
  File "/usr/lib/python2.5/site-packages/pyrit_cli.py", line 106, in initFromArg
v
    func(self, **options)
  File "/usr/lib/python2.5/site-packages/pyrit_cli.py", line 286, in
import_unique_passwords
    self.import_passwords(storage, infile, unique_check=False)
  File "/usr/lib/python2.5/site-packages/pyrit_cli.py", line 279, in import_passwords
    (i, perfcounter.avg), end=None, flush=True)
  File "/usr/lib/python2.5/site-packages/cpyrit/util.py", line 466, in getAvg
    return sum(x[1] for x in self.datapoints) / t
ZeroDivisionError: float division

Original comment by adam.k...@gmail.com on 20 Feb 2010 at 12:36

[GoogleCodeExporter]

Ok after trying it for maybe the 50th time it just started to work.

Original comment by adam.k...@gmail.com on 20 Feb 2010 at 12:38

[GoogleCodeExporter]

the error you pasted last in one of its own and fill be fixed in next svn. 
thanks for
reporting

Original comment by lukas.l...@gmail.com on 20 Feb 2010 at 12:49