abidinamdar / gmapcatcher

Automatically exported from code.google.com/p/gmapcatcher
1 stars 0 forks source link

I-nodes!! #188

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
Just a word of warning to those who download a fair amount of googlemap tiles. 
;) 

My Harddrive stopped writing files (160GB woohoo go me;) due to the i-node 
limit being reached (9 million i-nodes). 

Still technically had loads of 'space' can't give you an exact amount because 
there were lots of other files still on there, but off top of me head maybe 
30-40Gb at the very least was 'still available', but no darn i-nodes left, so 
couldn't put any more files on there. 

Using linux based o/s to check i-node limit..open terminal

'df-i' - will list number of inodes remaining/used e.t.c
'df-h' - will list available space remaining on hard-drive.

Prior to re-formatting the percentages were disproportionate i.e something like 
this (not exact figures) Iuse% = 99 (df-i) Use = %40 (df-h)

Solution was to back up harddrive to external hard-drive.
Reformat/Repartition (i was using more swap than i needed to anyways, so 
reduced that at the same time hey 2 birds, 1 stone scenario =P, no harm done)

I then reformatted with sudo mkfs.ext4 -I 128 -N 35000000 /dev/sda1, 

Which in my limited understanding reduced the inode size from 256 bytes down to 
128 bytes, it then created 35000000 i-nodes as opposed to the flimsy 9 mil 
(ish) i had to start. 

At time of writing (now haha) i am at Inode-use = 47%, Hard-drive use = 48%, 
which seems all-together better. 

From reading a few different articles, and sorta agreeing because it makes 
sense, don't increase the 'inodes per group' number, to a number higher than 
the 'blocks per group'. As it would prove pointless in that you will have more 
i-nodes than you can actually use. Perhaps i'm wrong but thats my understanding 
anyways. 

You can find out more info on your i-node situation by running in terminal 
(assuming linux again).

'sudo tune2fs -l /dev/yourharddrive i.e sda1 or sdb1 whatever.'

I hope this helps anyone out there who might be puzzled about why they are 
getting error messages from google when trying to download tiles ;)

-J3D1 =P

Original issue reported on code.google.com by ObiDanKi...@googlemail.com on 29 Jul 2010 at 5:10

GoogleCodeExporter commented 8 years ago
Just as a heads up formatting a 1TB external hard drive to its maximum i-node 
potential (ext4) should result in approx 1/4 billion potential i-nodes. 
A 160GB drive holds about 35 mil or so. So calculate your i-nodes to suit your 
needs. Before reformatting and upping the i-node limit, a WD 1TB drive has 
approx 90 mil i-nodes. To put this into perspective 160GB will get you every 
map level in its entirety down to level 5, and a fair number of level 4,3, and 
2 in a more specific locale. It will also get you terrain down to level 7 in 
its entirety, but after level 6 (level 5 and down im guessing) there are the 
same quotas put in place as satellite tiles to prevent mass-downloading.

Hope this helps 

- Dan

Original comment by ObiDanKi...@googlemail.com on 9 Oct 2010 at 11:06

GoogleCodeExporter commented 8 years ago

Original comment by heldersepu on 13 Oct 2011 at 8:32