windrobin / gmapcatcher

Automatically exported from code.google.com/p/gmapcatcher
0 stars 0 forks source link

Consolidate the downloaded tiles in bigger files #363

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
What new or enhanced feature are you proposing?
Adjacent downloaded tiles could be consolidated in a larger file.

What goal would this enhancement help you achieve?
Presently there are many downloaded tiles of small size.
This presents two problems:
- Backing up the tiles to a backup disk takes a significant amount of time, 
even turning off antimalware software.
- The downloaded files can take a huge amount of disk space in large cluster 
partitions as each file blocks a cluster.

Although this situation can be mitigated by:

  A) Having the downloaded tiles in a separate partition that has the minimum achievable cluster size (this practically solves the disk space waste issue)
  B) Doing a partition clone to backup the tiles (improves a lot the backup time, but this is still very long)

this situation is far from ideal.

Remark:
The Android application "MyTrails" apparently achieves this consolidation: for 
the same downloaded map, the number of files is significantly lower, and the 
size of the files larger and variable.
The folder structure is also simpler.

Example:

GMapCatcher:
Folder structure depth = 6
Virtual Earth\sat_tiles\1\32\186\22
Typical file size less than 20 Kbytes
For 100 Mbytes of data, 6307 files in 163 folders

MyTrails:
Folder structure depth = 2
Offline_Microsoft_Satellite\MyTrails_18
File size variable 50 to 1600 KBytes
For 100 Mbytes of data, 94 files (67 times less files than GMapCatcher) in 6 
folders (27 times less folders than GMapCatcher)

I realize that this modification is not a simple task !

Thanks and best regards

Original issue reported on code.google.com by alfonic...@gmail.com on 6 Jan 2013 at 4:53

GoogleCodeExporter commented 8 years ago
Not sure what this will accomplish...
We already have multiple files structures one of them is SQLite3, all the map 
tiles are saved to a database only one file.

Original comment by heldersepu on 6 Jan 2013 at 10:03

GoogleCodeExporter commented 8 years ago
Hello

Is the SQLite3 structure already implemented in version 8.0.1 ?
If yes, how to consolidate the tiles to a single database file ?
I was unable to find the information in the user guide.

Thanks and best regards

Original comment by alfonic...@gmail.com on 8 Jan 2013 at 9:52

GoogleCodeExporter commented 8 years ago
Yes it is, SQLite3 been there for a while.
With the latest version click on: "Tools Button" > Operations > Export Map
The rest of the steps should be self explanatory... 

Original comment by heldersepu on 8 Jan 2013 at 10:01

GoogleCodeExporter commented 8 years ago

Original comment by heldersepu on 22 Jul 2013 at 1:42

GoogleCodeExporter commented 8 years ago
Somehow this doesn't work properly. I don't get a file output if I export to 
SQLite3, the directory I choose in the dialog stays empty, no SQLite file 
database is created although the program shows that it is processing something. 
Does GMapCatcher require specific settings when exporting to SQLite3? I'm using 
version 0.8.0.5.

Original comment by struktur...@gmail.com on 19 Nov 2014 at 3:25

GoogleCodeExporter commented 8 years ago
I was able to reproduce the problem, will look into it later today

Original comment by heldersepu on 19 Nov 2014 at 5:28

GoogleCodeExporter commented 8 years ago
Strange running directly from sources works OK...

Original comment by heldersepu on 19 Nov 2014 at 10:39

GoogleCodeExporter commented 8 years ago
Here is the latest install: 
http://sepuweb.com/GMapCatcher/GMapCatcher-0.8.0.6.exe

Original comment by heldersepu on 19 Nov 2014 at 10:54

GoogleCodeExporter commented 8 years ago
Hello

GMapCatcher-0.8.0.6.exe: 
I had some sqlite RMaps maps built using Mobile Atlas Creator.
With the previous version of GMapcatcher I was able to view them, by selecting 
RMaps in the GMapcatcher settings and pointing to the folder containing the 
corresponding sqlite file.
This doesn't work anymore: the maps don't show.
Please let me know if you prefer that I make a new issue entry rather than 
continue on this issue.

Thanks and regards.

Original comment by alfonic...@gmail.com on 20 Nov 2014 at 7:39