vaginessa / gmapcatcher

Automatically exported from code.google.com/p/gmapcatcher
0 stars 0 forks source link

Create one db file per map service. #207

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
 1. switch to sqlite
 2. try different map services
3.

What is the expected output? What do you see instead?
There is only one db file. There is no map service column in the db.
So I think this is just a drawback at the moment.

What version of the product are you using? On what operating system?
0.7.5.0 on win xp.

Please provide any additional information below.

Original issue reported on code.google.com by peschul...@web.de on 24 Aug 2010 at 10:19

GoogleCodeExporter commented 9 years ago
I forgot one thing: please do not add one table per map service type, as the db 
file would grow too much. I was using the file based store, but got too many 
files on that partition - so I was hoping for a reasonable performance using 
the sqlite approach.

Original comment by peschul...@web.de on 24 Aug 2010 at 11:15

GoogleCodeExporter commented 9 years ago
Hi there,

as the status of this issue is still "new", and no one replied here, I think I 
was not clear or friendly enough. My "drawback at the moment" statement refers 
to putting every map service into one db table, resulting in a mixed display of 
different map providers tiles in one map on the screen. This is certainly not 
what we want.
My second statement tried to express my fear of a sqlite db to grow too much, 
so I would prefer to have one db file per map service. I hope this would be an 
easy thing to do, and should maybe addressed when looking at the mixed maps in 
one table issue.

regards,
fred

Original comment by peschul...@web.de on 30 Aug 2010 at 7:21

GoogleCodeExporter commented 9 years ago
Sorry that no one responded, I personally do not use sqlite... 

Original comment by heldersepu on 30 Aug 2010 at 9:04

GoogleCodeExporter commented 9 years ago
Thanks for answering, yes I think most people are using the file based setting. 
My reason for switching to sqlite is that windows heavily scattered and 
fragmented the zillions of cached files and even directories. Defragmenting 
with piriforms defraggler stopped to work at some point, as the program crashed 
right after analyzing the cache directory. Another reason is that there are 
thousands of same files (binary compared) with a size of 159 bytes, occupying a 
4k sector size on the disk. While this is no problem with todays disk size, I 
was hoping for a more efficient way of storing the data.
Well, maybe this is the prize for caching data :)

regards,
fred

Original comment by peschul...@web.de on 1 Sep 2010 at 1:10

GoogleCodeExporter commented 9 years ago
Hi.
I added sqlite repository to gmapcatcher. Reason was manageability of cache 
directory with plenty of cached files. Working with such structure when it 
grows above certain size is not pleasant.

While implementing I expected certain behavior and tested it with scenarios I 
was using. Later I found out the things behave quite differently and outcome is 
mixed tiles in sqlite DB from some map sources with specific pattern.

Separating each map source to seperate sqlite DB should not be difficult to do. 
Unfortunately I am unable to comment when im able to implement the change. 
Unfortunately I am out of time for some time now.

Original comment by standa31...@gmail.com on 1 Sep 2010 at 8:22

GoogleCodeExporter commented 9 years ago
Hi there,

no problem about you being short of time, I know you are doing this in your 
spare time and just for fun. I just liked to address the issue and will be 
happy whenever it is done.

regards,
fred

Original comment by peschul...@web.de on 3 Sep 2010 at 4:31

GoogleCodeExporter commented 9 years ago
Well - I forgot discussion with Helder. :)
I just tested behavior using repository type "file" with the same behavior. If 
user changes map source from for example Google to OpenStreetMaps tiles are 
mixed. It is not DB repository specific.

Some time ago there was discussion about the topic.
http://code.google.com/p/gmapcatcher/issues/detail?id=138&can=1&sort=type%20owne
r&start=200

Original comment by standa31...@gmail.com on 17 Sep 2010 at 2:42

GoogleCodeExporter commented 9 years ago
Oh I see, this did not happen to me. Maybe the reason is that I started with 
files first, downloading the region of interest, and switched map provider 
rather late. On the other hand trying the sqlite approach, I played around with 
map providers early. While reading all of issue 138, I am not sure if I 
understood it completely. Mixing of tiles seems not a good idea to me. The 
check box "Use different directory per map service" was checked very early 
here, I do not know if this is the default or if I did that intentionally to 
keep a bit of overview of what happens on the partition. Maybe if sqlite is 
used, this check box should lead to one db file per map service in the distinct 
data directories?

Original comment by peschul...@web.de on 22 Sep 2010 at 6:19

GoogleCodeExporter commented 9 years ago
I added this, now when users selects onedirpermap, it will create files like:
OpenStreetMap.db
Yandex.db
Yahoo.db

For more details see: R1392

Original comment by heldersepu on 30 Sep 2012 at 7:59

GoogleCodeExporter commented 9 years ago

Original comment by kipenros...@gmail.com on 8 Oct 2012 at 2:54

GoogleCodeExporter commented 9 years ago
Released in 0.8

Original comment by heldersepu on 16 Oct 2012 at 6:06