Method to delete duplicates station from dballe

[bchiavarini]

Hi, we are having a problem with our local DBalle because we have some stations that have been duplicated by mistake and that are now rising selection station ID query returned 2 results error when data are imported using Python API

with db.transaction() as tr:
    tr.import_messages(msg, overwrite=True, update_station=True, import_attributes=True)

Is there a command to easily purge the database from these duplicated stations?

Thanks for your help

[edigiacomo]

Hi @bchiavarini, would it be possible to remotely connect to your database?

[bchiavarini]

i have already fixed the error deleting by hand the doubled stations from the db. But i am still interested, if it already exists, in finding a better method to fix such kind of error in case they happen again or in case they happen at a scale that is not manageable with the direct intervention on the single database rows.

[spanezz]

There is no such a method in dballe at the moment, mainly because there's never been a need for it. dballe should never duplicate stations, and to the best of my knowledge we haven't seen it happen in our production databases.

If it happens, I think the best thing would be to figure out how it happens, and for that I'd need access to a database where it happens, and information about what operations led it to be that way.

Rather than put effort in coding for a "feature" needed to recover after a recurring issue, I would put effort in understanding how the issue happens and on making it not happen

[brancomat]

@bchiavarini : some additional (and, hopefully, useful) informations:

• in all DB-All.e production uses at SIMC we interact with the underlying db only with DB-All.e tools and API, we strongly discourage direct access to the db except for diagnistic needs
• if there are needs/use cases not covered by DB-All.e tools and API please open an issue, we're interested to learn about that
• the only maintenance tool present in DB-All.e tools is dbadb cleanup that deletes stations that have no values associated (but I'm not sure that this would have been useful since the problem seems to be related to id duplication)
• if the issue occurred using only DB-All.e tools and API accessing the db, we're definitively interested in understading the issue. Should it reoccur, even if it's not possible to have access to your database, having a dump of the stations table would be useful.

I'm closing the issue, feel free to reopen it if you have more information about it (or more questions)

Thanks!