matrix-org / synapse

Synapse: Matrix homeserver written in Python/Twisted.
https://matrix-org.github.io/synapse
Apache License 2.0
11.81k stars 2.13k forks source link

Migration concept / data import from other chats (HipChat, Mattermost, ...) #4590

Open nesretep-anp1 opened 5 years ago

nesretep-anp1 commented 5 years ago

Description:

I had intense tests with Synapse/Riot the last days where I got all (wanted) things the way I/we would want them! Nice work so far. (Ok, having the status.im theme on iPhone would be great, because the currently built theme are awfull, but that's a different story).

We want to leave Mattermost in favour of Matrix/Synapse. So, we now would have to migrate our Mattermost data (in)to Synapse (more than 250000 messages). But I did not find any migration concept or tool to do that?!

What is the recommended/available/... way to do that?

t3chguy commented 5 years ago

It is definitely possible, you could use APIs like https://matrix.org/docs/spec/application_service/r0.1.0.html#timestamp-massaging to even maintain the exact timestamps.

nesretep-anp1 commented 5 years ago

Nice! ;-)

But I do not want to develop a migration/import tool! ;-) The question is: is there an appropriate tool?

Am 08.02.2019 um 15:55 schrieb Michael Telatynski notifications@github.com:

It is definitely possible, you could use APIs like https://matrix.org/docs/spec/application_service/r0.1.0.html#timestamp-massaging to even maintain the exact timestamps.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.

Half-Shot commented 5 years ago

@nesretep-anp1 Modular.im has a hipchat migration tool built but there isn't a mattermost one yet.

neilisfragile commented 5 years ago

@nesretep-anp1 I don't think we we can invest in a mattermost migrator immediately (though obviously it is something we would like to have) If you are considering modular.im that would definitely help us bump it up the to do list.

nesretep-anp1 commented 5 years ago

@nesretep-anp1 I don't think we we can invest in a mattermost migrator immediately (though obviously it is something we would like to have) If you are considering modular.im that would definitely help us bump it up the to do list.

Well, to be honest; wie DO use Mattermost (und DO evaluate Synapse) due to having the appropriate communications platform within OUR OWN data center. So using modular.im is not an option in any case. (I think this will be the rule for nearly all leaving HipChat customers as well).

But, if there is a bounty based way to get an functional migration tool for Mattermost, that we would be ready to discuss!? ;)

nesretep-anp1 commented 5 years ago

But, if there is a bounty based way to get an functional migration tool for Mattermost, that we would be ready to discuss!? ;)

No one?

hamoid commented 5 years ago

I'm in the same situation. Our community will be stuck with Mattermost until there's a way to migrate to Matrix.

I see there's an export tool for Mattermost: https://docs.mattermost.com/administration/bulk-export.html But exporting file attachments is apparently not supported yet. This seems to be the command:

 ./mattermost export bulk /home/user/bulk_data.json --all-teams
richvdh commented 4 years ago

related: #3716

gabrc52 commented 1 year ago

As for Mattermost, I am working on a set of scripts to help with migrating to Matrix.

https://github.com/gabrc52/mattermost-to-matrix-migration

For now I have download_everything.sh which will download all public messages in a Mattermost team, including media. I still need to write the other half.