search

CntoDev / cnto-wp-website

A private repo to track progress on the new CNTO website draft
0 stars 0 forks source link

Archive of Enjin Forums #14

Open JamesTheClarke opened 3 years ago

JamesTheClarke commented 3 years ago

The enjin forums cannot by default be exported to our new website. Enjin holds that data hostage to incentivize older communities to stay there.

But we will still rely on the content created between 2014 and 2020 as these records can be very valuable for future decision making. A time capsule for those forums has to be created which is only accessible to those who:

The drawback of that solution would be that any new Reservist+ joining through the website would have to create an enjin account to gain access to the old forums - this would need to be managed by Staff to assign tags etc. increasing manual workload. Or we could make the entire forums completely public but that would violate the assumption of members (including alumni) that anything they posted in Community, Branches or Administrative Forums would remain private.

Alternatively, we need to figure out a more advanced technique to export the enjin forum data and import it somehow to the new website.

enrico-ghidoni commented 3 years ago

Checked Enjin APIs and there is no way to export the forum using them either. Our last resort is to use a custom web scraper with highest authorization possible in the current forums and let it parse and download every single thread that has ever been created, including replies. In order to then publish the old archives to the new forum, it has to have published APIs which wpForo currently does not. So this is dependant on #11 :)

enrico-ghidoni commented 3 years ago

Okay APIs on the new forum software are not required since we have access to the database and we can automatically insert the archive obtained by the web scraper into it.

milivojm commented 3 years ago

Isn't data available as JSON through API?

enrico-ghidoni commented 3 years ago

You wish... Enjin has absolutely no means of exporting forum threads. I managed to find this tool as an already existent web scraper. It's also written in C# so if you want to take a look feel free to @milivojm

milivojm commented 3 years ago

Yeah, looking at code. Looks very outdated.

enrico-ghidoni commented 3 years ago

@milivojm it would be a oneshot, just for exporting the forums and if we're lucky enough that it works it saves us a lot of time in writing our own web scraper. I can go ahead and try it but I'd need the API secret key generated from Enjin admin panel (ref. https://www.enjin.com/api). @JamesTheClarke if you could manage to get me that sweet key I can try the tool.

Didr commented 1 year ago

https://www.enjin.com/forums/m/10826/viewthread/33743439-announcing-retirement-enjin-website-builder

This needs to be finished before 30th of April.