search

guaka / mediawikixml2meteor2phonegap

Turn MediaWiki XML dumps into a Phonegap app, through Meteor
http://wiki.yt/
Other
9 stars 1 forks source link

hitchwiki dump as json is 13M - can we get this down to 5M? #16

Open guaka opened 11 years ago

guaka commented 11 years ago

(so it fits in appcache)

ditching namespaces?

other format? http://msgpack.org/ http://bsonspec.org/

guaka commented 11 years ago

1 failed attempt at only keeping ns0: json from xml2json is pure text, can't easily be filtered

guaka commented 11 years ago

with only Main, Template and Category dump.js down to 8.4M, saves about 33%

PhilGruber commented 11 years ago

Can we maybe compress it? Should be very efficient