MongoDB has a hard limit of 16MB on bson files.
Already (with spreadsheets) we've encountered files bigger than that.
And we're bound to have files many times larger in the future (GTFS, parquet etc., maybe even videos)
Mongo does have functionality to store arbitrarily large files, so we will probably have to modify all the components accessing mongodb to support this (writer route, notifier, transformer)
MongoDB has a hard limit of 16MB on bson files. Already (with spreadsheets) we've encountered files bigger than that. And we're bound to have files many times larger in the future (GTFS, parquet etc., maybe even videos)
Mongo does have functionality to store arbitrarily large files, so we will probably have to modify all the components accessing mongodb to support this (writer route, notifier, transformer)