ministryofjustice / analytics-platform

Parent repository for the MOJ Analytics Platform
MIT License
14 stars 1 forks source link

DOM1's connection is flakey #75

Closed davidread closed 6 years ago

davidread commented 6 years ago

JB:

is there any reason I should be having trouble uploading a csv to the platform? It is about 18.5 MB and seems to consistently be getting to about 35% then failing. I am currently WFH but my internet connection is 1 Gbps so it shouldn't be struggling with a small file

Workarounds

From @RobinL :

this does sometimes seem to happen. as you say, not likely to be your home connection. it’s the traffic ‘shaping’/‘routing’ that atos do on DOM1. The only solution we’ve ever found is to try different combinations of purple cable/wifi

We’ve managed uploads of up to about 5Gb this way, but we’ve never fully managed to get rid of reliability problems on DOM1

The main options we have at the moment to make things a bit better are: (1) Splitting uploads into smaller chunks. (2) Compressing data before uploading and then uncompressing on the platform

davidread commented 6 years ago

It's an issue with DOM1, not AP, so closing. Not sure there is anything we can do about it. Good to have a record of this though.