search

sverhoeven / docker-cartodb

Dockerized CartoDB
BSD 3-Clause "New" or "Revised" License
147 stars 117 forks source link

unable to upload database #8

Closed sandeepgadhwal closed 7 years ago

sandeepgadhwal commented 7 years ago

i am unable to upload any dataset error which i am getting is that it shows pending upload for sometime and after that this code 8063ae73-3bb8-4cf5-9b7f-99338ba6c871

anyway it worked it worked for the first time but now its always getting stuck what can be the reason.

dherrebout commented 7 years ago

Unfortunately I am experiencing this issue as well, the first upload after installing seems to work but after that datasets won't load anymore.

sverhoeven commented 7 years ago

I just uploaded a new version to Docker Hub. Could you try again?

dherrebout commented 7 years ago

I am still getting the same errors but now at least the server does not crash anymore, which means I could trace some error logs.

When I try to upload data, the resque.log displays this error:

2017-07-02 14:21:43 UTC: new_importer() 2017-07-02 14:21:43 UTC: Fetching datasource public_url metadata for item id public/uploads/a3c7d8f9453d7e83589d/Postcodes_NL.kml 2017-07-02 14:21:43 UTC: File will be downloaded from public/uploads/a3c7d8f9453d7e83589d/Postcodes_NL.kml 2017-07-02 14:21:43 UTC: Exception: Cannot allocate memory - which ifconfig 2>/dev/null

and

** [14:21:44 2017-07-02] 10262: (Job{imports} | Resque::ImporterJobs | [{"job_id"=>"f5a5b7c8-85e3-44b7-94e7-726cb05eaeef"}]) failed: #<Errno::ENOMEM: Cannot allocate memory - which ifconfig 2>/dev/null>

The amount of available working memory is 1GB, do you think that could be the issue?

/edit: scaled server up to 2GB memory, issue resolved. Apparently 1GB is not enough. I advise sandeep to upscale server as well, I expect that will resolve the issue for him as well. If so, this issue can be closed.

sandeepgadhwal commented 7 years ago

out of topic question : Can we use this image in production ? if not can you suggest any changes that can help me make this image production ready.

dherrebout commented 7 years ago

Yes you can, by following the exact instructions in the readme. Did scaling up the server resolve the data upload for you as well? If it did, this issue can be closed.

sverhoeven commented 7 years ago

You can, make sure to change the password of the dev and admin4example accounts.

Also the internals are configured for the least amount of setup hassle, for example the Postgresql database requires no password to login and the services are running in development mode to allow for unencrypted connections. See https://github.com/NLeSC/eEcology-CartoDB/blob/master/setup.md where I do some fortifying.

sandeepgadhwal commented 7 years ago

I recieved error while uploading database but the database was uploaded successfully. i dont know why error is still there. anyway its working so you can close the issue.