Upload fails, download and list work - Raspberry Pi 3B+

[kidtire]

I had a previous Raspberry Pi that was working fine with dropbox_uploader.sh until the WiFi adapter failed. So I installed a new Pi3 B+ and connected it to a Dropbox app that was being used on the old Pi.

Upload worked a few times then quit working. I can use the auth token on other machines. I can download and list files on this new machine.

I modified the curl command parameters in dropbox_uploader.sh to log as per previous issues and ran with -d and got this output (token masked in output):

dropbox_uploader.sh -d upload c100k cam2 1.0 Linux pi3b 4.14.62-v7+ #1134 SMP Tue Aug 14 17:10:10 BST 2018 armv7l GNU/Linux Raspbian GNU/Linux 9 \n \l

• RESPONSE_FILE=/tmp/du_resp_debug
• [[ '' == '' ]]
• BIN_DEPS='sed basename date grep stat dd mkdir curl'
• CURL_BIN=curl
• which sed basename date grep stat dd mkdir curl
• [[ 0 != 0 ]]
• which readlink
• [[ 0 == 0 ]] ++ readlink -m //test
• [[ /test == \/\t\e\s\t ]]
• HAVE_READLINK=1
• builtin printf ''
• [[ 0 == 0 ]]
• PRINTF='builtin printf'
• PRINTF_OPT='-v o'
• [[ -e /home/pi/.dropbox_uploader ]]
• source /home/pi/.dropbox_uploader
• [[ '' != '' ]]
• [[ '' != '' ]]
• [[ = '' ]]
• COMMAND=upload
• ARG1=c100k
• ARG2=cam2
• let argnum=4-2
• case $COMMAND in
• [[ 2 -lt 2 ]]
• FILE_DST=cam2
• (( i=OPTIND+1 ))
• (( i<4 ))
• FILE_SRC=c100k
• db_upload c100k /cam2 ++ normalize_path c100k +++ builtin printf c100k ++ path=c100k ++ [[ 1 == 1 ]] +++ readlink -m c100k ++ new_path=/home/pi/dropbox/c100k ++ [[ k == \/ ]] ++ echo /home/pi/dropbox/c100k
• local SRC=/home/pi/dropbox/c100k ++ normalize_path /cam2 +++ builtin printf /cam2 ++ path=/cam2 ++ [[ 1 == 1 ]] +++ readlink -m /cam2 ++ new_path=/cam2 ++ [[ 2 == \/ ]] ++ echo /cam2
• local DST=/cam2
• [[ ! -e /home/pi/dropbox/c100k ]]
• [[ ! -r /home/pi/dropbox/c100k ]] ++ db_stat /cam2 +++ normalize_path /cam2 ++++ builtin printf /cam2 +++ path=/cam2 +++ [[ 1 == 1 ]] ++++ readlink -m /cam2 +++ new_path=/cam2 +++ [[ 2 == \/ ]] +++ echo /cam2 ++ local FILE=/cam2 ++ [[ /cam2 == \/ ]] ++ curl -X POST -L -s --show-error --globoff -i -o /tmp/du_resp_debug --header 'Authorization: Bearer ' --header 'Content-Type: application/json' --data '{"path": "/cam2"}' https://api.dropboxapi.com/2/files/get_metadata ++ check_http_response ++ CODE=0 ++ case $CODE in ++ grep -q 'HTTP/1.1 400' /tmp/du_resp_debug +++ sed -n 's/{".tag": "([^"])".*/\1/p' /tmp/du_resp_debug ++ local TYPE=folder ++ case $TYPE in ++ echo DIR
• TYPE=DIR
• [[ DIR == \F\I\L\E ]]
• [[ DIR == \E\R\R ]]
• [[ DIR == \E\R\R ]]
• [[ DIR == \D\I\R ]] ++ basename /home/pi/dropbox/c100k
• local filename=c100k
• DST=/cam2/c100k
• [[ -d /home/pi/dropbox/c100k ]]
• [[ -e /home/pi/dropbox/c100k ]]
• db_upload_file /home/pi/dropbox/c100k /cam2/c100k ++ normalize_path /home/pi/dropbox/c100k +++ builtin printf /home/pi/dropbox/c100k ++ path=/home/pi/dropbox/c100k ++ [[ 1 == 1 ]] +++ readlink -m /home/pi/dropbox/c100k ++ new_path=/home/pi/dropbox/c100k ++ [[ k == \/ ]] ++ echo /home/pi/dropbox/c100k
• local FILE_SRC=/home/pi/dropbox/c100k ++ normalize_path /cam2/c100k +++ builtin printf /cam2/c100k ++ path=/cam2/c100k ++ [[ 1 == 1 ]] +++ readlink -m /cam2/c100k ++ new_path=/cam2/c100k ++ [[ k == \/ ]] ++ echo /cam2/c100k
• local FILE_DST=/cam2/c100k
• shopt -s nocasematch ++ basename /cam2/c100k
• basefile_dst=c100k
• [[ c100k == \t\h\u\m\b\s.\d\b ]]
• [[ c100k == \d\e\s\k\t\o\p.\i\n\i ]]
• [[ c100k == .\d\s_\s\t\o\r\e ]]
• [[ c100k == \i\c\o\n\\r ]]
• [[ c100k == .\d\r\o\p\b\o\x ]]
• [[ c100k == .\d\r\o\p\b\o\x.\a\t\t\r ]]
• shopt -u nocasematch ++ file_size /home/pi/dropbox/c100k +++ stat --format=%s /home/pi/dropbox/c100k ++ SIZE=100000 ++ '[' 0 -eq 0 ']' ++ echo 100000 ++ return
• FILE_SIZE=100000 ++ db_stat /cam2/c100k +++ normalize_path /cam2/c100k ++++ builtin printf /cam2/c100k +++ path=/cam2/c100k +++ [[ 1 == 1 ]] ++++ readlink -m /cam2/c100k +++ new_path=/cam2/c100k +++ [[ k == \/ ]] +++ echo /cam2/c100k ++ local FILE=/cam2/c100k ++ [[ /cam2/c100k == \/ ]] ++ curl -X POST -L -s --show-error --globoff -i -o /tmp/du_resp_debug --header 'Authorization: Bearer ' --header 'Content-Type: application/json' --data '{"path": "/cam2/c100k"}' https://api.dropboxapi.com/2/files/get_metadata ++ check_http_response ++ CODE=0 ++ case $CODE in ++ grep -q 'HTTP/1.1 400' /tmp/du_resp_debug +++ sed -n 's/{".tag": "([^"])".*/\1/p' /tmp/du_resp_debug ++ local 'TYPE={"error_summary": "path/not_found/..", "error": path' ++ case $TYPE in ++ echo ERR
• TYPE=ERR
• [[ ERR != \E\R\R ]]
• [[ ERR != \E\R\R ]]
• [[ 100000 -gt 157286000 ]]
• db_simple_upload_file /home/pi/dropbox/c100k /cam2/c100k ++ normalize_path /home/pi/dropbox/c100k +++ builtin printf /home/pi/dropbox/c100k ++ path=/home/pi/dropbox/c100k ++ [[ 1 == 1 ]] +++ readlink -m /home/pi/dropbox/c100k ++ new_path=/home/pi/dropbox/c100k ++ [[ k == \/ ]] ++ echo /home/pi/dropbox/c100k
• local FILE_SRC=/home/pi/dropbox/c100k ++ normalize_path /cam2/c100k +++ builtin printf /cam2/c100k ++ path=/cam2/c100k ++ [[ 1 == 1 ]] +++ readlink -m /cam2/c100k ++ new_path=/cam2/c100k ++ [[ k == \/ ]] ++ echo /cam2/c100k
• local FILE_DST=/cam2/c100k
• [[ 0 == 1 ]]
• CURL_PARAMETERS='-v -L -s'
• LINE_CR=
• print ' > Uploading "/home/pi/dropbox/c100k" to "/cam2/c100k"... '
• [[ 0 == 0 ]]
• echo -ne ' > Uploading "/home/pi/dropbox/c100k" to "/cam2/c100k"... '

  Uploading "/home/pi/dropbox/c100k" to "/cam2/c100k"... + curl -v -L -s -X POST -i --globoff -o /tmp/du_resp_debug --header 'Authorization: Bearer ' --header 'Dropbox-API-Arg: {"path": "/cam2/c100k","mode": "overwrite","autorename": true,"mute": false}' --header 'Content-Type: application/octet-stream' --data-binary @/home/pi/dropbox/c100k https://content.dropboxapi.com/2/files/upload

• Trying 2620:100:601a:8::a27d:708...
• TCP_NODELAY set
• Connected to content.dropboxapi.com (2620:100:601a:8::a27d:708) port 443 (#0)
• ALPN, offering h2
• ALPN, offering http/1.1
• Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
• successfully set certificate verify locations:
• CAfile: /etc/ssl/certs/ca-certificates.crt CApath: /etc/ssl/certs
• TLSv1.2 (OUT), TLS header, Certificate Status (22): } [5 bytes data]
• TLSv1.2 (OUT), TLS handshake, Client hello (1): } [512 bytes data]
• TLSv1.2 (IN), TLS handshake, Server hello (2): { [106 bytes data]
• TLSv1.2 (IN), TLS handshake, Certificate (11): { [3302 bytes data]
• TLSv1.2 (IN), TLS handshake, Server key exchange (12): { [333 bytes data]
• TLSv1.2 (IN), TLS handshake, Server finished (14): { [4 bytes data]
• TLSv1.2 (OUT), TLS handshake, Client key exchange (16): } [70 bytes data]
• TLSv1.2 (OUT), TLS change cipher, Client hello (1): } [1 bytes data]
• TLSv1.2 (OUT), TLS handshake, Finished (20): } [16 bytes data]
• TLSv1.2 (IN), TLS change cipher, Client hello (1): { [1 bytes data]
• TLSv1.2 (IN), TLS handshake, Finished (20): { [16 bytes data]
• SSL connection using TLSv1.2 / ECDHE-RSA-AES256-GCM-SHA384
• ALPN, server accepted to use http/1.1
• Server certificate:
• subject: C=US; ST=California; L=San Francisco; O=Dropbox, Inc; OU=Dropbox Ops; CN=content.dropboxapi.com
• start date: Feb 7 00:00:00 2017 GMT
• expire date: Feb 12 12:00:00 2020 GMT
• subjectAltName: host "content.dropboxapi.com" matched cert's "content.dropboxapi.com"
• issuer: C=US; O=DigiCert Inc; OU=www.digicert.com; CN=DigiCert SHA2 High Assurance Server CA
• SSL certificate verify ok. } [5 bytes data]

  POST /2/files/upload HTTP/1.1 Host: content.dropboxapi.com User-Agent: curl/7.52.1 Accept: / Authorization: Bearer Dropbox-API-Arg: {"path": "/cam2/c100k","mode": "overwrite","autorename": true,"mute": false} Content-Type: application/octet-stream Content-Length: 100000 Expect: 100-continue

  { [5 bytes data] < HTTP/1.1 100 Continue } [5 bytes data]

• SSL_write() returned SYSCALL, errno = 110
• Curl_http_done: called premature == 1
• stopped the pause stream!
• Closing connection 0
• check_http_response
• CODE=55
• case $CODE in
• grep -q 'HTTP/1.1 400' /tmp/du_resp_debug
• grep -q '^HTTP/1.1 200 OK' /tmp/du_resp_debug
• print 'FAILED\n'
• [[ 0 == 0 ]]
• echo -ne 'FAILED\n' FAILED
• print 'An error occurred requesting /upload\n'
• [[ 0 == 0 ]]
• echo -ne 'An error occurred requesting /upload\n' An error occurred requesting /upload
• ERROR_STATUS=1
• (( i++ ))
• (( i<4 ))
• remove_temp_files
• [[ 1 == 0 ]]
• [[ 1 -ne 0 ]]
• echo 'Some error occured. Please check the log.' Some error occured. Please check the log.
• exit 1

--

The /tmp/du_resp_debug contains: HTTP/1.1 100 Continue

--

I have tried creating a new Dropbox App, creating new tokens, new directories, rebooting the wifi AP. I have not tried configuring a new Raspberry Pi.

I tried the token on other systems and it worked.

Networking on this Pi seems to be ok for all other purposes including uploading large files via ftp.

[kidtire]

In trying to debug this I forced curl to use ipv4 (-4 option) and it seems to be working. I will look next at my ipv6 routing as that seems to be a problem on this new system.

[lucnat]

In trying to debug this I forced curl to use ipv4 (-4 option) and it seems to be working. I will look next at my ipv6 routing as that seems to be a problem on this new system.

How did you force it? Is it possible to pass curl parameters to the dropbox-uploader script?

[kidtire]

I just edited the curl parameters in the Dropbox uploaded script to use -4 everywhere and it works.

[lucnat]

I just edited the curl parameters in the Dropbox uploaded script to use -4 everywhere and it works.

Okey, it doesn't work for me on two different machines...could you share your file?

[lucnat]

I just edited the curl parameters in the Dropbox uploaded script to use -4 everywhere and it works.

Nevermind it works now after creating a new dropbox app which has access on the full dropbox