search

clemlabprojects / ambari

Fork of Apache Ambari maintained by Clemlab Company
https://www.clemlab.com
Apache License 2.0
42 stars 17 forks source link

[bug] ODP 1.2.2.0 on AlmaLinux 9 curl:option --data-binary: out of memory #83

Open daviyang35 opened 4 months ago

daviyang35 commented 4 months ago

Install mode

local repository on Rocky Linux 9 with httpd

archive version

Python version

os default python3

Error message

show with: restart YARN ResourceManager

resource_management.core.exceptions.ExecutionFailed: Execution of 'curl -sS -L -w '%{http_code}' -X PUT --data-binary @/var/lib/ambari-agent/tmp/yarn-ats/1.2.2.0-138/hbase.tar.gz -H 'Content-Type: application/octet-stream' 'http://0.0.0.0:50070/webhdfs/v1/odp/apps/1.2.2.0-138/hbase/hbase.tar.gz?op=CREATE&overwrite=True&permission=444&user.name=hdfs' 1>/tmp/tmpzwpulqks 2>/tmp/tmp31_4qppg' returned 2. curl: option --data-binary: out of memory
curl: try 'curl --help' or 'curl --manual' for more information
[root@hadoop-01 ~]# ls -lh /var/lib/ambari-agent/tmp/yarn-ats/1.2.2.0-138/hbase.tar.gz
-rw-r--r--. 1 root root 1.1G May 15 17:06 /var/lib/ambari-agent/tmp/yarn-ats/1.2.2.0-138/hbase.tar.gz

fix suggestion

curl upload more that 2GB file use:

curl -X PUT -T /var/lib/ambari-agent/tmp/yarn-ats/1.2.2.0-138/hbase.tar.gz ...
[root@hadoop-01 ~]# curl -sS -L -w '%{http_code}' -X PUT --data-binary @/var/lib/ambari-agent/tmp/yarn-ats/1.2.2.0-138/hbase.tar.gz -H 'Content-Type: application/octet-stream' 'http://0.0.0.0:50070/webhdfs/v1/odp/apps/1.2.2.0-138/hbase/hbase.tar.gz?op=CREATE&overwrite=True&permission=444&user.name=hdfs'
curl: option --data-binary: out of memory
curl: try 'curl --help' or 'curl --manual' for more information
[root@hadoop-01 ~]# curl -sS -L -w '%{http_code}' -X PUT -T /var/lib/ambari-agent/tmp/yarn-ats/1.2.2.0-138/hbase.tar.gz -H 'Content-Type: application/octet-stream' 'http://0.0.0.0:50070/webhdfs/v1/odp/apps/1.2.2.0-138/hbase/hbase.tar.gz?op=CREATE&overwrite=True&permission=444&user.name=hdfs'
201
[root@hadoop-01 ~]#