wiktorn / Overpass-API

Overpass API docker image
MIT License
133 stars 47 forks source link

Error while Reading XML for new URL #84

Closed ArduinoHocam closed 2 years ago

ArduinoHocam commented 2 years ago

Hi, I'd like to upload my osm file to any location like drive etc. and then I'd like to run the docker image with that URL passed to the docker. I've managed to run docker run command, it is able to download .osm.bz2 but after that it throws an error on the console saying:

image

As you can see from the above image, it is failing. I've also tried with the Monaco map which I downloaded from http://download.geofabrik.de/europe/monaco-latest.osm.bz2 and uploaded to drive and passed direct download link for the drive.

Do you have any idea why it is failing? I need to upload the file to different URL and that is why this is important for me.

Thanks for your help!

aliibrahimozkan commented 2 years ago

I have the same issue @ArduinoHocam

wiktorn commented 2 years ago

@ArduinoHocam It would be a lot easier if you would provide the URL for the file that you're using in text instead of screenshot.

I've tried this URL, and curl'ing that address gives me HTML instead of bzip2 file (stripped irrelavant lines from below):

$ curl -Lv 'https://drive.google.com/uc?export=download&id=1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy' 2>&1 | head -n 200
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying 172.217.20.174:443...
* Connected to drive.google.com (172.217.20.174) port 443 (#0)
> GET /uc?export=download&id=1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy HTTP/2
> Host: drive.google.com
> user-agent: curl/7.78.0
> accept: */*
>
< HTTP/2 302
< content-type: text/html; charset=UTF-8
< location: https://accounts.google.com/ServiceLogin?service=wise&passive=1209600&continue=https://drive.google.com/uc?export%3Ddownload%26id%3D1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy&followup=https://drive.google.com/uc?export%3Ddownload%26id%3D1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy&ltmpl=drive
< p3p: CP="This is not a P3P policy! See g.co/p3phelp for more info."
< report-to: {"group":"coop_gse_l9ocaq","max_age":2592000,"endpoints":[{"url":"https://csp.withgoogle.com/csp/report-to/gse_l9ocaq"}]}
< cross-origin-opener-policy-report-only: same-origin; report-to="coop_gse_l9ocaq"
< content-security-policy: script-src 'nonce-DvNRVlaIDT8BeQTIlUhkgw' 'unsafe-inline' 'strict-dynamic' https: http: 'unsafe-eval';object-src 'none';base-uri 'self';report-uri https://csp.withgoogle.com/csp/drive-explorer/
< date: Wed, 19 Jan 2022 23:27:20 GMT
< expires: Wed, 19 Jan 2022 23:27:20 GMT
< cache-control: private, max-age=0
< x-content-type-options: nosniff
< x-frame-options: SAMEORIGIN
< x-xss-protection: 1; mode=block
< server: GSE
< set-cookie: NID=511=OTINYhMBbTUt2dUCemGj6WqgDLI0j7EzJRoPH7qF7TIq6T11hRXLNld7i_iriQ_oxfz-DOkH9CnKurbj20UXNIxcmj2Ym8uoVXeXXM7UDFJOhEZShczD9bDH4cGxWl0JEFw775NR2Okq9Nk9_CLh-Etj1a8dMoupVVWU7FDtit4; expires=Thu, 21-Jul-2022 23:27:20 GMT; path=/; domain=.google.com; HttpOnly
< alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
< accept-ranges: none
< vary: Sec-Fetch-Dest, Sec-Fetch-Mode, Sec-Fetch-Site,Accept-Encoding
<
{ [5 bytes data]
* Ignoring the response-body
{ [471 bytes data]
100   471    0   471    0     0   1825      0 --:--:-- --:--:-- --:--:--  1832
* Connection #0 to host drive.google.com left intact
* Issue another request to this URL: 'https://accounts.google.com/ServiceLogin?service=wise&passive=1209600&continue=https://drive.google.com/uc?export%3Ddownload%26id%3D1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy&followup=https://drive.google.com/uc?export%3Ddownload%26id%3D1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy&ltmpl=drive'
*   Trying 216.58.215.109:443...
* Connected to accounts.google.com (216.58.215.109) port 443 (#1)
> GET /ServiceLogin?service=wise&passive=1209600&continue=https://drive.google.com/uc?export%3Ddownload%26id%3D1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy&followup=https://drive.google.com/uc?export%3Ddownload%26id%3D1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy&ltmpl=drive HTTP/2
> Host: accounts.google.com
> user-agent: curl/7.78.0
> accept: */*
>
{ [5 bytes data]
< HTTP/2 200
< content-type: text/html; charset=UTF-8
< x-frame-options: DENY
< link: <https://www.google.com/intl/pl/drive/>; rel="canonical"
< x-auto-login: realm=com.google&args=service%3Dwise%26continue%3Dhttps%253A%252F%252Fdrive.google.com%252Fuc%253Fexport%253Ddownload%2526id%253D1N-K-i3jk3yFhZRVYKZV_uV-3eRqTbpYy
< cache-control: no-cache, no-store, max-age=0, must-revalidate
< pragma: no-cache
< expires: Mon, 01 Jan 1990 00:00:00 GMT
< date: Wed, 19 Jan 2022 23:27:20 GMT
< strict-transport-security: max-age=31536000; includeSubDomains
< content-security-policy: script-src 'nonce-i9Wo6UxQLGmmed/i/Yctnw' 'unsafe-inline' 'unsafe-eval';object-src 'none';base-uri 'self';report-uri /cspreport
< content-security-policy: require-trusted-types-for 'script';report-uri /cspreport
< cross-origin-opener-policy-report-only: same-origin; report-to="coop_gse_qebhlk"
< report-to: {"group":"coop_gse_qebhlk","max_age":2592000,"endpoints":[{"url":"https://csp.withgoogle.com/csp/report-to/gse_qebhlk"}]}
< x-content-type-options: nosniff
< x-xss-protection: 1; mode=block
< server: GSE
< set-cookie: __Host-GAPS=1:z_lJ4OAoGyU1Tf-fPB_KFwDwaGdbLw:mZFlZzP11-d9_FcG;Path=/;Expires=Fri, 19-Jan-2024 23:27:20 GMT;Secure;HttpOnly;Priority=HIGH
< alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
<
{ [5 bytes data]

<!DOCTYPE html>
<html lang="pl">
  <head>
  <meta charset="utf-8">
  <meta content="width=300, initial-scale=1" name="viewport">

Please check, if it is possible to download that file without logging to Google Account.

ArduinoHocam commented 2 years ago

Hi @wiktorn, Sorry for the screenshot. I think the problem was related to google drive side. It is not the direct download link(probably there are auth. checks etc. even though the link was shared with public). I've tried with transfer.sh and download was successful(bz2 format) and worked. Thank you for your reply.