Error: 'Cannot detect compression type' while sinchronization from apache.jfrog.io

[x23n5902y]

Version

pulp-cli                        0.14.0
pulp-deb                        2.17.0
pulp-file                       1.10.2
pulp-rpm                        3.17.4
pulpcore                        3.18.1

Describe the bug Error: 'Cannot detect compression type' while sinchronization from apache.jfrog.io

To Reproduce

(pulp) [pulp@x-xxx-x-xxxxxx ~]$ pulp rpm remote create --name couchdb-remote --url https://apache.jfrog.io/ui/native/couchdb-rpm/el8/x86_64/ --policy immediate --proxy-url http://sys-proxy.domain.tld:8080/
{
  "pulp_href": "/pulp/api/v3/remotes/rpm/rpm/d41833a3-23dc-49ff-b462-94d2dbfacb95/",
  "pulp_created": "2022-03-03T07:15:26.591651Z",
  "name": "couchdb-remote",
  "url": "https://apache.jfrog.io/ui/native/couchdb-rpm/el8/x86_64/",
  "ca_cert": null,
  "client_cert": null,
  "tls_validation": true,
  "proxy_url": "http://sys-proxy.domain.tld:8080/",
  "pulp_labels": {},
  "pulp_last_updated": "2022-03-03T07:15:26.591671Z",
  "download_concurrency": null,
  "max_retries": null,
  "policy": "immediate",
  "total_timeout": null,
  "connect_timeout": null,
  "sock_connect_timeout": null,
  "sock_read_timeout": null,
  "headers": null,
  "rate_limit": null,
  "sles_auth_token": null
}

(pulp) [pulp@x-xxx-x-xxxxxx ~]$ pulp rpm repository create --name couchdb
{
  "pulp_href": "/pulp/api/v3/repositories/rpm/rpm/275317b6-5dac-479d-97f7-440bbbfd3cc9/",
  "pulp_created": "2022-03-03T07:15:56.884209Z",
  "versions_href": "/pulp/api/v3/repositories/rpm/rpm/275317b6-5dac-479d-97f7-440bbbfd3cc9/versions/",
  "pulp_labels": {},
  "latest_version_href": "/pulp/api/v3/repositories/rpm/rpm/275317b6-5dac-479d-97f7-440bbbfd3cc9/versions/0/",
  "name": "couchdb",
  "description": null,
  "retain_repo_versions": null,
  "remote": null,
  "autopublish": false,
  "metadata_signing_service": null,
  "retain_package_versions": 0,
  "metadata_checksum_type": null,
  "package_checksum_type": null,
  "gpgcheck": 0,
  "repo_gpgcheck": 0,
  "sqlite_metadata": false
}

(pulp) [pulp@x-xxx-x-xxxxxx ~]$ pulp rpm repository sync --name couchdb --remote couchdb-remote
Started background task /pulp/api/v3/tasks/f8664446-27d8-44ef-80c8-968af94840c8/
..Error: Task /pulp/api/v3/tasks/f8664446-27d8-44ef-80c8-968af94840c8/ failed: 'Cannot open /var/lib/pulp/tmp/1708@x-xxx-x-xxxxxx.domain.tld/tmp8kutbfpx/tmp45e57u65: Cannot detect compression type'

Expected behavior synchronization should pass without errors

Additional context Add any other context about the problem here. Please provide links to any previous discussions via Discourse or Bugzilla.

[ggainey]

Artifactory at jfrog is returning ridiculousness when asked for repodata/repomd.xml:

(pulp) [tmp]$ http GET https://apache.jfrog.io/ui/native/couchdb-rpm/el8/x86_64/repodata/repomd.xml
HTTP/1.1 200 OK
Accept-Ranges: bytes
Cache-Control: public, max-age=0
Connection: keep-alive
Content-Encoding: gzip
Content-Security-Policy: script-src 'self' cdn.heapanalytics.com heapanalytics.com www.google-analytics.com youtube.com www.youtube.com 'unsafe-eval' https://js.driftt.com https://widget.drift.com; frame-src youtube.com www.youtube.com js.driftt.com widget.drift.com; media-src js.driftt.com; font-src 'self' data: https://heapanalytics.com; base-uri 'self'; style-src 'self' 'unsafe-inline' https://heapanalytics.com; form-action 'self'; frame-ancestors 'self'
Content-Type: text/html; charset=UTF-8
Date: Thu, 03 Mar 2022 19:12:46 GMT
Etag: W/"a63-17ebb8562a0"
Feature-Policy: geolocation 'none';microphone 'none';camera 'none';payment 'none'
Last-Modified: Wed, 02 Feb 2022 17:39:48 GMT
Referrer-Policy: no-referrer
Strict-Transport-Security: max-age=15724800; includeSubDomains
Transfer-Encoding: chunked
Vary: Accept-Encoding
X-Content-Security-Policy: script-src 'self' cdn.heapanalytics.com heapanalytics.com www.google-analytics.com youtube.com www.youtube.com 'unsafe-eval' https://js.driftt.com https://widget.drift.com; frame-src youtube.com www.youtube.com js.driftt.com widget.drift.com; media-src js.driftt.com; font-src 'self' data: https://heapanalytics.com; base-uri 'self'; style-src 'self' 'unsafe-inline' https://heapanalytics.com; form-action 'self'; frame-ancestors 'self'
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Request-ID: 5f18b5f355fe854427417f255a8b3064
X-Webkit-Csp: script-src 'self' cdn.heapanalytics.com heapanalytics.com www.google-analytics.com youtube.com www.youtube.com 'unsafe-eval' https://js.driftt.com https://widget.drift.com; frame-src youtube.com www.youtube.com js.driftt.com widget.drift.com; media-src js.driftt.com; font-src 'self' data: https://heapanalytics.com; base-uri 'self'; style-src 'self' 'unsafe-inline' https://heapanalytics.com; form-action 'self'; frame-ancestors 'self'
X-Xss-Protection: 1; mode=block

<!doctype html><html lang=en><head><meta charset=utf-8><meta http-equiv=X-UA-Compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1"><meta name=importmap-type content=systemjs-importmap><link rel=apple-touch-icon sizes=180x180 href=./apple-touch-icon.png><link rel=icon type=image/png sizes=32x32 href=./favicon-32x32.png><link rel=icon type=image/png sizes=16x16 href=./favicon-16x16.png><link rel=mask-icon href=./safari-pinned-tab.svg color=#f5f5f2><link rel="shortcut icon" href=./favicon.ico><script type=systemjs-importmap>{
          "imports": {
            "@jfrog/ui-platform-microfrontend-distribution": "/ui/api/v1/distribution/webapp/js/app.js"
          }
        }</script><script src=/ui/externals/import-map-overrides/dist/import-map-overrides.js></script><script src=/ui/externals/systemjs/dist/s.min.js></script><base href=/ui/ ><title>JFrog</title><style>@keyframes heartbeatOut{from{opacity:1}50%{opacity:0;transform:scale(.8)}to{opacity:0;transform:scale(.8)}}@keyframes heartbeat{from{transform:scale3d(1,1,1)}50%{transform:scale3d(1.15,1.15,1.15)}to{transform:scale3d(1,1,1)}}.pounding-heart-container{display:none;align-items:center;justify-content:center;position:absolute;left:0;right:0;top:0;bottom:0;z-index:9999999999;background:linear-gradient(132.49deg,#414857 14.17%,#252831 83.36%)}.pounding-heart-container.show-splash{display:flex}.logo{width:130px;-webkit-backface-visibility:hidden;-ms-transform:translateZ(0);-webkit-transform:translateZ(0);transform:translateZ(0)}.logo.pulse{animation:heartbeat 1.7s infinite}.logo.zoom-out{animation:heartbeatOut 1s forwards}</style><link href=/ui/css/app.7fa62c69.css rel=preload as=style><link href=/ui/css/chunk-vendors.7890f761.css rel=preload as=style><link href=/ui/js/app.2c3dcb2c.js rel=preload as=script><link href=/ui/js/chunk-vendors.c1872b3e.js rel=preload as=script><link href=/ui/js/preloader.58e23e59.js rel=preload as=script><link href=/ui/css/chunk-vendors.7890f761.css rel=stylesheet><link href=/ui/css/app.7fa62c69.css rel=stylesheet></head><body><div class="pounding-heart-container show-splash"><img class="logo pulse" src=/ui/img/jfrog.e7e805da.svg></div><noscript><strong>We're sorry but jfrog webapp doesn't work properly without JavaScript enabled. Please enable it to continue.</strong></noscript><link rel=stylesheet type=text/css href=/ui/webapp/css/vendorStyles.css><link rel=stylesheet type=text/css href=/ui/webapp/css/application.css><div id=app></div><script src=/ui/js/chunk-vendors.c1872b3e.js></script><script src=/ui/js/app.2c3dcb2c.js></script><script src=/ui/js/preloader.58e23e59.js></script></body></html>

[jlsherrill]

try https://apache.jfrog.io/artifactory/couchdb-rpm/el8/x86_64/ instead. I get the impression the /ui/ is not meant to actually be used to consume content

[dralley]

Correct, the couchdb documentation links a .repo file, and the URL in that .repo file follows the format @jlsherrill described, rather than the URL mentioned in the original post.

https://couchdb.apache.org/repo/couchdb.repo