KXStudio / Repository

External, Non-PPA KXStudio Repository
75 stars 6 forks source link

Can't install ardour - 505 HTTP Version not supported #73

Closed lorenzogrv closed 7 years ago

lorenzogrv commented 8 years ago

Hi there! I can't install ardour through apt-get, seems like something is wrong with the github-cloud download from S3 AWS:

# apt-get install ardour
Lendo as listas de paquetes... Feito
Construindo a árbore de dependencias       
Lendo a información do estado... Feito
Os seguintes paquetes NOVOS hanse instalar:
  ardour
0 anovados, 1 instalados, Vanse retirar 0 e deixar 5 sen anovar.
Ten que recibir 65,3 MB de arquivos.
Despois desta operación ocuparanse 178 MB de disco adicionais.
0% [Traballando]
Err:1 http://kxstudio.linuxaudio.org/repo gcc5/free amd64 ardour amd64 1:5.3.5-1kxstudio1v5
  505  HTTP Version not supported
E: Non foi posíbel obter https://github-cloud.s3.amazonaws.com/releases/39372848/925193f8-7b36-11e6-8256-0fd70f6b012b.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ/20161019/us-east-1/s3/aws4_request&X-Amz-Date=20161019T130334Z&X-Amz-Expires=300&X-Amz-Signature=335b7002ca0629d004b715931cf5c352fb33e3f140e2f8226218c375696813fd&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment; filename=ardour_5.3.5-1kxstudio1v5_amd64.deb&response-content-type=application/octet-stream  505  HTTP Version not supported
E: Non foi posíbel obter algúns arquivos; probe con apt-get update ou --fix-missing.

Things I've tried:

Any ideas?


Triage info

If something more can help, let me know please..

Host system

# uname -a
Linux iaibox 4.7.0-1-amd64 #1 SMP Debian 4.7.6-1 (2016-10-07) x86_64 GNU/Linux
# dpkg -l | grep kxstudio-repos
ii  kxstudio-repos              9.3.0~kxstudio1     all          KXStudio repositories
ii  kxstudio-repos-gcc5         9.3.0~kxstudio1      all          KXStudio repositories (GCC5 Packages)
# dpkg -l | grep apt-transport
ii  apt-transport-https                     1.3.1                                amd64        https download transport for APT
ii  apt-transport-s3                        1.2.1-1                              all          APT transport for privately held AWS S3 repositories
# apt-get --version
apt 1.3.1 (amd64)
Módulos admitidos:
*Ver: Standard .deb
*Pkg:  Debian dpkg interface (Priority 30)
 Pkg:  Debian APT solver interface (Priority -1000)
 Pkg:  Debian APT planner interface (Priority -1000)
 S.L: 'deb' Debian binary tree
 S.L: 'deb-src' Debian source tree
 Idx: Debian Source Index
 Idx: Debian Package Index
 Idx: Debian Translation Index
 Idx: Debian dpkg status file
 Idx: Debian deb file
 Idx: Debian dsc file
 Idx: Debian control file
 Idx: EDSP scenario file
 Idx: EIPP scenario file

Reinstalling kxstudio-repos and kxstudio-repos-gcc5

# apt-get install --reinstall kxstudio-repos kxstudio-repos-gcc5
Lendo as listas de paquetes... Feito
Construindo a árbore de dependencias       
Lendo a información do estado... Feito
0 anovados, 0 instalados, 2 reinstalados, Vanse retirar 0 e deixar 5 sen anovar.
Ten que recibir 3050 B/8784 B de arquivos.
Despois desta operación ocuparanse 0 B de disco adicionais.
Rcb:1 http://ppa.launchpad.net/kxstudio-debian/kxstudio/ubuntu trusty/main amd64 kxstudio-repos-gcc5 all 9.3.0~kxstudio1 [3050 B]
Obtivéronse 3050 B en 14s (209 B/s)          
(A ler a base de datos ... 289854 files and directories currently installed.)
Preparing to unpack .../0-kxstudio-repos_9.3.0~kxstudio1_all.deb ...
Unpacking kxstudio-repos (9.3.0~kxstudio1) over (9.3.0~kxstudio1) ...
Preparing to unpack .../1-kxstudio-repos-gcc5_9.3.0~kxstudio1_all.deb ...
Unpacking kxstudio-repos-gcc5 (9.3.0~kxstudio1) over (9.3.0~kxstudio1) ...
A configurar kxstudio-repos (9.3.0~kxstudio1) ...
Warning: The postinst maintainerscript of the package kxstudio-repos
Warning: seems to use apt-key (provided by apt) without depending on gnupg or gnupg2.
Warning: This will BREAK in the future and should be fixed by the package maintainer(s).
Note: Check first if apt-key functionality is needed at all - it probably isn't!
Warning: apt-key should not be used in scripts (called from postinst maintainerscript of the package kxstudio-repos)
OK
Warning: The postinst maintainerscript of the package kxstudio-repos
Warning: seems to use apt-key (provided by apt) without depending on gnupg or gnupg2.
Warning: This will BREAK in the future and should be fixed by the package maintainer(s).
Note: Check first if apt-key functionality is needed at all - it probably isn't!
Warning: apt-key should not be used in scripts (called from postinst maintainerscript of the package kxstudio-repos)
OK
gpg: keybox '/tmp/tmp2v0g1toh/pubring.gpg' created
gpg: /tmp/tmp2v0g1toh/trustdb.gpg: creouse a base de datos de confianza
gpg: key F8599E482BD84BD9: public key "Launchpad PPA for KXStudio Debian" imported
gpg: Número total procesado: 1
gpg:            importadas: 1
Warning: The postinst maintainerscript of the package kxstudio-repos
Warning: seems to use apt-key (provided by apt) without depending on gnupg or gnupg2.
Warning: This will BREAK in the future and should be fixed by the package maintainer(s).
Note: Check first if apt-key functionality is needed at all - it probably isn't!
Warning: apt-key should not be used in scripts (called from postinst maintainerscript of the package kxstudio-repos)
gpg: non se atoparon datos OpenPGP válidos.
A configurar kxstudio-repos-gcc5 (9.3.0~kxstudio1) ...

Updating apt package lists

# apt-get update
Teño:1 http://security.debian.org/debian-security testing/updates InRelease    
Teño:2 http://ftp.es.debian.org/debian testing InRelease                       
Ign:3 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty InRelease  
Teño:4 http://ppa.launchpad.net/kxstudio-debian/gcc5/ubuntu wily InRelease     
Ign:5 http://kxstudio.linuxaudio.org/repo gcc5 InRelease                       
Teño:6 http://ppa.launchpad.net/kxstudio-debian/gcc5/ubuntu xenial InRelease   
Ign:7 http://kxstudio.linuxaudio.org/repo stable InRelease                     
Teño:8 http://ppa.launchpad.net/kxstudio-debian/gcc5-deps/ubuntu xenial InRelease
Teño:9 http://ppa.launchpad.net/kxstudio-debian/libs/ubuntu lucid InRelease    
Teño:10 http://kxstudio.linuxaudio.org/repo gcc5 Release                       
Teño:11 http://ppa.launchpad.net/kxstudio-debian/music/ubuntu lucid InRelease  
Teño:12 http://ppa.launchpad.net/kxstudio-debian/plugins/ubuntu lucid InRelease
Teño:13 http://kxstudio.linuxaudio.org/repo stable Release                     
Teño:14 http://ppa.launchpad.net/kxstudio-debian/apps/ubuntu lucid InRelease   
Teño:16 http://ppa.launchpad.net/kxstudio-debian/kxstudio/ubuntu lucid InRelease
Teño:17 http://ppa.launchpad.net/kxstudio-debian/libs/ubuntu trusty InRelease
Teño:18 http://ppa.launchpad.net/kxstudio-debian/music/ubuntu trusty InRelease
Teño:19 http://ppa.launchpad.net/kxstudio-debian/plugins/ubuntu trusty InRelease
Teño:21 http://ppa.launchpad.net/kxstudio-debian/apps/ubuntu trusty InRelease
Teño:22 http://ppa.launchpad.net/kxstudio-debian/kxstudio/ubuntu trusty InRelease
Ign:23 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty Release
Ign:24 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 Packages
Ign:25 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all Packages
Ign:26 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl_ES
Ign:27 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl
Ign:28 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-en
Ign:29 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all DEP-11 Metadata
Ign:30 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 DEP-11 Metadata
Ign:31 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main DEP-11 64x64 Icons
Ign:24 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 Packages
Ign:25 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all Packages
Ign:26 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl_ES
Ign:27 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl
Ign:28 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-en
Ign:29 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all DEP-11 Metadata
Ign:30 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 DEP-11 Metadata
Ign:31 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main DEP-11 64x64 Icons
Ign:24 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 Packages
Ign:25 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all Packages
Ign:26 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl_ES
Ign:27 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl
Ign:28 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-en
Ign:29 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all DEP-11 Metadata
Ign:30 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 DEP-11 Metadata
Ign:31 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main DEP-11 64x64 Icons
Ign:24 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 Packages
Ign:25 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all Packages
Ign:26 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl_ES
Ign:27 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl
Ign:28 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-en
Ign:29 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all DEP-11 Metadata
Ign:30 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 DEP-11 Metadata
Ign:31 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main DEP-11 64x64 Icons
Ign:24 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 Packages
Ign:25 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all Packages
Ign:26 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl_ES
Ign:27 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl
Ign:28 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-en
Ign:29 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all DEP-11 Metadata
Ign:30 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 DEP-11 Metadata
Ign:31 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main DEP-11 64x64 Icons
Err:24 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 Packages
  404  Not Found
Ign:25 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all Packages
Ign:26 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl_ES
Ign:27 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-gl
Ign:28 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main Translation-en
Ign:29 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main all DEP-11 Metadata
Ign:30 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main amd64 DEP-11 Metadata
Ign:31 http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty/main DEP-11 64x64 Icons
Lendo as listas de paquetes... Feito
W: The repository 'http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu zesty Release' does not have a Release file.
N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: Non foi posíbel obter http://ppa.launchpad.net/kxstudio-debian/ubuntus/ubuntu/dists/zesty/main/binary-amd64/Packages  404  Not Found
E: Some index files failed to download. They have been ignored, or old ones used instead.

falkTX commented 8 years ago

This is an issue with apt, not the kxstudio repos. Under Ubuntu 14.04 and 16.04 everything works fine.

Regarding zesty errors, that was just announced days ago, it's obvious I haven't had time to add it to the supported list.

lorenzogrv commented 8 years ago

Few notes to end this:

Thanks for your time, and the quick reply.

falkTX commented 8 years ago

well, let's leave this issue for the ardour package. if there's other issues open new bug reports for them.

norru commented 7 years ago

If it helps, I have had a similar issue when downloading carla-bridge-win64 in Ubuntu 16.10 and latest KXStudio as for 21/12/2016.

nico@nico-lenovo-ubuntu:~$ sudo apt-get install carla-bridge-win64Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following packages were automatically installed and are no longer required:
  linux-headers-4.8.0-28 linux-headers-4.8.0-28-generic linux-headers-4.8.0-28-lowlatency
  linux-image-4.8.0-28-generic linux-image-4.8.0-28-lowlatency linux-image-extra-4.8.0-28-generic
  linux-signed-image-4.8.0-28-generic
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
  carla-bridge-wine64
The following NEW packages will be installed
  carla-bridge-win64 carla-bridge-wine64
0 to upgrade, 2 to newly install, 0 to remove and 20 not to upgrade.
Need to get 22.0 kB/2,037 kB of archives.
After this operation, 9,259 kB of additional disk space will be used.
Do you want to continue? [Y/n] y
Err:1 http://kxstudio.linuxaudio.org/repo stable/free amd64 carla-bridge-wine64 amd64 2:1.9.5+git20160114
  505  HTTP Version not supported
E: Failed to fetch https://github-cloud.s3.amazonaws.com/releases/39372848/9da756ea-bab4-11e5-914c-9398570c3a01.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ/20161221/us-east-1/s3/aws4_request&X-Amz-Date=20161221T214035Z&X-Amz-Expires=300&X-Amz-Signature=2e7255c33a4f2fc94ab4732b868873dea7b6e7db36fd857962a7437a8df96568&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment; filename=carla-bridge-wine64_1.9.5.git20160114_amd64.deb&response-content-type=application/octet-stream  505  HTTP Version not supported
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

Googling around, it does look like this is caused by unescaped spaces in the URL. I'm new to KXStudio, and I have never seen apt-get failing with this error code before.

Let me know if you need more details.

falkTX commented 7 years ago

carla-bridge-win64 comes from the same repo, so the issue would be the same.

I need to note again that the repos still work on ubuntu 14.04 and debian 7 (current stable).

norru commented 7 years ago

I'm sure if I report this error to the apt team they'll tell me it's the repo's fault as no other repositories have this issue. As I have not seen this error before on any other repository they may actually have a point.

Is there a direct download link to the debs so I can download manually and install with dpkg?

norru commented 7 years ago

If it helps again, I've forcibly installed apt, apt-tools, apt-transport-https 1.4-beta2 (which is the current version on Sid) and the error persists.

norru commented 7 years ago

FYI

https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1651923

falkTX commented 7 years ago

The deb packages are all here: https://github.com/KXStudio/Repository/releases

Here's an example link that does the redirect: http://kxstudio.linuxaudio.org/repo/pool/free/ardour4_4.7.0-1kxstudio1_i386.deb

norru commented 7 years ago

Julian Andres Klode (juliank) wrote 1 hour ago: #5 I think the problem is that there is a space in the URI before "filename=", and that is not encoded before it being sent out, causing the server to think "filename=..." is the http version...

So there are two issues:

1) the redirect link contains a space 2) apt doesn't encode that space

Any chance that the space can be removed your side?

norru commented 7 years ago

It does appear that the redirect url does contain an encoded space, and that at some point in the apt pipe it gets decoded and not re-encoded back.

nico@nico-lenovo-ubuntu:~$ curl -vvv http://kxstudio.linuxaudio.org/repo/pool/free/ardour4_4.7.0-1kxstudio1_i386.deb
*   Trying 198.82.152.114...
* Connected to kxstudio.linuxaudio.org (198.82.152.114) port 80 (#0)
> GET /repo/pool/free/ardour4_4.7.0-1kxstudio1_i386.deb HTTP/1.1
> Host: kxstudio.linuxaudio.org
> User-Agent: curl/7.50.1
> Accept: */*
> 
< HTTP/1.1 301 Moved Permanently
< Date: Thu, 22 Dec 2016 16:17:10 GMT
< Server: Apache
< Location: https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb
< Vary: Accept-Encoding
< Content-Length: 379
< Content-Type: text/html; charset=iso-8859-1
< 
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>301 Moved Permanently</title>
</head><body>
<h1>Moved Permanently</h1>
<p>The document has moved <a href="https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb">here</a>.</p>
<hr>
<address>Apache Server at kxstudio.linuxaudio.org Port 80</address>
</body></html>
* Connection #0 to host kxstudio.linuxaudio.org left intact
nico@nico-lenovo-ubuntu:~$ curl https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb
<html><body>You are being <a href="https://github-cloud.s3.amazonaws.com/releases/39372848/4074c29a-d734-11e5-8632-2259aafc2c91.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ%2F20161222%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Date=20161222T161741Z&amp;X-Amz-Expires=300&amp;X-Amz-Signature=3faf5a0d96bf1e4762cc6ab598a8497c40cf439c33ce7b592705e60b9486d5d1&amp;X-Amz-SignedHeaders=host&amp;actor_id=0&amp;response-content-disposition=attachment%3B%20filename%3Dardour4_4.7.0-1kxstudio1_i386.deb&amp;response-content-type=application%2Foctet-stream">redirected</a>.</body></html>nico@nico-lenovo-ubuntu:~$ 
nico@nico-lenovo-ubuntu:~$ curl -vvv https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb
*   Trying 192.30.253.113...
* Connected to github.com (192.30.253.113) port 443 (#0)
* found 173 certificates in /etc/ssl/certs/ca-certificates.crt
* found 697 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
* SSL connection using TLS1.2 / ECDHE_RSA_AES_128_GCM_SHA256
*    server certificate verification OK
*    server certificate status verification SKIPPED
*    common name: github.com (matched)
*    server certificate expiration date OK
*    server certificate activation date OK
*    certificate public key: RSA
*    certificate version: #3
*    subject: 
*    start date: Thu, 10 Mar 2016 00:00:00 GMT
*    expire date: Thu, 17 May 2018 12:00:00 GMT
*    issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert SHA2 Extended Validation Server CA
*    compression: NULL
* ALPN, server accepted to use http/1.1
> GET /KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb HTTP/1.1
> Host: github.com
> User-Agent: curl/7.50.1
> Accept: */*
> 
< HTTP/1.1 302 Found
< Server: GitHub.com
< Date: Thu, 22 Dec 2016 16:17:58 GMT
< Content-Type: text/html; charset=utf-8
< Transfer-Encoding: chunked
< Status: 302 Found
< Cache-Control: no-cache
< Vary: X-PJAX
< Location: https://github-cloud.s3.amazonaws.com/releases/39372848/4074c29a-d734-11e5-8632-2259aafc2c91.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ%2F20161222%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20161222T161758Z&X-Amz-Expires=300&X-Amz-Signature=9b01bd5373576686821a64246a49f2aa743bd61a8a263344903424b177c58a20&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dardour4_4.7.0-1kxstudio1_i386.deb&response-content-type=application%2Foctet-stream
< X-UA-Compatible: IE=Edge,chrome=1
< Set-Cookie: logged_in=no; domain=.github.com; path=/; expires=Mon, 22 Dec 2036 16:17:58 -0000; secure; HttpOnly
< Set-Cookie: _gh_sess=eyJzZXNzaW9uX2lkIjoiZjhiMDhlZjFmOTkwYzc0ZWUwYjc0YWM3OWVhZDIwMjEiLCJzcHlfcmVwbyI6IktYU3R1ZGlvL1JlcG9zaXRvcnkiLCJzcHlfcmVwb19hdCI6MTQ4MjQyMzQ3OH0%3D--be3aea95afb365d48e55f3ae42fc52eb44274544; path=/; secure; HttpOnly
< X-Request-Id: bce17c907cbaaed87965126b46e9c683
< X-Runtime: 0.022282
< Content-Security-Policy: default-src 'none'; base-uri 'self'; block-all-mixed-content; child-src render.githubusercontent.com; connect-src 'self' uploads.github.com status.github.com collector.githubapp.com api.github.com www.google-analytics.com github-cloud.s3.amazonaws.com wss://live.github.com; font-src assets-cdn.github.com; form-action 'self' github.com gist.github.com; frame-ancestors 'none'; frame-src render.githubusercontent.com; img-src 'self' data: assets-cdn.github.com identicons.github.com collector.githubapp.com github-cloud.s3.amazonaws.com *.githubusercontent.com; media-src 'none'; script-src assets-cdn.github.com; style-src 'unsafe-inline' assets-cdn.github.com
< Strict-Transport-Security: max-age=31536000; includeSubdomains; preload
< Public-Key-Pins: max-age=5184000; pin-sha256="WoiWRyIOVNa9ihaBciRSC7XHjliYS9VwUGOIud4PB18="; pin-sha256="RRM1dGqnDFsCJXBTHky16vi1obOlCgFFn/yOhI/y+ho="; pin-sha256="k2v657xBsOVe1PQRwOsHsw3bsGT2VzIqz5K+59sNQws="; pin-sha256="K87oWBWM9UZfyddvDfoxL+8lpNyoUB2ptGtn0fv6G2Q="; pin-sha256="IQBnNBEiFuhj+8x6X8XLgh01V9Ic5/V3IRQLNFFc7v4="; pin-sha256="iie1VXtL7HzAMF+/PVPR9xzT80kQxdZeJ+zduCB3uj0="; pin-sha256="LvRiGEjRqfzurezaWuj8Wie2gyHMrW5Q06LspMnox7A="; includeSubDomains
< X-Content-Type-Options: nosniff
< X-Frame-Options: deny
< X-XSS-Protection: 1; mode=block
< Vary: Accept-Encoding
< X-Served-By: 7d2a2d05162492046d9960cdbc326796
< X-GitHub-Request-Id: 4D62FBED:5067:C82969A:585BFCB6
< 
* Connection #0 to host github.com left intact
<html><body>You are being <a href="https://github-cloud.s3.amazonaws.com/releases/39372848/4074c29a-d734-11e5-8632-2259aafc2c91.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ%2F20161222%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Date=20161222T161758Z&amp;X-Amz-Expires=300&amp;X-Amz-Signature=9b01bd5373576686821a64246a49f2aa743bd61a8a263344903424b177c58a20&amp;X-Amz-SignedHeaders=host&amp;actor_id=0&amp;response-content-disposition=attachment%3B%20filename%3Dardour4_4.7.0-1kxstudio1_i386.deb&amp;response-content-type=application%2Foctet-stream">redirected</a>.</body></html>
falkTX commented 7 years ago

There's no space added from my side. The original link is http://kxstudio.linuxaudio.org/repo/pool/free/ardour4_4.7.0-1kxstudio1_i386.deb Which redirects to https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb (see https://github.com/KXStudio/Repository/blob/master/pool/free/.htaccess) The only thing the redirect does is transforming '+' and '~' into underscores.

falkTX commented 7 years ago

I see in the curl output that the space before 'filename=' gets encoded as %20. So perhaps it's a real bug in apt? Considering this doesn't happen in older versions I think that would be the case..

norru commented 7 years ago

Please follow the launchpad thread. Guys in apt said it's a bug in curl, but triggered by a specific URL. Basically "it's not our fault".

As easily predicted, we're in a situation where everybody is saying "it's not me" and pointing fingers at each other, while us poor final users are left high and dry ;) As for curl, they may well say "not a bug/wontfix" and then it's game over.

Is it within your reach at all to remove that space? Because it looks like the path of least resistance. Is it something github does? Because https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb also redirects.

Perhaps it's a problem with github itself?

norru commented 7 years ago

By the way, curl is fine:

nico@nico-lenovo-ubuntu:~$ curl -L -vvv http://kxstudio.linuxaudio.org/repo/pool/free/ardour4_4.7.0-1kxstudio1_i386.deb -o ardour.deb
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying 198.82.152.114...
* Connected to kxstudio.linuxaudio.org (198.82.152.114) port 80 (#0)
> GET /repo/pool/free/ardour4_4.7.0-1kxstudio1_i386.deb HTTP/1.1
> Host: kxstudio.linuxaudio.org
> User-Agent: curl/7.50.1
> Accept: */*
> 
< HTTP/1.1 301 Moved Permanently
< Date: Thu, 22 Dec 2016 21:45:57 GMT
< Server: Apache
< Location: https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb
< Vary: Accept-Encoding
< Content-Length: 379
< Content-Type: text/html; charset=iso-8859-1
< 
* Ignoring the response-body
{ [379 bytes data]
100   379  100   379    0     0   1029      0 --:--:-- --:--:-- --:--:--  1029
* Connection #0 to host kxstudio.linuxaudio.org left intact
* Issue another request to this URL: 'https://github.com/KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb'
*   Trying 192.30.253.113...
* Connected to github.com (192.30.253.113) port 443 (#1)
* found 173 certificates in /etc/ssl/certs/ca-certificates.crt
* found 697 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* SSL connection using TLS1.2 / ECDHE_RSA_AES_128_GCM_SHA256
*    server certificate verification OK
*    server certificate status verification SKIPPED
*    common name: github.com (matched)
*    server certificate expiration date OK
*    server certificate activation date OK
*    certificate public key: RSA
*    certificate version: #3
*    subject: 
*    start date: Thu, 10 Mar 2016 00:00:00 GMT
*    expire date: Thu, 17 May 2018 12:00:00 GMT
*    issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert SHA2 Extended Validation Server CA
*    compression: NULL
* ALPN, server accepted to use http/1.1
> GET /KXStudio/Repository/releases/download/initial/ardour4_4.7.0-1kxstudio1_i386.deb HTTP/1.1
> Host: github.com
> User-Agent: curl/7.50.1
> Accept: */*
> 
< HTTP/1.1 302 Found
< Server: GitHub.com
< Date: Thu, 22 Dec 2016 21:45:58 GMT
< Content-Type: text/html; charset=utf-8
< Transfer-Encoding: chunked
< Status: 302 Found
< Cache-Control: no-cache
< Vary: X-PJAX
< Location: https://github-cloud.s3.amazonaws.com/releases/39372848/4074c29a-d734-11e5-8632-2259aafc2c91.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ%2F20161222%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20161222T214558Z&X-Amz-Expires=300&X-Amz-Signature=c42514a341b5775702cfa0e797d09d3ae3388257c936128fe26809f1ac04018f&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dardour4_4.7.0-1kxstudio1_i386.deb&response-content-type=application%2Foctet-stream
< X-UA-Compatible: IE=Edge,chrome=1
< Set-Cookie: logged_in=no; domain=.github.com; path=/; expires=Mon, 22 Dec 2036 21:45:58 -0000; secure; HttpOnly
< Set-Cookie: _gh_sess=eyJzZXNzaW9uX2lkIjoiZDM2NmQ1ZDkxMTYwZjY2MDhjMGQ4YmRlMTYwMjhlNTYiLCJzcHlfcmVwbyI6IktYU3R1ZGlvL1JlcG9zaXRvcnkiLCJzcHlfcmVwb19hdCI6MTQ4MjQ0MzE1OH0%3D--ecb6bf45be2649d7c68cea7bbdec7881509454a0; path=/; secure; HttpOnly
< X-Request-Id: cd4b2bde1903f54800cd6ab53b385d3a
< X-Runtime: 0.022819
< Content-Security-Policy: default-src 'none'; base-uri 'self'; block-all-mixed-content; child-src render.githubusercontent.com; connect-src 'self' uploads.github.com status.github.com collector.githubapp.com api.github.com www.google-analytics.com github-cloud.s3.amazonaws.com wss://live.github.com; font-src assets-cdn.github.com; form-action 'self' github.com gist.github.com; frame-ancestors 'none'; frame-src render.githubusercontent.com; img-src 'self' data: assets-cdn.github.com identicons.github.com collector.githubapp.com github-cloud.s3.amazonaws.com *.githubusercontent.com; media-src 'none'; script-src assets-cdn.github.com; style-src 'unsafe-inline' assets-cdn.github.com
< Strict-Transport-Security: max-age=31536000; includeSubdomains; preload
< Public-Key-Pins: max-age=5184000; pin-sha256="WoiWRyIOVNa9ihaBciRSC7XHjliYS9VwUGOIud4PB18="; pin-sha256="RRM1dGqnDFsCJXBTHky16vi1obOlCgFFn/yOhI/y+ho="; pin-sha256="k2v657xBsOVe1PQRwOsHsw3bsGT2VzIqz5K+59sNQws="; pin-sha256="K87oWBWM9UZfyddvDfoxL+8lpNyoUB2ptGtn0fv6G2Q="; pin-sha256="IQBnNBEiFuhj+8x6X8XLgh01V9Ic5/V3IRQLNFFc7v4="; pin-sha256="iie1VXtL7HzAMF+/PVPR9xzT80kQxdZeJ+zduCB3uj0="; pin-sha256="LvRiGEjRqfzurezaWuj8Wie2gyHMrW5Q06LspMnox7A="; includeSubDomains
< X-Content-Type-Options: nosniff
< X-Frame-Options: deny
< X-XSS-Protection: 1; mode=block
< Vary: Accept-Encoding
< X-Served-By: 9e87b28fb3a65e563c8d72545356c3e0
< X-GitHub-Request-Id: 4D62FBED:5067:CCBC7B0:585C4996
< 
* Ignoring the response-body
{ [622 bytes data]
100   610    0   610    0     0    468      0 --:--:--  0:00:01 --:--:--   871
* Connection #1 to host github.com left intact
* Issue another request to this URL: 'https://github-cloud.s3.amazonaws.com/releases/39372848/4074c29a-d734-11e5-8632-2259aafc2c91.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ%2F20161222%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20161222T214558Z&X-Amz-Expires=300&X-Amz-Signature=c42514a341b5775702cfa0e797d09d3ae3388257c936128fe26809f1ac04018f&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dardour4_4.7.0-1kxstudio1_i386.deb&response-content-type=application%2Foctet-stream'
*   Trying 54.231.81.80...
* Connected to github-cloud.s3.amazonaws.com (54.231.81.80) port 443 (#2)
* found 173 certificates in /etc/ssl/certs/ca-certificates.crt
* found 697 certificates in /etc/ssl/certs
* ALPN, offering http/1.1
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0* SSL connection using TLS1.2 / ECDHE_RSA_AES_128_GCM_SHA256
*    server certificate verification OK
*    server certificate status verification SKIPPED
*    common name: *.s3.amazonaws.com (matched)
*    server certificate expiration date OK
*    server certificate activation date OK
*    certificate public key: RSA
*    certificate version: #3
*    subject: C=US,ST=Washington,L=Seattle,O=Amazon.com Inc.,CN=*.s3.amazonaws.com
*    start date: Fri, 29 Jul 2016 00:00:00 GMT
*    expire date: Wed, 29 Nov 2017 12:00:00 GMT
*    issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert Baltimore CA-2 G2
*    compression: NULL
* ALPN, server did not agree to a protocol
> GET /releases/39372848/4074c29a-d734-11e5-8632-2259aafc2c91.deb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAISTNZFOVBIJMK3TQ%2F20161222%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20161222T214558Z&X-Amz-Expires=300&X-Amz-Signature=c42514a341b5775702cfa0e797d09d3ae3388257c936128fe26809f1ac04018f&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dardour4_4.7.0-1kxstudio1_i386.deb&response-content-type=application%2Foctet-stream HTTP/1.1
> Host: github-cloud.s3.amazonaws.com
> User-Agent: curl/7.50.1
> Accept: */*
> 
< HTTP/1.1 200 OK
< x-amz-id-2: jgftd3KO43W9MqQRkaXxZQj/9CHRvJcMQtqke6185CND77T3zmAov5yolBYJa70pmzfrvIaQsEk=
< x-amz-request-id: 763EFA47B3F85EAB
< Date: Thu, 22 Dec 2016 21:46:00 GMT
< Last-Modified: Fri, 19 Feb 2016 17:11:54 GMT
< ETag: "abb6b1bf10a5c1e30c367ed9c7517e7d"
< Content-Disposition: attachment; filename=ardour4_4.7.0-1kxstudio1_i386.deb
< Accept-Ranges: bytes
< Content-Type: application/octet-stream
< Content-Length: 60151504
< Server: AmazonS3
< 
{ [16360 bytes data]
100 57.3M  100 57.3M    0     0  2212k      0  0:00:26  0:00:26 --:--:-- 2514k
* Connection #2 to host github-cloud.s3.amazonaws.com left intact
falkTX commented 7 years ago

Well, I can't really change something on my side to fix this... You see the packages themselves and the normal URLs don't have spaces.

Might be a problem in github too, or aws. But I fear that's out of my control.

If nothing gets resolved the only solution I have is to change hosting :(

norru commented 7 years ago

Oh, I see. Understandable. The bug is located somewhere in the boundary between github and apt - curl seems fine on its own.

Is there a browsable list of packages with their direct url I can download directly (as curl seems to work?) and install with dpkg? I tried to browse the folder on github but it doesn't allow it.

falkTX commented 7 years ago

There's a script in this repository to download all packages (but using wget). See https://github.com/KXStudio/Repository/blob/master/download-packages

If you close the repo you should be able to run it, perhaps modifying it to use curl.

norru commented 7 years ago

Cool, this should do somehow :)

I managed to download wineasio and install it, I think it's just a matter of finding the right filenames (which shouldn't be a problem given your script).

norru commented 7 years ago

This does it:

curl -s https://raw.githubusercontent.com/KXStudio/Repository/master/dists/stable/free/binary-amd64/Packages | grep Filename:
norru commented 7 years ago

Hello,

please see the quote below from one of the maintainers of the apt package. He suggests to contact GitHub directly. I have tried myself right now but I believe GitHub will want to hear from the affected projects directly.

No regression. The quick hack we can try for now is parsing the URI we get and then encoding the local part. This is what I'm aiming for this month and it will fix this issue.

The correct fix requires restructuring the whole acquire system to not decode URIs in redirect requests and encode given URIs before sending the request. Since APT is freezing down for Debian stretch soon, that's likely not going to happen anytime soon (that targets apt 1.5, so 17.10 or 18.04).
Julian Andres Klode (juliank) wrote 2 hours ago:    #20

Bah, I was not clear. Github apparently started adding spaces into their URI. That's what is causing this issue, it's not really a change in apt that is causing it. That said, the redirect handling changed a bit - https redirects used to be handled by curl itself prior to 1.3.
Changed in apt (Ubuntu):
assignee:   nobody → Julian Andres Klode (juliank) 
norru commented 7 years ago

I have contacted GitHub support and they've confirmed they're looking into the matter.

norru commented 7 years ago

FYI

Launchpad Bug Tracker 1651923@bugs.launchpad.net via https://support.google.com/mail/answer/1311182?hl=en-GB canonical.com 17:31 (57 minutes ago) to me This bug was fixed in the package apt - 1.3.4


apt (1.3.4) yakkety; urgency=medium

** Changed in: apt (Ubuntu Yakkety) Status: Fix Committed => Fix Released

** Changed in: apt (Ubuntu Xenial) Status: Fix Committed => Fix Released

-- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1651923

Title: apt https method decodes redirect locations and sends them to the destination undecoded.

Status in apt package in Ubuntu: Fix Released Status in apt source package in Xenial: Fix Released Status in apt source package in Yakkety: Fix Released

Launchpad Bug Tracker 1651923@bugs.launchpad.net via https://support.google.com/mail/answer/1311182?hl=en-GB canonical.com 17:40 (48 minutes ago) to me This bug was fixed in the package apt - 1.2.19


apt (1.2.19) xenial; urgency=medium

On 22 December 2016 at 21:55, Filipe Coelho notifications@github.com wrote:

There's a script in this repository to download all packages (but using wget). See https://github.com/KXStudio/Repository/blob/master/download-packages

If you close the repo you should be able to run it, perhaps modifying it to use curl.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/KXStudio/Repository/issues/73#issuecomment-268899191, or mute the thread https://github.com/notifications/unsubscribe-auth/AA2Ry7aNyv69nQ1iN-TgUXa5TQPI2JBlks5rKvG5gaJpZM4Ka9zv .

-- Cheers, Nico

falkTX commented 7 years ago

Closing this issue, bug fixed upstream. Thanks for all your help on this one.