composer / packagist

Package Repository Website - try https://packagist.com if you need your own -
https://packagist.org/
MIT License
1.74k stars 477 forks source link

GDATA antivirus corrupts downloads #847

Closed staabm closed 6 years ago

staabm commented 6 years ago

I get the warning of

The "http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json" file could not be downloaded: failed to open stream: HTTP request failed!
http://packagist.org could not be fully loaded, package information was loaded from the local cache and may be out of date

when updating the php-cs-fixer. re-doing the same command reproducible generates this error on my end.

$ composer global update friendsofphp/php-cs-fixer -vvv
Changed current directory to C:/Users/mstaab/AppData/Roaming/Composer
Reading ./composer.json
Loading config file ./composer.json
Checked CA file C:\Users\mstaab\AppData\Local\Temp\composer-cacert-e78c8ab7b4432bd466e64bb942d988f6c0ac91cd785017e465bdc96d42fe9dd0.pem: valid
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): git branch --no-color --no-abbrev -v
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): git describe --exact-match --tags
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): git log --pretty="%H" -n1 HEAD
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): hg branch
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): fossil branch list
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): fossil tag list
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): svn info --xml
Reading C:\Users\mstaab\AppData\Roaming\Composer/vendor/composer/installed.json
Running 1.5.6 (2017-12-18 12:09:18) with PHP 7.1.2 on Windows NT / 10.0
Reading ./composer.lock
Loading composer repositories with package information
Downloading https://packagist.org/packages.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/packages.json into cache
Updating dependencies (including require-dev)
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2013.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2014.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2015.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2016.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-01.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-04.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-07.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-10.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-archived.json from cache
Downloading http://packagist.org/p/provider-latest%2444c548f907e665cc0d09b9a239f6996d8e54c69fadb43661b4045ecebf860f21.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-latest.json into cache
Downloading http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json
Downloading http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json
Downloading http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$stopwatch.json from cache
The "http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json" file could not be downloaded: failed to open stream: HTTP request failed!
http://packagist.org could not be fully loaded, package information was loaded from the local cache and may be out of date
Downloading http://packagist.org/p/symfony/process%24494f4d740f511b9b14fb874c7a7441551d8a858540ca231bfd64c2fcf8f5b0b0.json
Downloading http://packagist.org/p/symfony/process%24494f4d740f511b9b14fb874c7a7441551d8a858540ca231bfd64c2fcf8f5b0b0.json
Downloading http://packagist.org/p/symfony/process%24494f4d740f511b9b14fb874c7a7441551d8a858540ca231bfd64c2fcf8f5b0b0.json
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$process.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$polyfill-php72.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-paragonie$random-compat.json from cache
Downloading http://packagist.org/p/symfony/polyfill-php70%2410e0b600838fd4796c4aafe7edfd6bbe8070712597abe479d4b7009e1453be55.json
Downloading http://packagist.org/p/symfony/polyfill-php70%2410e0b600838fd4796c4aafe7edfd6bbe8070712597abe479d4b7009e1453be55.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$polyfill-php70.json into cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$options-resolver.json from cache
Downloading http://packagist.org/p/symfony/finder%246bfe5a3e2ed814666f110530a0ebcadd989a5e518a30ee17197a1685fa08c974.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$finder.json into cache
Downloading http://packagist.org/p/symfony/filesystem%240ef110c6c30592a803c690de63deb8f59908c9cd4e19b4fd0f7ece3351692c81.json
Downloading http://packagist.org/p/symfony/filesystem%240ef110c6c30592a803c690de63deb8f59908c9cd4e19b4fd0f7ece3351692c81.json
Downloading http://packagist.org/p/symfony/filesystem%240ef110c6c30592a803c690de63deb8f59908c9cd4e19b4fd0f7ece3351692c81.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$filesystem.json into cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$event-dispatcher.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-psr$log.json from cache
Downloading http://packagist.org/p/symfony/debug%24066ee74f4078de5a31c1ae82a339f7b721f11e6571a457b27cb4acb647fd16b8.json
Downloading http://packagist.org/p/symfony/debug%24066ee74f4078de5a31c1ae82a339f7b721f11e6571a457b27cb4acb647fd16b8.json
Downloading http://packagist.org/p/symfony/debug%24066ee74f4078de5a31c1ae82a339f7b721f11e6571a457b27cb4acb647fd16b8.json
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$debug.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$polyfill-mbstring.json from cache
Downloading http://packagist.org/p/symfony/console%244cfd2ff973963baa935eb831cf337cd984a2d9c6118c1e295eb048c67de19ea7.json
Downloading http://packagist.org/p/symfony/console%244cfd2ff973963baa935eb831cf337cd984a2d9c6118c1e295eb048c67de19ea7.json
Downloading http://packagist.org/p/symfony/console%244cfd2ff973963baa935eb831cf337cd984a2d9c6118c1e295eb048c67de19ea7.json
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$console.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-php-cs-fixer$diff.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-gecko-packages$gecko-php-unit.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-doctrine$lexer.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-doctrine$annotations.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-composer$semver.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-nikic$php-parser.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-phan$phan.json from cache
Downloading http://packagist.org/p/friendsofphp/php-cs-fixer%246c3e543a23180de74b698419d3a6e66a70f23bef84933242334da2e889f3bc12.json
Downloading http://packagist.org/p/friendsofphp/php-cs-fixer%246c3e543a23180de74b698419d3a6e66a70f23bef84933242334da2e889f3bc12.json
Downloading http://packagist.org/p/friendsofphp/php-cs-fixer%246c3e543a23180de74b698419d3a6e66a70f23bef84933242334da2e889f3bc12.json
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-friendsofphp$php-cs-fixer.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-felixfbecker$advanced-json-rpc.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-sabre$event.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-netresearch$jsonmapper.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-phpdocumentor$reflection-docblock.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-phpdocumentor$reflection-common.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-phpdocumentor$type-resolver.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-webmozart$assert.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$dependency-injection.json from cache
Reading C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/provider-symfony$http-kernel.json from cache
Resolving dependencies through SAT
Dependency resolution completed in 0.023 seconds
Analyzed 3122 packages to resolve dependencies
Analyzed 35544 rules to resolve dependencies
Nothing to install or update
Reading C:\Users\mstaab\AppData\Roaming\Composer/vendor/composer/installed.json
Generating autoload files
$ php -v
PHP 7.1.2 (cli) (built: Feb 14 2017 21:24:45) ( NTS MSVC14 (Visual C++ 2015) x64 )
Copyright (c) 1997-2017 The PHP Group
Zend Engine v3.1.0, Copyright (c) 1998-2017 Zend Technologies

on windows10x64 latest update.

staabm commented 6 years ago

I cleared the composer cache and re-issued the commando. this time I get the error for a different package...

$ composer clear-cache
Cache directory does not exist (cache-vcs-dir):
Clearing cache (cache-repo-dir): C:\Users\mstaab\AppData\Local\Composer\repo
Clearing cache (cache-files-dir): C:\Users\mstaab\AppData\Local\Composer\files
Clearing cache (cache-dir): C:\Users\mstaab\AppData\Local\Composer
All caches cleared.

mstaab@COMPLEX-67 MINGW64 ~/Documents/GitHub/socket (phpcs)
$ composer global update friendsofphp/php-cs-fixer -vvv
Changed current directory to C:/Users/mstaab/AppData/Roaming/Composer
Reading ./composer.json
Loading config file ./composer.json
Checked CA file C:\Users\mstaab\AppData\Local\Temp\composer-cacert-e78c8ab7b4432bd466e64bb942d988f6c0ac91cd785017e465bdc96d42fe9dd0.pem: valid
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): git branch --no-color --no-abbrev -v
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): git describe --exact-match --tags
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): git log --pretty="%H" -n1 HEAD
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): hg branch
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): fossil branch list
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): fossil tag list
Executing command (C:\Users\mstaab\AppData\Roaming\Composer): svn info --xml
Reading C:\Users\mstaab\AppData\Roaming\Composer/vendor/composer/installed.json
Running 1.5.6 (2017-12-18 12:09:18) with PHP 7.1.2 on Windows NT / 10.0
Reading ./composer.lock
Loading composer repositories with package information
Downloading https://packagist.org/packages.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/packages.json into cache
Updating dependencies (including require-dev)
Downloading http://packagist.org/p/provider-2013%24c6a942a314c110f52ed7cec32739da97b57cdd11522fed9c2b8650c398c8ae5e.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2013.json into cache
Downloading http://packagist.org/p/provider-2014%249b8f5994f698c1dd785943431b161f12f29609459910ebb28d9b1488af3faccc.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2014.json into cache
Downloading http://packagist.org/p/provider-2015%2479653d2ffa23c6ede8fc8618c5482405a466cd5facbe3a9f523890732f04046e.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2015.json into cache
Downloading http://packagist.org/p/provider-2016%24c3b44edd842e3a8b85bb690b3b6095512aadf05d9d140b61769411140b482e25.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2016.json into cache
Downloading http://packagist.org/p/provider-2017-01%248f75f10ddf296889b548bd22ec7dec16a4ae38e27dacf1e7f9477a4e349af1da.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-01.json into cache
Downloading http://packagist.org/p/provider-2017-04%24ee2c4f1d888400fa4b0f9d567ffbabf18c3d6e3d79648926a67bb1018bc81d6f.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-04.json into cache
Downloading http://packagist.org/p/provider-2017-07%24a4b9bb2088f107d7d113a6fdd95e17f3467889d552845b66c6227f36a485f60d.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-07.json into cache
Downloading http://packagist.org/p/provider-2017-10%24be022055e48e1d387b6fec3729d3b1a59d08bc332a0a8745a24c9939fea245ec.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-2017-10.json into cache
Downloading http://packagist.org/p/provider-archived%24bfac74415588293cc70834fd89b2ea5e5fc7a98de3d2d827aa14183421c52815.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-archived.json into cache
Downloading http://packagist.org/p/provider-latest%24dd8047bda9be2e8726848c6ed78c76bcfabdf50306c9940584d7471c54a5f89a.json
Writing C:/Users/mstaab/AppData/Local/Composer/repo/https---packagist.org/p-provider-latest.json into cache
Downloading http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json
Downloading http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json
Downloading http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.json

  [Composer\Downloader\TransportException]
  The "http://packagist.org/p/symfony/stopwatch%248a1f224ce6b6ece086524c87206b4496c81bfa09e8fb0e1b8d2c55d94a818a9f.js
  on" file could not be downloaded: failed to open stream: HTTP request failed!

Exception trace:
 () at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Util/RemoteFilesystem.php:515
 Composer\Util\RemoteFilesystem->get() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Util/RemoteFilesystem.php:101
 Composer\Util\RemoteFilesystem->getContents() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Repository/ComposerRepository.php:664
 Composer\Repository\ComposerRepository->fetchFile() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Repository/ComposerRepository.php:339
 Composer\Repository\ComposerRepository->whatProvides() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/DependencyResolver/Pool.php:204
 Composer\DependencyResolver\Pool->computeWhatProvides() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/DependencyResolver/Pool.php:193
 Composer\DependencyResolver\Pool->whatProvides() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/DependencyResolver/RuleSetGenerator.php:168
 Composer\DependencyResolver\RuleSetGenerator->whitelistFromPackage() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/DependencyResolver/RuleSetGenerator.php:322
 Composer\DependencyResolver\RuleSetGenerator->getRulesFor() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/DependencyResolver/Solver.php:214
 Composer\DependencyResolver\Solver->solve() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Installer.php:472
 Composer\Installer->doInstall() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Installer.php:226
 Composer\Installer->run() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Command/UpdateCommand.php:159
 Composer\Command\UpdateCommand->execute() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/vendor/symfony/console/Command/Command.php:266
 Symfony\Component\Console\Command\Command->run() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/vendor/symfony/console/Application.php:861
 Symfony\Component\Console\Application->doRunCommand() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/vendor/symfony/console/Application.php:208
 Symfony\Component\Console\Application->doRun() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Console/Application.php:245
 Composer\Console\Application->doRun() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/vendor/symfony/console/Application.php:127
 Symfony\Component\Console\Application->run() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Console/Application.php:100
 Composer\Console\Application->run() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Command/GlobalCommand.php:84
 Composer\Command\GlobalCommand->run() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/vendor/symfony/console/Application.php:861
 Symfony\Component\Console\Application->doRunCommand() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/vendor/symfony/console/Application.php:208
 Symfony\Component\Console\Application->doRun() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Console/Application.php:245
 Composer\Console\Application->doRun() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/vendor/symfony/console/Application.php:127
 Symfony\Component\Console\Application->run() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/src/Composer/Console/Application.php:100
 Composer\Console\Application->run() at phar://C:/ProgramData/ComposerSetup/bin/composer.phar/bin/composer:54
 require() at C:\ProgramData\ComposerSetup\bin\composer.phar:24

update [--prefer-source] [--prefer-dist] [--dry-run] [--dev] [--no-dev] [--lock] [--no-custom-installers] [--no-autoloader] [--no-scripts] [--no-progress] [--no-suggest] [--with-dependencies] [-v|vv|vvv|--verbose] [-o|--optimize-autoloader] [-a|--classmap-authoritative] [--apcu-autoloader] [--ignore-platform-reqs] [--prefer-stable] [--prefer-lowest] [-i|--interactive] [--root-reqs] [--] [<packages>]...

I wonder whether this might be a antivirus/firewall issue on our end/workstation/network (not confirmed yet). wouldn't it make sense that the downloads from packagist.org word use https so intermediate proxies/gateways couldn't destroy the http requests/responses?

staabm commented 6 years ago

It turned out that it actually is the case that our "G DATA Security Client" does block some of the download urls of packagist.org.

not sure whether https would solve this concrete issue, but still I suggest to use https. wdyt?

Seldaek commented 6 years ago

Can't really be responsible for your antivirus, but you can force https by doing composer config -g repo.packagist.org composer https://packagist.org

staabm commented 6 years ago

Can't really be responsible for your antivirus

absolutely ;-)

you can force https

any plans on making https the default? couldn't composer downloads benefit from http2 via https?

Seldaek commented 6 years ago

This will probably change in the future but right now we wouldn't benefit with the current code and repository model.