search

BlackArch / blackarch

An ArchLinux based distribution for penetration testers and security researchers.
https://www.blackarch.org
Other
2.83k stars 571 forks source link

[corrupt packages] #1592

Closed ogardatadude closed 7 years ago

ogardatadude commented 7 years ago

Installing to arch, blackarch-webapp keep running into error on same two packages..

error: scrapy: signature from "redacted" is invalid :: File /var/cache/pacman/pkg/scrapy-1.3.3-1-any.pkg.tar.xz is corrupted (invalid or corrupted package (PGP signature)). Do you want to delete it? [Y/n] n error: sqlmap: signature from "redacted" is invalid :: File /var/cache/pacman/pkg/sqlmap-1.1.3-1-any.pkg.tar.xz is corrupted (invalid or corrupted package (PGP signature)).

noptrix commented 7 years ago

yes | pacman -Scc && pacman -Syyu ?

teixeiras commented 7 years ago

Same issue here... didn't fix the recommended command

noptrix commented 7 years ago

which mirror have you got?

ogardatadude commented 7 years ago

yes I have tried clearing the cache and up updated with the very same commands you suggest but still the issues...

As far as mirrors, I have tried multiple.

  1. using the mirror list when installing from the script strap.sh
  2. tried installing blackarch-mirrorlist package and pointing to it in the pacman.conf file, even uncommented all US and Canada sites for proximity

Always ended up with the same result, also tried with curl uncommented, that resulted in the more detailed errors I posted above

NovaCygni commented 7 years ago

Just double-checked and confirm: [blackarch]

SigLevel = Optional TrustAll Server = http://blackarch.pi3rrot.net/blackarch/$repo/os/$arch

Works perfectly fine...

noptrix commented 7 years ago

@teixeiras and @ogardatadude can you ignore those packages: --ignore scrapy sqlmap and retry?

noptrix commented 7 years ago

unfortunately, we can't reproduce your errors ... that's why you should always post information as much as possible

ogardatadude commented 7 years ago

@NovaCygni

I am not sure how perfectly fine works when the are this many files not found....

:: Retrieving packages... error: failed retrieving file '0d1n-198.2c15fbe-2-x86_64.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'adfind-19.8d62713-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'arachni-1.5.1-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'atscan-1510.0303706-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'bbscan-34.490ad74-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'burpsuite-1.7.19-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'cangibrina-118.acf96c4-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'cansina-1:169.593934c-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'chankro-3.c150607-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'cintruder-5.8b656d4-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python2-cfscrape-89.ce2fffd-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'commix-806.d7d0d90-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'cybercrowl-87.26bef0f-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'dirsearch-196.5914f02-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-tqdm-4.11.2-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-tabulate-0.7.7-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-multidict-2.1.4-2-x86_64.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-yarl-0.10.0-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-async_timeout-1.2.0-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-aiohttp-2.0.3-4-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-inflect-0.2.5-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'domi-owned-41.583d0a5-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'droopescan-1.36.0-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'eyewitness-597.5723751-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'gittools-19.6705a96-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files golismero-50.3af264... 14.7 MiB 2.76M/s 00:05 [######################] 100% error: failed retrieving file 'httppwnly-47.528a664-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'jexboss-86.338b531-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'joomlavs-230.e26b637-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'lbmap-147.2d15ace-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python2-jsbeautifier-1.6.12-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'plecost-88.149fd34-8-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'pyfiscan-1883.de83802-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python2-speechrecognition-3.5.0-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : Operation too slow. Less than 1 bytes/sec transferred the last 10 seconds warning: failed to retrieve some files error: failed retrieving file 'pythem-347.db51149-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'python-jsbeautifier-1.6.12-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'ruler-139.ae099a4-1-x86_64.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'scrapy-1.3.3-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'snuck-6.76196b6-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : Operation too slow. Less than 1 bytes/sec transferred the last 10 seconds warning: failed to retrieve some files error: failed retrieving file 'spiga-1:437.f884137-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'sqlmap-1.1.3-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'tplmap-641.8b61de5-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'ufonet-27.a1caa70-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'vega-1.0-8-x86_64.pkg.tar.xz' from blackarch.pi3rrot.net : Operation too slow. Less than 1 bytes/sec transferred the last 10 seconds warning: failed to retrieve some files error: failed retrieving file 'python2-xdot-0.7-6-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'w3af-1.6.49-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : Operation too slow. Less than 1 bytes/sec transferred the last 10 seconds warning: failed to retrieve some files error: failed retrieving file 'waffit-152.b9dd2e2-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files webscarab-20120422.... 12.4 MiB 2.61M/s 00:05 [######################] 100% error: failed retrieving file 'weevely-709.0a3b03f-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'wfuzz-56.153e55f-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'ruby-require_all-1.4.0-2-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'ruby-slop-4.4.1-5-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'wordpress-exploit-framework-555.384bda5-4-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'wpbrute-rpc-3.e7d8145-5-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'wuzz-173.93274c1-1-x86_64.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'xsspy-48.1067664-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'xwaf-118.9525e85-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'yawast-410.06a42b6-1-x86_64.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed retrieving file 'zaproxy-2.6.0-1-any.pkg.tar.xz' from blackarch.pi3rrot.net : The requested URL returned error: 404 warning: failed to retrieve some files error: failed to commit transaction (unexpected error) Errors occurred, no packages were upgraded.

NovaCygni commented 7 years ago 

Package (1)        Old Version  New Version  Net Change

blackarch/arachni  1.5-3        1.5-3          0.00 MiB

Total Installed Size:  8.46 MiB
Net Upgrade Size:      0.00 MiB

:: Proceed with installation? [Y/n] y
(1/1) checking keys in keyring                     [######################] 100%
(1/1) checking package integrity                   [######################] 100%
(1/1) loading package files                        [######################] 100%
(1/1) checking for file conflicts                  [######################] 100%
:: Processing package changes...
(1/1) reinstalling arachni                         [######################] 100%

That exact repo, right now, has all of those files in, and is working fine, I would suggest changing your pacman.conf file section for Blackarch to:

[blackarch]
Server = https://www.blackarch.org/blackarch/$repo/os/$arch
Server = http://blackarch.tamcore.eu/$repo/os/$arch
Server = http://blackarch.pi3rrot.net/blackarch/$repo/os/$arch
Server = http://blackarch.leneveu.fr/blackarch/$repo/os/$arch
SigLevel = TrustedOnly
ghost commented 7 years ago

I am having the same problem, even after clearing pacman's cache, using blackarch.org as my primary mirror and the mirrors @NovaCygni suggested. I need scrapy & sqlmap to work for me so ignoring it is no option for me.Any help would be appreciated.

I'm running a fresh Arch install if that helps.

EDIT: I ignored scrapy & sqlmap and after that installed it through the AUR and from source later. BUt this is an issue that still causes a little inconvenience ;)

-Phoenix750

noptrix commented 7 years ago

@Phoenix750 you can ignore and then later simply do: pacman -S sqlmap scrapy

Torxed commented 7 years ago

On a fresh Arch installation (only slight change was that i enabled multilib):

> sudo pacman -S blackarch
*downloading a shit ton of packages, all well*
error: failed to commit transaction (unexpected error)
Errors occured, no packages were upgraded.
> sudo pacman -S blackarch
:: Retrieving packages...
error: failed retrieving file 'sqlmap-1.1.3-1-any.pkg.tar.xz' from mirror.zetup.net : Maximum file size exceeded.
error: failed retrieving file scrapy-1.3.3-1-any.pkg.tar.xz' from mirror.zetup.net : Maximum file size exceeded.

What's the reason for this? Found a similar problem from back in 2014 on the official forum: https://bbs.archlinux.org/viewtopic.php?id=184864

Not sure it's even slightly related tho.

Using mirror:

[blackarch]
http://mirror.zetup.net/blackarch/$repo/os/$arch

Also tried:

[blackarch]
SigLevel = Optional TrustAll
Server = http://blackarch.pi3rrot.net/blackarch/$repo/os/$arch

Same result. (Also trying sudo pacman -S blackarch --ignore scrapy sqlmap, waiting for result on that one but i need to save this post before i fall asleep trying to solve this)

NovaCygni commented 7 years ago

sudo pacman -S blackarch --ignore scrapy --ignore sqlmap && sudo pacman -S yaourt && yaourt -S sqlmap scrapy Dead/Faulty mirror, its been like it for a couple months now but it (the issue) is easily fixed/sorted.

Torxed commented 7 years ago

It still bugs out but later this time. I get The warning at the start saying:

scrapy is in IgnoreRpk/IgnoreGroup. Install anyway?
sqlmap is in IgnoreRpk/IgnoreGroup. Install anyway?

To which i reply "n" to skip them. It downloads everything nicely and does the

(3160/3160) checking package integrity
(3160/3160) checking file conflicts
/usr/bin/frida-* exists in both 'python2-frida' and 'frida' (three different but same issue)

/usr/lib/ruby/gems/2.0/... exists in both 'ruby-colorize' and 'yawast'
(i get roughly 40 collisions of different gems)
NovaCygni commented 7 years ago

Gonna suggest, throw in the --force switch, but do not start taking it for "Casual" usage, in this scenario its fine to use, itll make 0 difference to the installed packages and theyll all install and work fine, its sadly one of the issues I did try raising with the pacman people ( idiotic or pointless messages, ie, "File owned by x is also owned by y and z" and "x package is newer than y package" ). Ps> Once yourve installed it you can "Tidy up" this issue, simply do a "gem update" and your good to go.

Torxed commented 7 years ago

@NovaCygni Worked like a charm!

sudo pacman --force -S blackarch --ignore scrapy --ignore sqlmap && sudo pacman -S yaourt && yaourt -S sqlmap scrapy

Works perfectly. Major inconvenience for new users but if they find this thread it's an easy fix. Big thank you!

PedroSFreitas commented 7 years ago

Worked like a charm!

Closing, @ogardatadude and @Torxed: If you think it's a mistake to close this issue, you can reopen and provide further information.

Thanks.

ZeyadMoustafaKamal commented 3 months ago

Hi. I am from 2024 and there is not force option. also the overwrite option doesn't seem to work for this. what to do now ??

Torxed commented 3 months ago

Hi. I am from 2024 and there is not force option. also the overwrite option doesn't seem to work for this. what to do now ??

If you're using pacman, for sure there's a --force option. The overwrite should be there too. Otherwise we have major issues with pacman

What does your error output look like?