search

DanMcInerney / xsscrapy

XSS spider - 66/66 wavsep XSS detected
1.66k stars 442 forks source link

Facing this issue while installing requirements.txt #60

Open spider8892 opened 3 years ago

spider8892 commented 3 years ago

ERROR: Command errored out with exit status 1: command: /usr/local/bin/python3.9 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-jzd70atp/pybloom_18079700ea8147b8921576e7f2418b13/setup.py'"'"'; file='"'"'/tmp/pip-install-jzd70atp/pybloom_18079700ea8147b8921576e7f2418b13/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-4mh1s55h cwd: /tmp/pip-install-jzd70atp/pybloom_18079700ea8147b8921576e7f2418b13/ Complete output (8 lines): Traceback (most recent call last): File "", line 1, in File "/tmp/pip-install-jzd70atp/pybloom_18079700ea8147b8921576e7f2418b13/setup.py", line 2, in from ez_setup import use_setuptools File "/tmp/pip-install-jzd70atp/pybloom_18079700ea8147b8921576e7f2418b13/ez_setup.py", line 98 except pkg_resources.VersionConflict, e: ^ SyntaxError: invalid syntax

WARNING: Discarding https://files.pythonhosted.org/packages/1a/82/a1ad015bdc19bd7e10aa97070329b84b5e01c0c6b5de88df664a98413eed/pybloom-1.1.tar.gz#sha256=f90903f2229135833a3ce115709662a4f4ea49bdfffc7d62a3061bd9021ac485 (from https://pypi.org/simple/pybloom/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output. ERROR: Could not find a version that satisfies the requirement pybloom==1.1 ERROR: No matching distribution found for pybloom==1.1

Mentsh commented 3 years ago

Here is your issue."/usr/local/bin/python3.9" XSScrapy is written with 2.7 python - install that version ( hint 2.7 and 3.* can live on the same system.) Then run it with 2.7

decidedlygray commented 3 years ago

@spider8892 please try the instructions I posted here - https://github.com/DanMcInerney/xsscrapy/issues/42#issuecomment-770297523

spider8892 commented 3 years ago

@spider8892 please try the instructions I posted here - #42 (comment)

Step 3 - Change our python to point to python2 is not working on my terminal

pyenv install 2.7.18 Command 'pyenv' not found, did you mean: command 'p7env' from deb libnss3-tools Try: apt install

decidedlygray commented 3 years ago

Something was missed with Step 1 - did you get any errors when installing pyenv? Please re-run the steps in Step 1. Also be sure to close your terminal and open a new one

imchiragprajapati commented 3 years ago

Please solve this last error

image

mmandlesara14 commented 3 years ago

please solve this error. /usr/share/offsec-awae-wheels/pyOpenSSL-19.1.0-py2.py3-none-any.whl/OpenSSL/crypto.py:12: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is now deprecated in cryptography, and will be removed in the next release. 2021-06-30 03:14:39 [scrapy.utils.log] INFO: Scrapy 1.8.0 started (bot: xsscrapy) 2021-06-30 03:14:39 [scrapy.utils.log] INFO: Versions: lxml 4.6.3.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.6.0, w3lib 1.22.0, Twisted 16.6.0, Python 2.7.18 (default, Apr 28 2021, 17:39:59) - [GCC 10.2.1 20210110], pyOpenSSL 19.1.0 (OpenSSL 1.1.1i 8 Dec 2020), cryptography 3.3.2, Platform Linux-5.9.0-kali1-amd64-x86_64-with-debian-kali-rolling 2021-06-30 03:14:39 [scrapy.crawler] INFO: Overridden settings: {'NEWSPIDER_MODULE': 'xsscrapy.spiders', 'DUPEFILTER_CLASS': 'xsscrapy.bloomfilters.BloomURLDupeFilter', 'SPIDER_MODULES': ['xsscrapy.spiders'], 'CONCURRENT_REQUESTS': '30', 'BOT_NAME': 'xsscrapy', 'DOWNLOAD_DELAY': '0'} 2021-06-30 03:14:39 [scrapy.extensions.telnet] INFO: Telnet Password: 7c274c008e63de61 2021-06-30 03:14:39 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.corestats.CoreStats'] Unhandled error in Deferred: 2021-06-30 03:14:39 [twisted] CRITICAL: Unhandled error in Deferred:

2021-06-30 03:14:39 [twisted] CRITICAL: Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1299, in _inlineCallbacks result = g.send(result) File "/usr/local/lib/python2.7/dist-packages/scrapy/crawler.py", line 104, in crawl six.reraise(*exc_info) File "/usr/local/lib/python2.7/dist-packages/scrapy/crawler.py", line 86, in crawl self.engine = self._create_engine() File "/usr/local/lib/python2.7/dist-packages/scrapy/crawler.py", line 111, in _createengine return ExecutionEngine(self, lambda : self.stop()) File "/usr/local/lib/python2.7/dist-packages/scrapy/core/engine.py", line 67, in init self.scheduler_cls = load_object(self.settings['SCHEDULER']) File "/usr/local/lib/python2.7/dist-packages/scrapy/utils/misc.py", line 46, in load_object mod = import_module(module) File "/usr/lib/python2.7/importlib/init.py", line 37, in import_module import(name) File "/usr/local/lib/python2.7/dist-packages/scrapy/core/scheduler.py", line 7, in from queuelib import PriorityQueue File "/usr/local/lib/python2.7/dist-packages/queuelib/init.py", line 1, in from queuelib.queue import FifoDiskQueue, LifoDiskQueue File "/usr/local/lib/python2.7/dist-packages/queuelib/queue.py", line 7, in from contextlib import suppress ImportError: cannot import name suppress

imchiragprajapati commented 3 years ago

The modules are removes by the pip So, from now onwords we can't use xsscrapy.

Same issue was faced by me

mmandlesara14 commented 3 years ago

thank you bro

mmandlesara14 commented 3 years ago

@ImPRINCE99 can u please share what do u tool used right now ? because this tool is shit i tried so many time but didnt use any where

imchiragprajapati commented 3 years ago

See I suggest you to do Manual hunting. By hunting Manually I am getting 20 XSS per day. And when I was using scrapy It was like 5 XSS per day

mmandlesara14 commented 3 years ago

@ImPRINCE99 is it a tool of kali (scrapy)?

imchiragprajapati commented 3 years ago

I mean Xsscrapy

decidedlygray commented 3 years ago

@mmandlesara Please refrain from using profanity when referring to a project that has been provided to you for FREE, and has been built using the time of volunteers. In other words: maybe instead of calling this tool "shit", you go out and learn some "shit" and submit a patch to fix what you're unhappy with.

Both @mmandlesara and @ImPRINCE99 - Create a new issue for any problems, don't hijack existing threads.

Also @ImPRINCE99 - you can use xsscrapy with python3 - this has been addressed in other threads. There are open PRs for the conversion to Python3 you could use.

Cheers