search

kennbroorg / iKy

OSINT Project. Collect information from a mail. Gather. Profile. Timeline.
https://kennbroorg.gitlab.io/ikyweb/
GNU General Public License v3.0
831 stars 149 forks source link

iKy stops after submitting email to gatherer #86

Closed HappyMiner closed 1 year ago

HappyMiner commented 2 years ago

Feedback First, thanks for actually taking the time and writing a documentation on how to install and use your project. Seems quite uncommon these days!

Config MacOS 10.15.7 Catalina Tried on browsers: Firefox 100.0.1 (64-bit) (Adblockers off) Brave [Version 1.38.119 Chromium: 101.0.4951.67 (Official Build) (x86_64)] (no ad on active) Safari Version 15.4 (15613.1.17.1.13, 15613) (no mods)

Steps undertaken

Issue After submitting an email address (test@test.com) in the gatherer, I can see that apparently queries are run on twitch etc. The notifications appear as can be seen in the demo videos, on the right hand side of the screen. The notifications disappear, the green bar on top of the screen reaches the right side and then nothing happens anymore.

In the Firefox console (developer tools) I can see: Uncaught ReferenceError: exports is not defined

http://127.0.0.1:4200/scripts.js:143 Angular is running in the development mode. Call enableProdMode() to enable the production mode. Source map error: Error: request failed with status 404 Resource URL: http://127.0.0.1:4200/scripts.js Source Map URL: jspdf.node.min.js.map Use of drawWindow method from CanvasRenderingContext2D is deprecated. Use tabs.captureTab extensions API instead https://developer.mozilla.org/docs/Mozilla/Add-ons/WebExtensions/API/tabs/captureTab [pagedata-script.js:1:12465](moz-extension://233111cc-175d-fa45-abd1-8b08e8b34cfc/content/pagedata-script.js) Header Component [header.component.ts:25:14](webpack:///src/app/@theme/components/header/header.component.ts) Error in parsing value for ‘max-height’. Declaration dropped. [127.0.0.1:4200:168:42](http://127.0.0.1:4200/) Error in parsing value for ‘margin-top’. Declaration dropped. [127.0.0.1:4200:197:23](http://127.0.0.1:4200/) Error in parsing value for ‘margin-bottom’. Declaration dropped. [127.0.0.1:4200:198:26](http://127.0.0.1:4200/) Error in parsing value for ‘max-height’. Declaration dropped. [127.0.0.1:4200:373:42](http://127.0.0.1:4200/) Error in parsing value for ‘margin-top’. Declaration dropped. [127.0.0.1:4200:402:23](http://127.0.0.1:4200/) Error in parsing value for ‘margin-bottom’. Declaration dropped. [127.0.0.1:4200:403:26](http://127.0.0.1:4200/) Error in parsing value for ‘max-height’. Declaration dropped. [127.0.0.1:4200:578:42](http://127.0.0.1:4200/) Error in parsing value for ‘margin-top’. Declaration dropped. [127.0.0.1:4200:607:23](http://127.0.0.1:4200/) Error in parsing value for ‘margin-bottom’. Declaration dropped. [127.0.0.1:4200:608:26](http://127.0.0.1:4200/) Error in parsing value for ‘max-height’. Declaration dropped. [127.0.0.1:4200:783:42](http://127.0.0.1:4200/) Error in parsing value for ‘margin-top’. Declaration dropped. [127.0.0.1:4200:812:23](http://127.0.0.1:4200/) Error in parsing value for ‘margin-bottom’. Declaration dropped. [127.0.0.1:4200:813:26](http://127.0.0.1:4200/) Error in parsing value for ‘max-height’. Declaration dropped. [127.0.0.1:4200:988:42](http://127.0.0.1:4200/) Error in parsing value for ‘margin-top’. Declaration dropped. [127.0.0.1:4200:1017:23](http://127.0.0.1:4200/) Error in parsing value for ‘margin-bottom’. Declaration dropped. [127.0.0.1:4200:1018:26](http://127.0.0.1:4200/) GathererComponent ngOnInit [gatherer.component.ts:94:16](webpack:///src/app/pages/gatherer/gatherer.component.ts) dataService Pull globalGather : Object { } [data-gather-info.service.ts:50:16](webpack:///src/app/@core/data/data-gather-info.service.ts) GathererComponent ngOnInit Object { } [gatherer.component.ts:97:16](webpack:///src/app/pages/gatherer/gatherer.component.ts) GathererComponent ngOnInit length 0 [gatherer.component.ts:98:16](webpack:///src/app/pages/gatherer/gatherer.component.ts) dataService Initialize globalGather : Object { } [data-gather-info.service.ts:40:16](webpack:///src/app/@core/data/data-gather-info.service.ts) Global data initialize Object { } [gatherer.component.ts:88:20](webpack:///src/app/pages/gatherer/gatherer.component.ts) Search Object { term: "test@test.com", tag: undefined } [gatherer.component.ts:90:20](webpack:///src/app/pages/gatherer/gatherer.component.ts) validateEmail func test@test.com [data-gather-info.service.ts:118:16](webpack:///src/app/@core/data/data-gather-info.service.ts) dataService Push globalGather : Object { email: "test@test.com" } [data-gather-info.service.ts:46:16](webpack:///src/app/@core/data/data-gather-info.service.ts) Username : test [data-gather-info.service.ts:151:16](webpack:///src/app/@core/data/data-gather-info.service.ts) XHRGEThttp://127.0.0.1:5000/tasklist XHROPTIONShttp://127.0.0.1:5000/emailrep XHROPTIONShttp://127.0.0.1:5000/leaklookup XHROPTIONShttp://127.0.0.1:5000/dorks XHROPTIONShttp://127.0.0.1:5000/search XHROPTIONShttp://127.0.0.1:5000/sherlock XHROPTIONShttp://127.0.0.1:5000/fullcontact XHROPTIONShttp://127.0.0.1:5000/holehe XHROPTIONShttp://127.0.0.1:5000/github XHROPTIONShttp://127.0.0.1:5000/peopledatalabs XHROPTIONShttp://127.0.0.1:5000/keybase XHROPTIONShttp://127.0.0.1:5000/darkpass XHROPTIONShttp://127.0.0.1:5000/leaks XHROPTIONShttp://127.0.0.1:5000/socialscan XHROPTIONShttp://127.0.0.1:5000/tiktok XHROPTIONShttp://127.0.0.1:5000/reddit XHROPTIONShttp://127.0.0.1:5000/tinder XHROPTIONShttp://127.0.0.1:5000/venmo XHROPTIONShttp://127.0.0.1:5000/twitch XHROPTIONShttp://127.0.0.1:5000/spotify **Expected outcome** After submitting the email address in the gatherer, according to the demo videos we should see a result in the main screen (social graph and such or an error message if nothing is found at all). **Outputs while running** 1. **Installation** (venv) MAC:iKy-pack User$ pip install -r requirements.txt Collecting yagooglesearch Cloning https://github.com/KennBro/yagooglesearch.git (to revision origin/add-output-param) to /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/yagooglesearch_45a0d150014d46da8f059e390668a4ca Running command git clone --filter=blob:none --quiet https://github.com/KennBro/yagooglesearch.git /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/yagooglesearch_45a0d150014d46da8f059e390668a4ca WARNING: Did not find branch or tag 'origin/add-output-param', assuming revision or ref. Running command git checkout -q origin/add-output-param Resolved https://github.com/KennBro/yagooglesearch.git to commit origin/add-output-param Preparing metadata (setup.py) ... done Collecting search-engine-parser Cloning https://github.com/KennBro/search-engine-parser.git (to revision origin/master) to /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/search-engine-parser_e2b5ad81c8ab45678253d35eca362c91 Running command git clone --filter=blob:none --quiet https://github.com/KennBro/search-engine-parser.git /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-install-v47f0obc/search-engine-parser_e2b5ad81c8ab45678253d35eca362c91 WARNING: Did not find branch or tag 'origin/master', assuming revision or ref. Running command git checkout -q origin/master Resolved https://github.com/KennBro/search-engine-parser.git to commit origin/master Preparing metadata (setup.py) ... done Collecting chardet==3.0.4 Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB) Collecting aiohttp==3.7.4 Using cached aiohttp-3.7.4-cp39-cp39-macosx_10_14_x86_64.whl (649 kB) Collecting beautifulsoup4==4.9.3 Using cached beautifulsoup4-4.9.3-py3-none-any.whl (115 kB) Collecting httpx==0.13.3 Using cached httpx-0.13.3-py3-none-any.whl (55 kB) Collecting Flask==2.1.2 Using cached Flask-2.1.2-py3-none-any.whl (95 kB) Collecting celery==4.4.5 Using cached celery-4.4.5-py2.py3-none-any.whl (426 kB) Collecting Flask-Cors==3.0.9 Using cached Flask_Cors-3.0.9-py2.py3-none-any.whl (14 kB) Collecting requests==2.27.0 Using cached requests-2.27.0-py2.py3-none-any.whl (63 kB) Collecting bs4==0.0.1 Using cached bs4-0.0.1-py3-none-any.whl Collecting cfscrape==2.1.1 Using cached cfscrape-2.1.1-py3-none-any.whl (12 kB) Collecting tweepy==4.5.0 Using cached tweepy-4.5.0-py2.py3-none-any.whl (66 kB) Collecting geopy==1.22.0 Using cached geopy-1.22.0-py2.py3-none-any.whl (113 kB) Collecting socialscan==1.4.2 Using cached socialscan-1.4.2-py3-none-any.whl (21 kB) Collecting instaloader==4.8.1 Using cached instaloader-4.8.1-py3-none-any.whl Collecting requests-futures==1.0.0 Using cached requests_futures-1.0.0-py2.py3-none-any.whl (7.4 kB) Collecting torrequest Using cached torrequest-0.1.0-py3-none-any.whl Collecting holehe==1.60.2 Using cached holehe-1.60.2-py3-none-any.whl (138 kB) Collecting fuzzywuzzy==0.18.0 Using cached fuzzywuzzy-0.18.0-py2.py3-none-any.whl (18 kB) Collecting redis==3.5.3 Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB) Collecting langdetect==1.0.8 Using cached langdetect-1.0.8-py3-none-any.whl Collecting googletrans==3.0.0 Using cached googletrans-3.0.0-py3-none-any.whl Collecting vaderSentiment==3.3.2 Using cached vaderSentiment-3.3.2-py2.py3-none-any.whl (125 kB) Collecting emailrep==0.0.4 Using cached emailrep-0.0.4-py3-none-any.whl (6.3 kB) Collecting stop_words Using cached stop_words-2018.7.23-py3-none-any.whl Collecting spotipy==2.16.1 Using cached spotipy-2.16.1-py3-none-any.whl (24 kB) Collecting twitch-python Using cached twitch_python-0.0.20-py3-none-any.whl (30 kB) Collecting parse Using cached parse-1.19.0-py3-none-any.whl Collecting browser-cookie3 Using cached browser_cookie3-0.14.1-py3-none-any.whl (10 kB) Collecting google-api-python-client==2.33.0 Using cached google_api_python_client-2.33.0-py2.py3-none-any.whl (7.9 MB) Collecting multidict<7.0,>=4.5 Using cached multidict-6.0.2-cp39-cp39-macosx_10_9_x86_64.whl (28 kB) Collecting yarl<2.0,>=1.0 Using cached yarl-1.7.2-cp39-cp39-macosx_10_9_x86_64.whl (121 kB) Collecting attrs>=17.3.0 Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB) Collecting typing-extensions>=3.6.5 Using cached typing_extensions-4.2.0-py3-none-any.whl (24 kB) Collecting async-timeout<4.0,>=3.0 Using cached async_timeout-3.0.1-py3-none-any.whl (8.2 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB) Collecting certifi Using cached certifi-2022.5.18-py3-none-any.whl (155 kB) Collecting hstspreload Using cached hstspreload-2021.12.1-py3-none-any.whl (1.3 MB) Collecting httpcore==0.9.* Using cached httpcore-0.9.1-py3-none-any.whl (42 kB) Collecting sniffio Using cached sniffio-1.2.0-py3-none-any.whl (10 kB) Collecting rfc3986<2,>=1.3 Using cached rfc3986-1.5.0-py2.py3-none-any.whl (31 kB) Collecting idna==2.* Using cached idna-2.10-py2.py3-none-any.whl (58 kB) Collecting importlib-metadata>=3.6.0 Using cached importlib_metadata-4.11.3-py3-none-any.whl (18 kB) Collecting Werkzeug>=2.0 Using cached Werkzeug-2.1.2-py3-none-any.whl (224 kB) Collecting Jinja2>=3.0 Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB) Collecting itsdangerous>=2.0 Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB) Collecting click>=8.0 Using cached click-8.1.3-py3-none-any.whl (96 kB) Collecting pytz>dev Using cached pytz-2022.1-py2.py3-none-any.whl (503 kB) Collecting future>=0.18.0 Using cached future-0.18.2-py3-none-any.whl Collecting billiard<4.0,>=3.6.3.0 Using cached billiard-3.6.4.0-py3-none-any.whl (89 kB) Collecting kombu<4.7,>=4.6.10 Using cached kombu-4.6.11-py2.py3-none-any.whl (184 kB) Collecting vine==1.3.0 Using cached vine-1.3.0-py2.py3-none-any.whl (14 kB) Collecting Six Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB) Collecting requests-oauthlib<2,>=1.0.0 Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting geographiclib<2,>=1.49 Using cached geographiclib-1.52-py3-none-any.whl (38 kB) Collecting colorama Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB) Collecting tqdm>=4.31.0 Using cached tqdm-4.64.0-py2.py3-none-any.whl (78 kB) Collecting termcolor Using cached termcolor-1.1.0-py3-none-any.whl Collecting trio Using cached trio-0.20.0-py3-none-any.whl (359 kB) Collecting argparse Using cached argparse-1.4.0-py2.py3-none-any.whl (23 kB) Collecting python-dateutil Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) Collecting PySocks Using cached PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting google-api-core<3.0.0dev,>=1.21.0 Using cached google_api_core-2.8.0-py3-none-any.whl (114 kB) Collecting httplib2<1dev,>=0.15.0 Using cached httplib2-0.20.4-py3-none-any.whl (96 kB) Collecting google-auth-httplib2>=0.1.0 Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB) Collecting google-auth<3.0.0dev,>=1.16.0 Using cached google_auth-2.6.6-py2.py3-none-any.whl (156 kB) Collecting uritemplate<5,>=3.0.0 Using cached uritemplate-4.1.1-py2.py3-none-any.whl (10 kB) Collecting h2==3.* Using cached h2-3.2.0-py2.py3-none-any.whl (65 kB) Collecting h11<0.10,>=0.8 Using cached h11-0.9.0-py2.py3-none-any.whl (53 kB) Collecting hpack<4,>=3.0 Using cached hpack-3.0.0-py2.py3-none-any.whl (38 kB) Collecting hyperframe<6,>=5.2.0 Using cached hyperframe-5.2.0-py2.py3-none-any.whl (12 kB) Collecting requests[socks] Using cached requests-2.27.1-py2.py3-none-any.whl (63 kB) Collecting stem>=1.4.0 Using cached stem-1.8.0-py3-none-any.whl Collecting lxml==4.6.3 Using cached lxml-4.6.3-cp39-cp39-macosx_10_9_x86_64.whl (4.6 MB) Collecting fake-useragent==0.1.11 Using cached fake_useragent-0.1.11-py3-none-any.whl Collecting rx>=3.0.0 Using cached Rx-3.2.0-py3-none-any.whl (199 kB) Collecting pyaes Using cached pyaes-1.6.1-py3-none-any.whl Collecting lz4 Using cached lz4-4.0.0-cp39-cp39-macosx_10_9_x86_64.whl (90 kB) Collecting SecretStorage Using cached SecretStorage-3.3.2-py3-none-any.whl (15 kB) Collecting keyring Using cached keyring-23.5.0-py3-none-any.whl (33 kB) Collecting pycryptodome Using cached pycryptodome-3.14.1-cp35-abi3-macosx_10_9_x86_64.whl (1.5 MB) Collecting pbkdf2 Using cached pbkdf2-1.3-py3-none-any.whl Collecting googleapis-common-protos<2.0dev,>=1.52.0 Using cached googleapis_common_protos-1.56.1-py2.py3-none-any.whl (211 kB) Collecting protobuf>=3.12.0 Using cached protobuf-3.20.1-cp39-cp39-macosx_10_9_x86_64.whl (962 kB) Collecting pyasn1-modules>=0.2.1 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting rsa<5,>=3.1.4 Using cached rsa-4.8-py3-none-any.whl (39 kB) Collecting cachetools<6.0,>=2.0.0 Using cached cachetools-5.1.0-py3-none-any.whl (9.2 kB) Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB) Collecting zipp>=0.5 Using cached zipp-3.8.0-py3-none-any.whl (5.4 kB) Collecting MarkupSafe>=2.0 Using cached MarkupSafe-2.1.1-cp39-cp39-macosx_10_9_x86_64.whl (13 kB) Collecting amqp<2.7,>=2.6.0 Using cached amqp-2.6.1-py2.py3-none-any.whl (48 kB) Collecting oauthlib>=3.0.0 Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB) Collecting jeepney>=0.6 Using cached jeepney-0.8.0-py3-none-any.whl (48 kB) Collecting cryptography>=2.0 Using cached cryptography-37.0.2-cp36-abi3-macosx_10_10_x86_64.whl (2.8 MB) Collecting outcome Using cached outcome-1.1.0-py2.py3-none-any.whl (9.7 kB) Collecting async-generator>=1.9 Using cached async_generator-1.10-py3-none-any.whl (18 kB) Collecting sortedcontainers Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting cffi>=1.12 Using cached cffi-1.15.0-cp39-cp39-macosx_10_9_x86_64.whl (178 kB) Collecting pyasn1<0.5.0,>=0.4.6 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pycparser Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Building wheels for collected packages: yagooglesearch, search-engine-parser Building wheel for yagooglesearch (setup.py) ... done Created wheel for yagooglesearch: filename=yagooglesearch-1.6.0-py3-none-any.whl size=21156 sha256=c50dd87da90c342318b76880e3ddfc248304fb9fb8bd986034e8d3a9514de885 Stored in directory: /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-ephem-wheel-cache-dgxrop_6/wheels/a4/37/83/ae019cec936bec826575dbac8ac111df1481d3c45d2583dbbe Building wheel for search-engine-parser (setup.py) ... done Created wheel for search-engine-parser: filename=search_engine_parser-0.6.3-py3-none-any.whl size=37791 sha256=6a873e6307f8de3befe5392d34dc2e63f935e2d7012cdd83a20c271bd3747efc Stored in directory: /private/var/folders/jt/t76_6q7131154tsf02l2hr2r0000gn/T/pip-ephem-wheel-cache-dgxrop_6/wheels/86/18/9c/ba539308ab34dcf6f3e7b171a9403bbf0cbd04cdc13fd71df2 Successfully built yagooglesearch search-engine-parser Installing collected packages: termcolor, stop_words, stem, sortedcontainers, rfc3986, pytz, pyasn1, pyaes, pbkdf2, parse, hyperframe, hpack, h11, geographiclib, fuzzywuzzy, fake-useragent, chardet, billiard, argparse, zipp, Werkzeug, vine, urllib3, uritemplate, typing-extensions, tqdm, soupsieve, sniffio, Six, rx, rsa, redis, PySocks, pyparsing, pycryptodome, pycparser, pyasn1-modules, protobuf, oauthlib, multidict, MarkupSafe, lz4, lxml, jeepney, itsdangerous, idna, hstspreload, h2, geopy, future, colorama, click, charset-normalizer, certifi, cachetools, attrs, async-timeout, async-generator, yarl, requests, python-dateutil, outcome, langdetect, Jinja2, importlib-metadata, httplib2, httpcore, googleapis-common-protos, google-auth, cffi, beautifulsoup4, amqp, vaderSentiment, twitch-python, trio, torrequest, spotipy, requests-oauthlib, requests-futures, kombu, keyring, instaloader, httpx, google-auth-httplib2, google-api-core, Flask, emailrep, cryptography, cfscrape, bs4, aiohttp, yagooglesearch, tweepy, socialscan, SecretStorage, search-engine-parser, holehe, googletrans, google-api-python-client, Flask-Cors, celery, browser-cookie3 Successfully installed Flask-2.1.2 Flask-Cors-3.0.9 Jinja2-3.1.2 MarkupSafe-2.1.1 PySocks-1.7.1 SecretStorage-3.3.2 Six-1.16.0 Werkzeug-2.1.2 aiohttp-3.7.4 amqp-2.6.1 argparse-1.4.0 async-generator-1.10 async-timeout-3.0.1 attrs-21.4.0 beautifulsoup4-4.9.3 billiard-3.6.4.0 browser-cookie3-0.14.1 bs4-0.0.1 cachetools-5.1.0 celery-4.4.5 certifi-2022.5.18 cffi-1.15.0 cfscrape-2.1.1 chardet-3.0.4 charset-normalizer-2.0.12 click-8.1.3 colorama-0.4.4 cryptography-37.0.2 emailrep-0.0.4 fake-useragent-0.1.11 future-0.18.2 fuzzywuzzy-0.18.0 geographiclib-1.52 geopy-1.22.0 google-api-core-2.8.0 google-api-python-client-2.33.0 google-auth-2.6.6 google-auth-httplib2-0.1.0 googleapis-common-protos-1.56.1 googletrans-3.0.0 h11-0.9.0 h2-3.2.0 holehe-1.60.2 hpack-3.0.0 hstspreload-2021.12.1 httpcore-0.9.1 httplib2-0.20.4 httpx-0.13.3 hyperframe-5.2.0 idna-2.10 importlib-metadata-4.11.3 instaloader-4.8.1 itsdangerous-2.1.2 jeepney-0.8.0 keyring-23.5.0 kombu-4.6.11 langdetect-1.0.8 lxml-4.6.3 lz4-4.0.0 multidict-6.0.2 oauthlib-3.2.0 outcome-1.1.0 parse-1.19.0 pbkdf2-1.3 protobuf-3.20.1 pyaes-1.6.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pycryptodome-3.14.1 pyparsing-3.0.9 python-dateutil-2.8.2 pytz-2022.1 redis-3.5.3 requests-2.27.0 requests-futures-1.0.0 requests-oauthlib-1.3.1 rfc3986-1.5.0 rsa-4.8 rx-3.2.0 search-engine-parser-0.6.3 sniffio-1.2.0 socialscan-1.4.2 sortedcontainers-2.4.0 soupsieve-2.3.2.post1 spotipy-2.16.1 stem-1.8.0 stop_words-2018.7.23 termcolor-1.1.0 torrequest-0.1.0 tqdm-4.64.0 trio-0.20.0 tweepy-4.5.0 twitch-python-0.0.20 typing-extensions-4.2.0 uritemplate-4.1.1 urllib3-1.26.9 vaderSentiment-3.3.2 vine-1.3.0 yagooglesearch-1.6.0 yarl-1.7.2 zipp-3.8.0 3. **Execution of "python app.py -e prod"** (venv) MAC:backend User$ python app.py -e prod Starting PROD servers REDIS serving... CELERY serving... Falsk serving... HTTPD serving... HTTPD serving...INSIDE 8416:C 19 May 2022 10:24:41.538 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 8416:C 19 May 2022 10:24:41.538 # Redis version=7.0.0, bits=64, commit=00000000, modified=0, pid=8416, just started 8416:C 19 May 2022 10:24:41.538 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf 8416:M 19 May 2022 10:24:41.539 * Increased maximum number of open files to 10032 (it was originally set to 256). 8416:M 19 May 2022 10:24:41.539 * monotonic clock: POSIX clock_gettime _._ _.-``__ ''-._ _.-`` `. `_. ''-._ Redis 7.0.0 (00000000/0) 64 bit .-`` .-```. ```\/ _.,_ ''-._ ( ' , .-` | `, ) Running in standalone mode |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379 | `-._ `._ / _.-' | PID: 8416 `-._ `-._ `-./ _.-' _.-' |`-._`-._ `-.__.-' _.-'_.-'| | `-._`-._ _.-'_.-' | https://redis.io `-._ `-._`-.__.-'_.-' _.-' |`-._`-._ `-.__.-' _.-'_.-'| | `-._`-._ _.-'_.-' | `-._ `-._`-.__.-'_.-' _.-' `-._ `-.__.-' _.-' `-._ _.-' `-.__.-' 8416:M 19 May 2022 10:24:41.540 # WARNING: The TCP backlog setting of 511 cannot be enforced because kern.ipc.somaxconn is set to the lower value of 128. 8416:M 19 May 2022 10:24:41.540 # Server initialized 8416:M 19 May 2022 10:24:41.540 * The AOF directory appendonlydir doesn't exist 8416:M 19 May 2022 10:24:41.540 * Loading RDB produced by version 7.0.0 8416:M 19 May 2022 10:24:41.540 * RDB age 79 seconds 8416:M 19 May 2022 10:24:41.540 * RDB memory usage when created 1.47 Mb 8416:M 19 May 2022 10:24:41.540 * Done loading RDB, keys loaded: 1, keys expired: 0. 8416:M 19 May 2022 10:24:41.540 * DB loaded from disk: 0.000 seconds 8416:M 19 May 2022 10:24:41.540 * Ready to accept connections * Serving Flask app 'factories.application' (lazy loading) * Environment: production WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead. * Debug mode: on * Running on http://127.0.0.1:5000 (Press CTRL+C to quit) * Restarting with stat Starting PROD servers REDIS serving... CELERY serving... Falsk serving... HTTPD serving... 8424:C 19 May 2022 10:24:42.099 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 8424:C 19 May 2022 10:24:42.099 # Redis version=7.0.0, bits=64, commit=00000000, modified=0, pid=8424, just started 8424:C 19 May 2022 10:24:42.099 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf 8424:M 19 May 2022 10:24:42.100 * Increased maximum number of open files to 10032 (it was originally set to 256). 8424:M 19 May 2022 10:24:42.100 * monotonic clock: POSIX clock_gettime 8424:M 19 May 2022 10:24:42.101 # Warning: Could not create server TCP listening socket *:6379: bind: Address already in use 8424:M 19 May 2022 10:24:42.101 # Failed listening on port 6379 (TCP), aborting. Process httpd: Traceback (most recent call last): File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap self.run() File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/Users/User/Projects/SEC/iky/iKy-pack/backend/app.py", line 44, in httpServer with socketserver.TCPServer(("", PORT), Handler) as httpd_server: File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/socketserver.py", line 452, in __init__ self.server_bind() File "/usr/local/Cellar/python@3.9/3.9.12_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/socketserver.py", line 466, in server_bind self.socket.bind(self.server_address) OSError: [Errno 48] Address already in use * Debugger is active! * Debugger PIN: 113-929-301 /Users/User/Projects/SEC/iky/venv/lib/python3.9/site-packages/fuzzywuzzy/fuzz.py:11: UserWarning: Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning warnings.warn('Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning') [2022-05-19 10:24:42,997: DEBUG/MainProcess] | Worker: Preparing bootsteps. [2022-05-19 10:24:42,999: DEBUG/MainProcess] | Worker: Building graph... [2022-05-19 10:24:42,999: DEBUG/MainProcess] | Worker: New boot order: {Timer, Hub, Pool, Autoscaler, StateDB, Beat, Consumer} [2022-05-19 10:24:43,008: DEBUG/MainProcess] | Consumer: Preparing bootsteps. [2022-05-19 10:24:43,009: DEBUG/MainProcess] | Consumer: Building graph... [2022-05-19 10:24:43,027: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Agent, Events, Mingle, Gossip, Heart, Tasks, Control, event loop} -------------- celery@MAC.local v4.4.5 (cliffs) --- ***** ----- -- ******* ---- macOS-10.15.7-x86_64-i386-64bit 2022-05-19 10:24:43 - *** --- * --- - ** ---------- [config] - ** ---------- .> app: factories.application:0x1035e77f0 - ** ---------- .> transport: redis://localhost:6379/0 - ** ---------- .> results: redis://localhost:6379/0 - *** --- * --- .> concurrency: 8 (prefork) -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) --- ***** ----- -------------- [queues] .> celery exchange=celery(direct) key=celery [tasks] . celery.accumulate . celery.backend_cleanup . celery.chain . celery.chord . celery.chord_unlock . celery.chunks . celery.group . celery.map . celery.starmap . modules.darkpass.darkpass_tasks.t_darkpass . modules.dorks.dorks_tasks.t_dorks . modules.emailrep.emailrep_tasks.t_emailrep . modules.fullcontact.fullcontact_tasks.t_fullcontact . modules.ghostproject.ghostproject_tasks.t_ghostproject . modules.github.github_tasks.t_github . modules.gitlab.gitlab_tasks.t_gitlab . modules.holehe.holehe_tasks.t_holehe . modules.instagram.instagram_tasks.t_instagram . modules.keybase.keybase_tasks.t_keybase . modules.leaklookup.leaklookup_tasks.t_leaklookup . modules.leaks.leaks_tasks.t_leaks . modules.linkedin.linkedin_tasks.t_linkedin . modules.peopledatalabs.peopledatalabs_tasks.t_peopledatalabs . modules.reddit.reddit_tasks.t_reddit . modules.search.search_tasks.t_search . modules.sherlock.sherlock_tasks.t_sherlock . modules.skype.skype_tasks.t_skype . modules.socialscan.socialscan_tasks.t_socialscan . modules.spotify.spotify_tasks.t_spotify . modules.tiktok.tiktok_tasks.t_tiktok . modules.tinder.tinder_tasks.t_tinder . modules.tweetiment.tweetiment_tasks.t_tweetiment . modules.twitch.twitch_tasks.t_twitch . modules.twitter.twitter_tasks.t_twitter . modules.twitter_comparison.twitter_comp_tasks.t_twitter_comp . modules.twitter_comparison.twitter_info_tasks.t_twitter_info . modules.usersearch.usersearch_tasks.t_usersearch . modules.venmo.venmo_tasks.t_venmo [2022-05-19 10:24:43,046: DEBUG/MainProcess] | Worker: Starting Hub [2022-05-19 10:24:43,046: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:43,046: DEBUG/MainProcess] | Worker: Starting Pool /Users/User/Projects/SEC/iky/venv/lib/python3.9/site-packages/fuzzywuzzy/fuzz.py:11: UserWarning: Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning warnings.warn('Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning') [2022-05-19 10:24:43,551: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:43,552: DEBUG/MainProcess] | Worker: Starting Consumer [2022-05-19 10:24:43,552: DEBUG/MainProcess] | Consumer: Starting Connection [2022-05-19 10:24:43,562: DEBUG/MainProcess] | Worker: Preparing bootsteps. [2022-05-19 10:24:43,563: DEBUG/MainProcess] | Worker: Building graph... [2022-05-19 10:24:43,563: DEBUG/MainProcess] | Worker: New boot order: {Timer, Hub, Pool, Autoscaler, Beat, StateDB, Consumer} [2022-05-19 10:24:43,566: INFO/MainProcess] Connected to redis://localhost:6379/0 [2022-05-19 10:24:43,566: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:43,566: DEBUG/MainProcess] | Consumer: Starting Events [2022-05-19 10:24:43,573: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:43,573: DEBUG/MainProcess] | Consumer: Starting Mingle [2022-05-19 10:24:43,573: INFO/MainProcess] mingle: searching for neighbors [2022-05-19 10:24:43,573: DEBUG/MainProcess] | Consumer: Preparing bootsteps. [2022-05-19 10:24:43,574: DEBUG/MainProcess] | Consumer: Building graph... [2022-05-19 10:24:43,596: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Agent, Events, Mingle, Tasks, Control, Heart, Gossip, event loop} -------------- celery@MAC.local v4.4.5 (cliffs) --- ***** ----- -- ******* ---- macOS-10.15.7-x86_64-i386-64bit 2022-05-19 10:24:43 - *** --- * --- - ** ---------- [config] - ** ---------- .> app: factories.application:0x10c072820 - ** ---------- .> transport: redis://localhost:6379/0 - ** ---------- .> results: redis://localhost:6379/0 - *** --- * --- .> concurrency: 8 (prefork) -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) --- ***** ----- -------------- [queues] .> celery exchange=celery(direct) key=celery [tasks] . celery.accumulate . celery.backend_cleanup . celery.chain . celery.chord . celery.chord_unlock . celery.chunks . celery.group . celery.map . celery.starmap . modules.darkpass.darkpass_tasks.t_darkpass . modules.dorks.dorks_tasks.t_dorks . modules.emailrep.emailrep_tasks.t_emailrep . modules.fullcontact.fullcontact_tasks.t_fullcontact . modules.ghostproject.ghostproject_tasks.t_ghostproject . modules.github.github_tasks.t_github . modules.gitlab.gitlab_tasks.t_gitlab . modules.holehe.holehe_tasks.t_holehe . modules.instagram.instagram_tasks.t_instagram . modules.keybase.keybase_tasks.t_keybase . modules.leaklookup.leaklookup_tasks.t_leaklookup . modules.leaks.leaks_tasks.t_leaks . modules.linkedin.linkedin_tasks.t_linkedin . modules.peopledatalabs.peopledatalabs_tasks.t_peopledatalabs . modules.reddit.reddit_tasks.t_reddit . modules.search.search_tasks.t_search . modules.sherlock.sherlock_tasks.t_sherlock . modules.skype.skype_tasks.t_skype . modules.socialscan.socialscan_tasks.t_socialscan . modules.spotify.spotify_tasks.t_spotify . modules.tiktok.tiktok_tasks.t_tiktok . modules.tinder.tinder_tasks.t_tinder . modules.tweetiment.tweetiment_tasks.t_tweetiment . modules.twitch.twitch_tasks.t_twitch . modules.twitter.twitter_tasks.t_twitter . modules.twitter_comparison.twitter_comp_tasks.t_twitter_comp . modules.twitter_comparison.twitter_info_tasks.t_twitter_info . modules.usersearch.usersearch_tasks.t_usersearch . modules.venmo.venmo_tasks.t_venmo [2022-05-19 10:24:43,616: DEBUG/MainProcess] | Worker: Starting Hub [2022-05-19 10:24:43,616: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:43,616: DEBUG/MainProcess] | Worker: Starting Pool [2022-05-19 10:24:44,157: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,158: DEBUG/MainProcess] | Worker: Starting Consumer [2022-05-19 10:24:44,158: DEBUG/MainProcess] | Consumer: Starting Connection [2022-05-19 10:24:44,171: INFO/MainProcess] Connected to redis://localhost:6379/0 [2022-05-19 10:24:44,171: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,171: DEBUG/MainProcess] | Consumer: Starting Events [2022-05-19 10:24:44,177: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,177: DEBUG/MainProcess] | Consumer: Starting Mingle [2022-05-19 10:24:44,177: INFO/MainProcess] mingle: searching for neighbors [2022-05-19 10:24:44,594: INFO/MainProcess] mingle: all alone [2022-05-19 10:24:44,594: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,594: DEBUG/MainProcess] | Consumer: Starting Gossip [2022-05-19 10:24:44,702: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,702: DEBUG/MainProcess] | Consumer: Starting Heart [2022-05-19 10:24:44,704: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,704: DEBUG/MainProcess] | Consumer: Starting Tasks [2022-05-19 10:24:44,710: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,710: DEBUG/MainProcess] | Consumer: Starting Control [2022-05-19 10:24:44,713: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:44,714: DEBUG/MainProcess] | Consumer: Starting event loop [2022-05-19 10:24:44,714: DEBUG/MainProcess] | Worker: Hub.register Pool... [2022-05-19 10:24:44,714: INFO/MainProcess] celery@MAC.local ready. [2022-05-19 10:24:44,714: DEBUG/MainProcess] basic.qos: prefetch_count->32 [2022-05-19 10:24:45,199: INFO/MainProcess] mingle: all alone [2022-05-19 10:24:45,199: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:45,199: DEBUG/MainProcess] | Consumer: Starting Tasks [2022-05-19 10:24:45,206: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:45,206: DEBUG/MainProcess] | Consumer: Starting Control [2022-05-19 10:24:45,209: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:45,209: DEBUG/MainProcess] | Consumer: Starting Heart [2022-05-19 10:24:45,211: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:45,211: DEBUG/MainProcess] | Consumer: Starting Gossip [2022-05-19 10:24:45,214: DEBUG/MainProcess] ^-- substep ok [2022-05-19 10:24:45,214: DEBUG/MainProcess] | Consumer: Starting event loop [2022-05-19 10:24:45,214: DEBUG/MainProcess] | Worker: Hub.register Pool... [2022-05-19 10:24:45,215: INFO/MainProcess] celery@MAC.local ready. [2022-05-19 10:24:45,215: DEBUG/MainProcess] basic.qos: prefetch_count->32 ^[[1;2D127.0.0.1 - - [19/May/2022 10:50:56] "GET /styles-es2015.js.map HTTP/1.1" 200 - 127.0.0.1 - - [19/May/2022 10:50:56] code 404, message File not found 127.0.0.1 - - [19/May/2022 10:50:56] "GET /jspdf.node.min.js.map HTTP/1.1" 404 - 127.0.0.1 - - [19/May/2022 10:50:56] "GET /vendor-es2015.js.map HTTP/1.1" 200 - 127.0.0.1 - - [19/May/2022 10:50:56] "GET /main-es2015.js.map HTTP/1.1" 200 - 127.0.0.1 - - [19/May/2022 10:50:56] "GET /app-pages-pages-module-es2015.js.map HTTP/1.1" 200 - 127.0.0.1 - - [19/May/2022 10:51:08] "GET / HTTP/1.1" 200 - 127.0.0.1 - - [19/May/2022 10:51:09] "GET /styles-es2015.js.map HTTP/1.1" 304 - 127.0.0.1 - - [19/May/2022 10:51:09] code 404, message File not found 127.0.0.1 - - [19/May/2022 10:51:09] "GET /jspdf.node.min.js.map HTTP/1.1" 404 - 127.0.0.1 - - [19/May/2022 10:51:09] "GET /vendor-es2015.js.map HTTP/1.1" 304 - 127.0.0.1 - - [19/May/2022 10:51:13] "GET /main-es2015.js.map HTTP/1.1" 304 - 127.0.0.1 - - [19/May/2022 10:51:41] "GET /app-pages-pages-module-es2015.js.map HTTP/1.1" 304 - 8416:M 19 May 2022 11:02:54.256 * 100 changes in 300 seconds. Saving... 8416:M 19 May 2022 11:02:54.256 * Background saving started by pid 9559 9559:C 19 May 2022 11:02:54.259 * DB saved on disk 9559:C 19 May 2022 11:02:54.259 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB 8416:M 19 May 2022 11:02:54.357 * Background saving terminated with success **Notes** I saw in the output above: "8424:M 19 May 2022 10:24:42.101 # Failed listening on port 6379 (TCP), aborting." Therefore checked whether there was a rogue redis still roaming on my machine: sudo lsof -i:6379 Yielded no results. Redis appears to be started exclusively by the iKY package.
KennBro commented 2 years ago

After execute 

python3 app.y -e prod

Try this command

curl -d ‘{“username”:”jpdborgna", "from":"Initial"}' -H "Content-Type: application/json" -X POST http://127.0.0.1:5000/github

The output should be

{
  "from_m": "Initial", 
  "module": "github", 
  "param": "xxx", 
  "task": "8d59905d-ae1f-434d-bde1-2414cbb3e94f"
}

And then run 

curl http://127.0.0.1:5000/result/<task_id>

Where task_id is the task variable of the output

Explained in wiki (https://github.com/kennbroorg/iKy/wiki/Backend-through-url)

Send me the output. See you