issue with the requirements.txt file

MariaRusanova commented 4 years ago

Hello Team,

I have some problem with the proper location of the file requirements.txt file. I will give you more detailed output for that issue that I received.

image

Please assist because I'm not exactly aware with what is related this error like 404 Client Error: Not Found

Thanks.

matamorphosis commented 4 years ago

Hi Maria,

Thanks for your interest in Scrummage.

When installing Scrummage, please follow the installation guide here. This will instruct you to run the install.sh file which will install all python requirements for you.

However, in regards to the specific command you were executing in the attached image, you are missing the "-r" argument which specifies a file containing a list of libraries rather than a single library. Without this, the pip3 command will try and find a library called "python-requirements.txt", which is why you are receiving the 404 error.

Correct command:

user@linux:~$ pip3 install -r python-requirements.txt

MariaRusanova commented 4 years ago

Thank you for the recommendation. I followed the procedure that you provided me, passed through it but received a new error when I executed the last line -> python3 Scrummage.py

the error is given below:

┌─[✗]─[root@parrot]─[~/Downloads/Scrummage/lib] └──╼ #python3 Scrummage.py CRITICAL:Scrummage:2020-07-18 13:45:58 Error initiating SSL.

Please advise if you can. Thanks!

matamorphosis commented 4 years ago

You are seeing this error because the Scrummage.py file cannot locate your .key file nor your .crt file used to enable SSL. To configure SSL you need to follow steps 5-7 in the installation guide. I have attached the steps below and customised them towards your installation based on the image you sent me.

...

Next, you will either need to provide certificates or generate a self-signed certificate to use. In either case, you will need to create a directory called "certs" in the root Scrummage directory:
```
user@linux:~/Downloads/Scrummage$ mkdir certs && cd certs
```

After which, you will then need to either provide a .key and .crt file to that directory or create the certificates with the command below:

user@linux:~/Downloads/Scrummage/certs$ openssl req -x509 -sha256 -nodes -days 365 -newkey rsa:2048 -keyout privateKey.key -out certificate.crt

Next, navigate to "/lib/plugins/common/config", and in the config.json file verify the web application details are correct under "web-app". Ensure the certificates are set correctly. Using the path "../certs/FILE": Please replace [vim/nano/gedit/leafpad] with your text editor of choice.

user@linux:~/Downloads/Scrummage/lib/plugins/common/config$ [vim/nano/gedit/leafpad] config.json


"web-app": {
"debug": false,
"host": "127.0.0.1",
"port": 5000,
"certificate-file": "../certs/certificate.crt",
"key-file": "../certs/privateKey.key",
"api-secret": "",
"api-validity-minutes": 60,
"api-max-calls": 10,
"api-period-in-seconds": 60
},

MariaRusanova commented 4 years ago

I will implement. Merci. :)

MariaRusanova commented 4 years ago

The error with the certificate was resolved that is fine.

But I have another specific error related to the sql database. When I'm executing the python script received:

┌─[root@parrot]─[~/Downloads/Scrummage/lib] └──╼ #./Scrummage.py 'NoneType' object is not subscriptable

So probably something in the code have to be changed or accommodated to pass further. I read for such type of errors that one method can be added sorted_list = sorted(lista) in the scrip but I'm just not sure if that is the method for resolution and if I have to change the code where exactly to change it.

Please advice me if you can how to proceed further.

Many thanks for your time and dedication on that project!

matamorphosis commented 4 years ago

Hi Maria,

Not sure exactly what your issue is. To help us identify your issue please provide all details from the trace. Executing Scrummage should work fine if the database and tables were all created correctly during installation, and the PostgreSQL service has started.

Command to check DB service

user@linux:~$ service postgresql status

Ideal Response

● postgresql.service - PostgreSQL RDBMS
     Loaded: loaded (/lib/systemd/system/postgresql.service; enabled; vendor pr>
     Active: active (exited) since Sun 2020-07-19 21:35:44 AEST; 58min ago
    Process: 1570 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
   Main PID: 1570 (code=exited, status=0/SUCCESS)

Please also check your database details are correct in the config file.

"postgresql": {
    "host": "127.0.0.1",
    "port": 5432,
    "database": "scrummage",
    "user": "scrummage",
    "password": "<YOUR-PASSWORD-HERE>"
},

Please also check the web-app configuration

"web-app": {
    "debug": false,
    "host": "<IP-ADDRESS>",
    "port": 5000,
    "certificate-file": "../certs/certificate.crt",
    "key-file": "../certs/privateKey.key",
    "api-secret": "<API-SECRET>",
    "api-validity-minutes": 60,
    "api-max-calls": 10,
    "api-period-in-seconds": 60
},

If this is all good, please refer to PostgreSQL documentation for checking the presence of tables in the database, and consider a fresh install if the error persists. In the majority of cases the installation is very simple and all configurations, except certificates, are handled by it.

I can confirm there should be nothing in the current code that should prevent you from running the program if it has been installed and configured correctly.

MariaRusanova commented 4 years ago

mersi for your fast reply.

If that can help I can say that the settings in confif file were compared and they are ok

image

in my config.json file:

        "postgresql": {
            "host": "127.0.0.1",
            "port": 5432,
            "database": "scrummage",
            "user": "scrummage",
            "password": "pnMfxPmEYpUrQDH1shUDoWR3WcIIj0"
        },

here is the output for the status of the version of my postgresql

┌─[✗]─[root@parrot]─[~/Downloads/Scrummage/lib] └──╼ #service postgresql status ● postgresql.service - PostgreSQL RDBMS Loaded: loaded (/lib/systemd/system/postgresql.service; disabled; vendor pre> Active: active (exited) since Sat 2020-07-18 13:20:02 EDT; 19h ago Main PID: 880 (code=exited, status=0/SUCCESS) Tasks: 0 (limit: 4915) Memory: 0B CGroup: /system.slice/postgresql.service

Jul 18 13:20:02 parrot systemd[1]: Starting PostgreSQL RDBMS... Jul 18 13:20:02 parrot systemd[1]: Started PostgreSQL RDBMS. lines 1-10/10 (END)

The last error that I'm receiving is definitely related to the database:

┌─[root@parrot]─[~/Downloads/Scrummage/lib] └──╼ #./Scrummage.py WARNING:root:2020-07-19 08:59:34 Connectors Library - Failed to connect to database. CRITICAL:Scrummage:2020-07-19 08:59:34 Failed to load main database, please make sure the database details are added correctly to the configuration, and the PostgreSQL service is running.

Thanks

matamorphosis commented 4 years ago

Based on the information provided it is definitely a database issue. In the installation directory, could you confirm there is a file called "db.json". If so check the details and try running "Create_Tables.py".

MariaRusanova commented 4 years ago

I've checked and there is such file in this directory called db.json

┌─[root@parrot]─[~/Downloads/Scrummage/installation] └──╼ #ls certs db.json python-pinterest-api chrome_dev Generate_JSON_Config.py python_requirements.txt Create_Tables.py images_dark_theme Readme.md Create_User.py install.sh site-packages

I've ran the script "Create_Tables.py"

Is it normal to be a slow process?, still waiting..

image

after waiting received:

┌─[root@parrot]─[~/Downloads/Scrummage/installation] └──╼ #./Create_Tables.py

./Create_Tables.py: line 3: syntax error near unexpected token `('

./Create_Tables.py: line 3: `def Load_Main_Database():'

matamorphosis commented 4 years ago

Please run python scripts with python3 Script.py. Not all python scripts are configured to be executable.
As per my previous instructions, the "certs" directory should be in the Scrummage root directory and not the installation directory. Move this folder one directory up.

MariaRusanova commented 4 years ago

I gave it a try:

┌─[✗]─[root@parrot]─[~/Downloads/Scrummage/installation] └──╼ #pip3 install Create_Tables.py Collecting Create_Tables.py Could not install packages due to an EnvironmentError: 404 Client Error: Not Found for url: https://pypi.org/simple/create-tables-py/

matamorphosis commented 4 years ago

No not pip3, python3. Run

python3 Create_Tables.py

MariaRusanova commented 4 years ago

Ok, understood.

the output is:

┌─[root@parrot]─[~/Downloads/Scrummage/installation] └──╼ #python3 Create_Tables.py Error while creating PostgreSQL table. 'bool' object has no attribute 'cursor'

matamorphosis commented 4 years ago

It appears as though the db.json file is not configured properly. You could try re-running install.sh with

sudo bash install.sh

If you are still facing issues please capture the entire trace and upload it.

MariaRusanova commented 4 years ago

┌─[root@parrot]─[~/Downloads/Scrummage/installation] └──╼ #sudo bash install.sh Hit:1 https://deb.parrot.sh/parrot rolling InRelease Hit:2 https://deb.parrot.sh/parrot rolling-security InRelease Reading package lists... Done Building dependency tree
Reading state information... Done 2272 packages can be upgraded. Run 'apt list --upgradable' to see them. Reading package lists... Done Building dependency tree
Reading state information... Done build-essential is already the newest version (12.8). build-essential set to manually installed. postgresql is already the newest version (12+215). unzip is already the newest version (6.0-25). wget is already the newest version (1.20.3-1+b2). Some packages could not be installed. This may mean that you have requested an impossible situation or if you are using the unstable distribution that some required packages have not yet been created or been moved out of Incoming. The following information may help to resolve the situation:

The following packages have unmet dependencies: build-essential : Depends: libc6-dev but it is not going to be installed or libc-dev Depends: g++ (>= 4:9.2) but it is not going to be installed E: Unable to correct problems, you have held broken packages. mkdir: cannot create directory ‘../lib/static/protected’: File exists mkdir: cannot create directory ‘../lib/static/protected/output’: File exists mkdir: cannot create directory ‘../lib/static/protected/screenshots’: File exists mkdir: cannot create directory ‘chrome_dev’: File exists --2020-07-19 09:57:05-- https://chromedriver.storage.googleapis.com/76.0.3809.12/chromedriver_linux64.zip Resolving chromedriver.storage.googleapis.com (chromedriver.storage.googleapis.com)... 172.217.17.112, 2a00:1450:400e:806::2010 Connecting to chromedriver.storage.googleapis.com (chromedriver.storage.googleapis.com)|172.217.17.112|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 5229485 (5.0M) [application/zip] Saving to: ‘chromedriver_linux64.zip.2’

chromedriver_linux6 100%[===================>] 4.99M 17.5MB/s in 0.3s

2020-07-19 09:57:05 (17.5 MB/s) - ‘chromedriver_linux64.zip.2’ saved [5229485/5229485]

Archive: chromedriver_linux64.zip inflating: chromedriver
fatal: destination path 'python-pinterest-api' already exists and is not an empty directory. running install running bdist_egg running egg_info writing pinterest_api.egg-info/PKG-INFO writing dependency_links to pinterest_api.egg-info/dependency_links.txt writing requirements to pinterest_api.egg-info/requires.txt writing top-level names to pinterest_api.egg-info/top_level.txt reading manifest file 'pinterest_api.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' writing manifest file 'pinterest_api.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py creating build/bdist.linux-x86_64/egg creating build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/init.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/version.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/board.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/config.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/err.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/me.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/oauth2.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/pin.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/section.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/user.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/util.py -> build/bdist.linux-x86_64/egg/pinterest byte-compiling build/bdist.linux-x86_64/egg/pinterest/init.py to init.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/version.py to version.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/board.py to board.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/config.py to config.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/err.py to err.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/me.py to me.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/oauth2.py to oauth2.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/pin.py to pin.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/section.py to section.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/user.py to user.cpython-37.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/util.py to util.cpython-37.pyc creating build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/not-zip-safe -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO creating 'dist/pinterest_api-0.0.8-py3.7.egg' and adding 'build/bdist.linux-x86_64/egg' to it removing 'build/bdist.linux-x86_64/egg' (and everything under it) Processing pinterest_api-0.0.8-py3.7.egg removing '/usr/local/lib/python3.7/dist-packages/pinterest_api-0.0.8-py3.7.egg' (and everything under it) creating /usr/local/lib/python3.7/dist-packages/pinterest_api-0.0.8-py3.7.egg Extracting pinterest_api-0.0.8-py3.7.egg to /usr/local/lib/python3.7/dist-packages pinterest-api 0.0.8 is already the active version in easy-install.pth

Installed /usr/local/lib/python3.7/dist-packages/pinterest_api-0.0.8-py3.7.egg Processing dependencies for pinterest-api==0.0.8 Searching for requests==2.21.0 Best match: requests 2.21.0 Adding requests 2.21.0 to easy-install.pth file

Using /usr/lib/python3/dist-packages Finished processing dependencies for pinterest-api==0.0.8 Not uninstalling requests at /usr/lib/python3/dist-packages, outside environment /usr Can't uninstall 'requests'. No files were found to uninstall. Requirement already satisfied: praw in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 1)) (7.1.0) Requirement already satisfied: pandas in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 2)) (1.0.5) Requirement already satisfied: feedparser in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 3)) (5.2.1) Requirement already satisfied: jira in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 4)) (2.0.0) Requirement already satisfied: pyhibp in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 5)) (4.1.0) Requirement already satisfied: ebaysdk in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 6)) (2.2.0) Requirement already satisfied: google-api-python-client in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 7)) (1.10.0) Requirement already satisfied: facebook-sdk in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 8)) (3.1.0) Requirement already satisfied: selenium in /usr/lib/python3/dist-packages (from -r python_requirements.txt (line 9)) (4.0.0a1) Requirement already satisfied: flask in /usr/lib/python3/dist-packages (from -r python_requirements.txt (line 10)) (1.1.1) Requirement already satisfied: python-crontab in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 11)) (2.5.1) Requirement already satisfied: instagram_explore in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 12)) (0.3.0) Requirement already satisfied: slackclient==2.0.0 in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 13)) (2.0.0) Requirement already satisfied: vulners in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 14)) (1.5.5) Requirement already satisfied: defectdojo_api in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 15)) (1.1.4) Requirement already satisfied: flickr_api in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 16)) (0.7.3) Requirement already satisfied: python-docx in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 17)) (0.8.10) Requirement already satisfied: flask_compress in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 18)) (1.5.0) Requirement already satisfied: flask_jwt in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 19)) (0.3.2) Requirement already satisfied: tweepy in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 20)) (3.9.0) Requirement already satisfied: ratelimiter in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 21)) (1.2.0.post0) Requirement already satisfied: pyleri in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 22)) (1.3.2) Requirement already satisfied: publicsuffix2 in /usr/local/lib/python3.7/dist-packages (from -r python_requirements.txt (line 23)) (2.20191221) Requirement already satisfied: websocket-client>=0.54.0 in /usr/local/lib/python3.7/dist-packages (from praw->-r python_requirements.txt (line 1)) (0.57.0) Requirement already satisfied: prawcore<2.0,>=1.3.0 in /usr/local/lib/python3.7/dist-packages (from praw->-r python_requirements.txt (line 1)) (1.4.0) Requirement already satisfied: update-checker>=0.17 in /usr/local/lib/python3.7/dist-packages (from praw->-r python_requirements.txt (line 1)) (0.17) Requirement already satisfied: python-dateutil>=2.6.1 in /usr/lib/python3/dist-packages (from pandas->-r python_requirements.txt (line 2)) (2.7.3) Requirement already satisfied: numpy>=1.13.3 in /usr/lib/python3/dist-packages (from pandas->-r python_requirements.txt (line 2)) (1.16.5) Requirement already satisfied: pytz>=2017.2 in /usr/lib/python3/dist-packages (from pandas->-r python_requirements.txt (line 2)) (2019.3) Requirement already satisfied: oauthlib[signedtoken]>=1.0.0 in /usr/local/lib/python3.7/dist-packages (from jira->-r python_requirements.txt (line 4)) (3.1.0) Requirement already satisfied: requests>=2.10.0 in /usr/lib/python3/dist-packages (from jira->-r python_requirements.txt (line 4)) (2.21.0) Requirement already satisfied: defusedxml in /usr/lib/python3/dist-packages (from jira->-r python_requirements.txt (line 4)) (0.6.0) Requirement already satisfied: setuptools>=20.10.1 in /usr/lib/python3/dist-packages (from jira->-r python_requirements.txt (line 4)) (41.2.0) Requirement already satisfied: requests-oauthlib>=0.6.1 in /usr/local/lib/python3.7/dist-packages (from jira->-r python_requirements.txt (line 4)) (1.3.0) Requirement already satisfied: requests-toolbelt in /usr/local/lib/python3.7/dist-packages (from jira->-r python_requirements.txt (line 4)) (0.9.1) Requirement already satisfied: six>=1.10.0 in /usr/lib/python3/dist-packages (from jira->-r python_requirements.txt (line 4)) (1.12.0) Requirement already satisfied: pbr>=3.0.0 in /usr/local/lib/python3.7/dist-packages (from jira->-r python_requirements.txt (line 4)) (5.4.5) Requirement already satisfied: lxml in /usr/lib/python3/dist-packages (from ebaysdk->-r python_requirements.txt (line 6)) (4.4.1) Requirement already satisfied: uritemplate<4dev,>=3.0.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client->-r python_requirements.txt (line 7)) (3.0.1) Requirement already satisfied: google-api-core<2dev,>=1.18.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client->-r python_requirements.txt (line 7)) (1.21.0) Requirement already satisfied: google-auth-httplib2>=0.0.3 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client->-r python_requirements.txt (line 7)) (0.0.4) Requirement already satisfied: google-auth>=1.16.0 in /usr/local/lib/python3.7/dist-packages (from google-api-python-client->-r python_requirements.txt (line 7)) (1.19.2) Requirement already satisfied: httplib2<1dev,>=0.9.2 in /usr/lib/python3/dist-packages (from google-api-python-client->-r python_requirements.txt (line 7)) (0.11.3) Requirement already satisfied: aiohttp>3.5.2 in /usr/lib/python3/dist-packages (from slackclient==2.0.0->-r python_requirements.txt (line 13)) (3.6.1) Requirement already satisfied: aiodns>1.0 in /usr/lib/python3/dist-packages (from slackclient==2.0.0->-r python_requirements.txt (line 13)) (1.1.1) Requirement already satisfied: oauth2 in /usr/local/lib/python3.7/dist-packages (from flickr_api->-r python_requirements.txt (line 16)) (1.9.0.post1) Requirement already satisfied: brotli in /usr/lib/python3/dist-packages (from flask_compress->-r python_requirements.txt (line 18)) (1.0.7) Requirement already satisfied: PyJWT<1.5.0,>=1.4.0 in /usr/local/lib/python3.7/dist-packages (from flask_jwt->-r python_requirements.txt (line 19)) (1.4.2) Requirement already satisfied: cryptography; extra == "signedtoken" in /usr/lib/python3/dist-packages (from oauthlib[signedtoken]>=1.0.0->jira->-r python_requirements.txt (line 4)) (2.6.1) Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in /usr/local/lib/python3.7/dist-packages (from google-api-core<2dev,>=1.18.0->google-api-python-client->-r python_requirements.txt (line 7)) (1.52.0) Requirement already satisfied: protobuf>=3.12.0 in /usr/local/lib/python3.7/dist-packages (from google-api-core<2dev,>=1.18.0->google-api-python-client->-r python_requirements.txt (line 7)) (3.12.2) Requirement already satisfied: cachetools<5.0,>=2.0.0 in /usr/local/lib/python3.7/dist-packages (from google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) (4.1.1) Requirement already satisfied: pyasn1-modules>=0.2.1 in /usr/local/lib/python3.7/dist-packages (from google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) (0.2.8) Requirement already satisfied: rsa<5,>=3.1.4; python_version >= "3" in /usr/local/lib/python3.7/dist-packages (from google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) (4.6) Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /usr/local/lib/python3.7/dist-packages (from pyasn1-modules>=0.2.1->google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) (0.4.8) mv: cannot move 'site-packages/defectdojo.py' to '/root/.local/lib/python3.7/site-packages/defectdojo.py': No such file or directory Successfully installed brakeman-4.8.2 Parsing documentation for brakeman-4.8.2 Done installing documentation for brakeman after 18 seconds 1 gem installed [+] Installation Complete. [+] Environment variable added to startup. ERROR: database "scrummage" already exists ERROR: role "scrummage" already exists GRANT Database has been created with the following details, please retain these for later. [+] Generated main configuration file (config.json). Database Details: Database: scrummage Username: scrummage Password: j4cvf1qojNhpQzl5h12RADo34XuJdp [+] Database setup complete. Error while creating PostgreSQL table. 'bool' object has no attribute 'cursor' [+] Scrummage tables created. 2020-07-19 09:57:57.315532 Failed to connect to database. [+] Admin user created, user details: Username: admin Password: 5B60myJfAv63IFgDEPMKUXZEV0pvxs

as far as I see there are two errors during the whole process:

ERROR: database "scrummage" already exists ERROR: role "scrummage" already exists

Are they critical? Thanks.

matamorphosis commented 4 years ago

Hi, you are seeing these errors only because you are re-running the script. So several things will already exist in the DB.

Unfortunately, I can confirm there are no code-related issues on our end with the installation, and therefore need to close this issue as your issue appears to be implementation related.

Some recommendations:

Pull the latest changes from GitHub, as I've made some changes to the install guide.
Start afresh, with a supported operating system, such as Ubuntu or Kali Linux. (If using Kali Linux you will need to ensure the PostgreSQL service starts on boot.) While in theory, the code should work on ParrotOS, it has not yet been tested on that distribution.
Follow the instructions, and read them carefully. (Do not execute any python3 or pip3 commands unless explicitly called out in a code section starting with user@linux), You do not ever need to run pip3, and the only python3 commands are after you have run install.sh successfully.

MariaRusanova commented 4 years ago

I've revert the machine parrot and executed all of the steps once more but still receiving the error:

┌─[root@parrot]─[~/Scrummage/lib] └──╼ #python3 Scrummage.py WARNING:root:2020-07-20 04:25:39 Connectors Library - Failed to connect to database. CRITICAL:Scrummage:2020-07-20 04:25:39 Failed to load main database, please make sure the database details are added correctly to the configuration, and the PostgreSQL service is running.

Maybe the code is not optimized for parrot and I have to try with kali linux.

matamorphosis commented 4 years ago

Being able to run the tool depends on the success of your installation. If you were still getting database errors on install the tool won't run.

If you download the latest version, I updated the installer today to be more verbose. This might help you narrow down the error.

MariaRusanova commented 4 years ago

this was the result with brandy new installed kali linux operation system - the last version of kali

image

matamorphosis commented 4 years ago

From the time you downloaded Scrummage please list each command you executed.

MariaRusanova commented 4 years ago

git clone https://github.com/matamorphosis/Scrummage.git cd Scrummage cd installation

./install.sh

after that:

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "Create_Tables.py", line 30, in connection = Load_Main_Database() File "Create_Tables.py", line 27, in Load_Main_Database sys.exit(str(datetime.datetime.now()) + " Failed to connect to database.")

Actually we are not connecting to the database. So even if we try to create the table manually the commands are not passing further.

example:

verbr@kali:~/Scrummage/installation# python3 Create_User.py -u admin -p bU2ehsgWHEaWMiqVcCdvg7Rqfp1zDI
2020-07-21 17:46:11.170737 Failed to connect to database.
root@kali:~/Scrummage/installation# bU2ehsgWHEaWMiqVcCdvg7Rqfp1zDI

matamorphosis commented 4 years ago

Have you tried executing install.sh as root?

sudo bash install.sh

As you cannot install the application as a regular user.

MariaRusanova commented 4 years ago

yes, definitely. This command was executed with root privileges.

matamorphosis commented 4 years ago

I've just checked the installer, it works perfectly. Please ensure before you install you don't have PostgreSQL installed already. In your case, ensure you are using a brand-new distribution.

See here the output of my installation (no errors)

user@linux: ~/Downloads $ git clone https://github.com/matamorphosis/Scrummage.git Cloning into 'Scrummage'... remote: Enumerating objects: 50, done. remote: Counting objects: 100% (50/50), done. remote: Compressing objects: 100% (36/36), done. remote: Total 2890 (delta 18), reused 29 (delta 12), pack-reused 2840 Receiving objects: 100% (2890/2890), 10.24 MiB | 5.35 MiB/s, done. Resolving deltas: 100% (1857/1857), done.

user@linux: ~/Downloads $ cd Scrummage/installation/

user@linux: ~/Downloads/Scrummage/installation $ sudo bash install.sh

Hit:1 https://download.docker.com/linux/ubuntu bionic InRelease Ign:2 http://repo.saltstack.com/apt/ubuntu/18.04/amd64/2018.3 bionic InRelease
Err:3 http://repo.saltstack.com/apt/ubuntu/18.04/amd64/2018.3 bionic Release
404 Not Found [IP: 13.225.143.99 80] Hit:4 http://ppa.launchpad.net/gift/stable/ubuntu bionic InRelease
Hit:5 http://us.archive.ubuntu.com/ubuntu bionic InRelease
Hit:6 http://us.archive.ubuntu.com/ubuntu bionic-updates InRelease
Hit:7 http://ppa.launchpad.net/malteworld/ppa/ubuntu bionic InRelease
Hit:8 http://archive.ubuntu.com/ubuntu bionic InRelease
Hit:9 http://security.ubuntu.com/ubuntu bionic-security InRelease
Hit:10 http://us.archive.ubuntu.com/ubuntu bionic-backports InRelease
Hit:11 http://archive.ubuntu.com/ubuntu bionic-security InRelease
Hit:12 http://ppa.launchpad.net/noobslab/icons/ubuntu bionic InRelease
Hit:13 http://ppa.launchpad.net/noobslab/themes/ubuntu bionic InRelease
Hit:14 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic InRelease
Hit:15 http://ppa.launchpad.net/sift/stable/ubuntu bionic InRelease
Reading package lists... Done
E: The repository 'http://repo.saltstack.com/apt/ubuntu/18.04/amd64/2018.3 bionic Release' no longer has a Release file. N: Updating from such a repository can't be done securely, and is therefore disabled by default. N: See apt-secure(8) manpage for repository creation and user configuration details. Reading package lists... Done Building dependency tree
Reading state information... Done build-essential is already the newest version (12.4ubuntu1). unzip is already the newest version (6.0-21ubuntu1). git is already the newest version (1:2.17.1-1ubuntu0.7). python3 is already the newest version (3.6.7-1~18.04). wget is already the newest version (1.19.4-1ubuntu2.2). python3-pip is already the newest version (9.0.1-2.3~ubuntu1.18.04.1). The following additional packages will be installed: postgresql-10 postgresql-client-10 postgresql-client-common postgresql-common sysstat Suggested packages: postgresql-doc locales-all postgresql-doc-10 python-psycopg2-doc isag The following NEW packages will be installed: postgresql postgresql-10 postgresql-client-10 postgresql-client-common postgresql-common postgresql-contrib python3-psycopg2 sysstat The following packages will be upgraded: openssl 1 upgraded, 8 newly installed, 0 to remove and 284 not upgraded. Need to get 5,957 kB of archives. After this operation, 21.4 MB of additional disk space will be used. Get:1 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 openssl amd64 1.1.1-1ubuntu2.1~18.04.6 [614 kB] Get:2 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-common all 190ubuntu0.1 [29.6 kB] Get:3 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-10 amd64 10.12-0ubuntu0.18.04.1 [937 kB] Get:4 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-common all 190ubuntu0.1 [157 kB] Get:5 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-10 amd64 10.12-0ubuntu0.18.04.1 [3,761 kB] Get:6 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql all 10+190ubuntu0.1 [5,884 B] Get:7 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-contrib all 10+190ubuntu0.1 [5,896 B] Get:8 http://us.archive.ubuntu.com/ubuntu bionic/main amd64 python3-psycopg2 amd64 2.7.4-1 [152 kB] Get:9 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 sysstat amd64 11.6.1-1ubuntu0.1 [295 kB] Fetched 5,957 kB in 3s (1,806 kB/s) Preconfiguring packages ... (Reading database ... 252156 files and directories currently installed.) Preparing to unpack .../0-openssl_1.1.1-1ubuntu2.1~18.04.6_amd64.deb ... Unpacking openssl (1.1.1-1ubuntu2.1~18.04.6) over (1.1.1-1ubuntu2.1~18.04.5) ... Selecting previously unselected package postgresql-client-common. Preparing to unpack .../1-postgresql-client-common_190ubuntu0.1_all.deb ... Unpacking postgresql-client-common (190ubuntu0.1) ... Selecting previously unselected package postgresql-client-10. Preparing to unpack .../2-postgresql-client-10_10.12-0ubuntu0.18.04.1_amd64.deb ... Unpacking postgresql-client-10 (10.12-0ubuntu0.18.04.1) ... Selecting previously unselected package postgresql-common. Preparing to unpack .../3-postgresql-common_190ubuntu0.1_all.deb ... Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' Unpacking postgresql-common (190ubuntu0.1) ... Selecting previously unselected package postgresql-10. Preparing to unpack .../4-postgresql-10_10.12-0ubuntu0.18.04.1_amd64.deb ... Unpacking postgresql-10 (10.12-0ubuntu0.18.04.1) ... Selecting previously unselected package postgresql. Preparing to unpack .../5-postgresql_10+190ubuntu0.1_all.deb ... Unpacking postgresql (10+190ubuntu0.1) ... Selecting previously unselected package postgresql-contrib. Preparing to unpack .../6-postgresql-contrib_10+190ubuntu0.1_all.deb ... Unpacking postgresql-contrib (10+190ubuntu0.1) ... Selecting previously unselected package python3-psycopg2. Preparing to unpack .../7-python3-psycopg2_2.7.4-1_amd64.deb ... Unpacking python3-psycopg2 (2.7.4-1) ... Selecting previously unselected package sysstat. Preparing to unpack .../8-sysstat_11.6.1-1ubuntu0.1_amd64.deb ... Unpacking sysstat (11.6.1-1ubuntu0.1) ... Setting up sysstat (11.6.1-1ubuntu0.1) ...

Creating config file /etc/default/sysstat with new version update-alternatives: using /usr/bin/sar.sysstat to provide /usr/bin/sar (sar) in auto mode Created symlink /etc/systemd/system/multi-user.target.wants/sysstat.service → /lib/systemd/system/sysstat.service. Setting up python3-psycopg2 (2.7.4-1) ... Setting up postgresql-client-common (190ubuntu0.1) ... Setting up postgresql-common (190ubuntu0.1) ... Adding user postgres to group ssl-cert

Creating config file /etc/postgresql-common/createcluster.conf with new version Building PostgreSQL dictionaries from installed myspell/hunspell packages... en_us Removing obsolete dictionary files: Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service → /lib/systemd/system/postgresql.service. Setting up openssl (1.1.1-1ubuntu2.1~18.04.6) ... Setting up postgresql-client-10 (10.12-0ubuntu0.18.04.1) ... update-alternatives: using /usr/share/postgresql/10/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode Setting up postgresql-10 (10.12-0ubuntu0.18.04.1) ... Creating new PostgreSQL cluster 10/main ... /usr/lib/postgresql/10/bin/initdb -D /var/lib/postgresql/10/main --auth-local peer --auth-host md5 The files belonging to this database system will be owned by user "postgres". This user must also own the server process.

The database cluster will be initialized with locale "en_US.UTF-8". The default database encoding has accordingly been set to "UTF8". The default text search configuration will be set to "english".

Data page checksums are disabled.

fixing permissions on existing directory /var/lib/postgresql/10/main ... ok creating subdirectories ... ok selecting default max_connections ... 100 selecting default shared_buffers ... 128MB selecting default timezone ... Etc/UTC selecting dynamic shared memory implementation ... posix creating configuration files ... ok running bootstrap script ... ok performing post-bootstrap initialization ... ok syncing data to disk ... ok

Success. You can now start the database server using: /usr/lib/postgresql/10/bin/pg_ctl -D /var/lib/postgresql/10/main -l logfile start

Ver Cluster Port Status Owner Data directory Log file 10 main 5432 down postgres /var/lib/postgresql/10/main /var/log/postgresql/postgresql-10-main.log update-alternatives: using /usr/share/postgresql/10/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode Setting up postgresql (10+190ubuntu0.1) ... Setting up postgresql-contrib (10+190ubuntu0.1) ... Processing triggers for man-db (2.8.3-2ubuntu0.1) ... Processing triggers for ureadahead (0.100.0-21) ... Processing triggers for systemd (237-3ubuntu10.40) ... [+] Creating protected directory. [+] Changing owner of protected directory to user sansforensics. [+] Obtaining Chrome Driver. --2020-07-23 00:19:21-- https://chromedriver.storage.googleapis.com/76.0.3809.12/chromedriver_linux64.zip Resolving chromedriver.storage.googleapis.com (chromedriver.storage.googleapis.com)... 216.58.200.112, 2404:6800:4006:808::2010 Connecting to chromedriver.storage.googleapis.com (chromedriver.storage.googleapis.com)|216.58.200.112|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 5229485 (5.0M) [application/zip] Saving to: ‘chromedriver_linux64.zip’

chromedriver_linux64.zip 100%[===============================================================================>] 4.99M 8.41MB/s in 0.6s

2020-07-23 00:19:23 (8.41 MB/s) - ‘chromedriver_linux64.zip’ saved [5229485/5229485]

Archive: chromedriver_linux64.zip inflating: chromedriver
[+] Setting up python3 dependencies.

Cloning into 'python-pinterest-api'... remote: Enumerating objects: 102, done. remote: Total 102 (delta 0), reused 0 (delta 0), pack-reused 102 Receiving objects: 100% (102/102), 20.78 KiB | 386.00 KiB/s, done. Resolving deltas: 100% (61/61), done. running install running bdist_egg running egg_info creating pinterest_api.egg-info writing pinterest_api.egg-info/PKG-INFO writing dependency_links to pinterest_api.egg-info/dependency_links.txt writing requirements to pinterest_api.egg-info/requires.txt writing top-level names to pinterest_api.egg-info/top_level.txt writing manifest file 'pinterest_api.egg-info/SOURCES.txt' reading manifest file 'pinterest_api.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' writing manifest file 'pinterest_api.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py creating build creating build/lib creating build/lib/pinterest copying pinterest/user.py -> build/lib/pinterest copying pinterest/config.py -> build/lib/pinterest copying pinterest/init.py -> build/lib/pinterest copying pinterest/err.py -> build/lib/pinterest copying pinterest/pin.py -> build/lib/pinterest copying pinterest/section.py -> build/lib/pinterest copying pinterest/me.py -> build/lib/pinterest copying pinterest/oauth2.py -> build/lib/pinterest copying pinterest/util.py -> build/lib/pinterest copying pinterest/board.py -> build/lib/pinterest copying pinterest/version.py -> build/lib/pinterest creating build/bdist.linux-x86_64 creating build/bdist.linux-x86_64/egg creating build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/user.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/config.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/init.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/err.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/pin.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/section.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/me.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/oauth2.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/util.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/board.py -> build/bdist.linux-x86_64/egg/pinterest copying build/lib/pinterest/version.py -> build/bdist.linux-x86_64/egg/pinterest byte-compiling build/bdist.linux-x86_64/egg/pinterest/user.py to user.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/config.py to config.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/init.py to init.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/err.py to err.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/pin.py to pin.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/section.py to section.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/me.py to me.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/oauth2.py to oauth2.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/util.py to util.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/board.py to board.cpython-36.pyc byte-compiling build/bdist.linux-x86_64/egg/pinterest/version.py to version.cpython-36.pyc creating build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/not-zip-safe -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO copying pinterest_api.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO creating dist creating 'dist/pinterest_api-0.0.8-py3.6.egg' and adding 'build/bdist.linux-x86_64/egg' to it removing 'build/bdist.linux-x86_64/egg' (and everything under it) Processing pinterest_api-0.0.8-py3.6.egg creating /usr/local/lib/python3.6/dist-packages/pinterest_api-0.0.8-py3.6.egg Extracting pinterest_api-0.0.8-py3.6.egg to /usr/local/lib/python3.6/dist-packages Adding pinterest-api 0.0.8 to easy-install.pth file

Installed /usr/local/lib/python3.6/dist-packages/pinterest_api-0.0.8-py3.6.egg Processing dependencies for pinterest-api==0.0.8 Searching for requests==2.23.0 Best match: requests 2.23.0 Adding requests 2.23.0 to easy-install.pth file

Using /usr/lib/python3/dist-packages Finished processing dependencies for pinterest-api==0.0.8 Not uninstalling requests at /usr/lib/python3/dist-packages, outside environment /usr Collecting praw (from -r python_requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/2c/15/4bcc44271afce0316c73cd2ed35f951f1363a07d4d5d5440ae5eb2baad78/praw-7.1.0-py3-none-any.whl (152kB) 100% |████████████████████████████████| 153kB 3.1MB/s Requirement already satisfied: pandas in /usr/local/lib/python3.6/dist-packages (from -r python_requirements.txt (line 2)) Requirement already satisfied: feedparser in /usr/local/lib/python3.6/dist-packages (from -r python_requirements.txt (line 3)) Collecting jira (from -r python_requirements.txt (line 4)) Downloading https://files.pythonhosted.org/packages/cb/c2/4203b6cad72d115b0ad62ae7028567b538c8933745f665d0eee5082baf67/jira-2.0.0-py2.py3-none-any.whl (57kB) 100% |████████████████████████████████| 61kB 6.0MB/s Collecting pyhibp (from -r python_requirements.txt (line 5)) Downloading https://files.pythonhosted.org/packages/85/cf/be3473ed77f3dc7bb631675f120cb804a6983aaa2796da161017696db25d/pyhibp-4.1.0-py3-none-any.whl Collecting ebaysdk (from -r python_requirements.txt (line 6)) Downloading https://files.pythonhosted.org/packages/5c/6c/81b7f8cd9561f9b7ccf86f9084a3d5b26aed75e894b207a007312bf87c17/ebaysdk-2.2.0-py3-none-any.whl (72kB) 100% |████████████████████████████████| 81kB 6.3MB/s Collecting google-api-python-client (from -r python_requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/27/90/2f62cfb242ed19e6e76e96434543003990ebefed475c208d6f342d824931/google_api_python_client-1.10.0-py2.py3-none-any.whl (60kB) 100% |████████████████████████████████| 61kB 4.0MB/s Collecting facebook-sdk (from -r python_requirements.txt (line 8)) Downloading https://files.pythonhosted.org/packages/79/d7/4cb0f5930f79205cc45db22e17fa716396d813c3d6b8d5de77783a5fa59a/facebook_sdk-3.1.0-py2.py3-none-any.whl Collecting selenium (from -r python_requirements.txt (line 9)) Downloading https://files.pythonhosted.org/packages/80/d6/4294f0b4bce4de0abf13e17190289f9d0613b0a44e5dd6a7f5ca98459853/selenium-3.141.0-py2.py3-none-any.whl (904kB) 100% |████████████████████████████████| 911kB 1.5MB/s Requirement already satisfied: flask in /usr/local/lib/python3.6/dist-packages (from -r python_requirements.txt (line 10)) Collecting python-crontab (from -r python_requirements.txt (line 11)) Downloading https://files.pythonhosted.org/packages/1b/7e/fb78b96de58a49b8ef807c321870ef4de3de5928fd71a40a400aed714310/python-crontab-2.5.1.tar.gz (52kB) 100% |████████████████████████████████| 61kB 11.1MB/s Collecting instagram_explore (from -r python_requirements.txt (line 12)) Downloading https://files.pythonhosted.org/packages/02/07/bd1d8656e71f28c74a6f6d59b657d214f5f378eccfaa1d0df84bd2cd07aa/instagram-explore-0.3.0.tar.gz Collecting slackclient==2.0.0 (from -r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/a2/b2/b7933cc8a84358283800bd558a38e04f7cde3276404b96e698ea4073dfe1/slackclient-2.0.0-py2.py3-none-any.whl Collecting vulners (from -r python_requirements.txt (line 14)) Downloading https://files.pythonhosted.org/packages/2b/a8/a44b9a111a2aeca458f30018491c4b6b44360e476e405f14d1516bd9b620/vulners-1.5.5-py3-none-any.whl Collecting defectdojo_api (from -r python_requirements.txt (line 15)) Downloading https://files.pythonhosted.org/packages/cc/05/ce252b3957df901ef88ed10fa13e1711ee54c58fc8ab605721f5a19b50e8/defectdojo_api-1.1.4.tar.gz Collecting flickr_api (from -r python_requirements.txt (line 16)) Downloading https://files.pythonhosted.org/packages/5c/41/53bc65eb632ba852474516d426fdfbb93665b42e3a87a724801ef2576f0c/flickr_api-0.7.3-py3-none-any.whl (105kB) 100% |████████████████████████████████| 112kB 5.1MB/s Collecting python-docx (from -r python_requirements.txt (line 17)) Downloading https://files.pythonhosted.org/packages/e4/83/c66a1934ed5ed8ab1dbb9931f1779079f8bca0f6bbc5793c06c4b5e7d671/python-docx-0.8.10.tar.gz (5.5MB) 100% |████████████████████████████████| 5.5MB 262kB/s Collecting flask_compress (from -r python_requirements.txt (line 18)) Downloading https://files.pythonhosted.org/packages/a0/96/cd684c1ffe97b513303b5bfd4bbfb4114c5f4a5ea8a737af6fd813273df8/Flask-Compress-1.5.0.tar.gz Collecting flask_jwt (from -r python_requirements.txt (line 19)) Downloading https://files.pythonhosted.org/packages/9b/8a/5d3b2e593f1fc5c1b464aa1cbf35023a4400a2b53ce6a52801f68d7a1eeb/Flask-JWT-0.3.2.tar.gz Collecting tweepy (from -r python_requirements.txt (line 20)) Downloading https://files.pythonhosted.org/packages/bb/7c/99d51f80f3b77b107ebae2634108717362c059a41384a1810d13e2429a81/tweepy-3.9.0-py2.py3-none-any.whl Collecting ratelimiter (from -r python_requirements.txt (line 21)) Downloading https://files.pythonhosted.org/packages/51/80/2164fa1e863ad52cc8d870855fba0fbb51edd943edffd516d54b5f6f8ff8/ratelimiter-1.2.0.post0-py3-none-any.whl Collecting pyleri (from -r python_requirements.txt (line 22)) Downloading https://files.pythonhosted.org/packages/49/17/3395056129b8090564f00f914640c665eb1206136708b09d5ed3ceb5d898/pyleri-1.3.2.tar.gz Collecting publicsuffix2 (from -r python_requirements.txt (line 23)) Downloading https://files.pythonhosted.org/packages/9d/16/053c2945c5e3aebeefb4ccd5c5e7639e38bc30ad1bdc7ce86c6d01707726/publicsuffix2-2.20191221-py2.py3-none-any.whl (89kB) 100% |████████████████████████████████| 92kB 8.1MB/s Collecting prawcore<2.0,>=1.3.0 (from praw->-r python_requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/61/89/651078078f089c182164efd10d45d3b709b46e4e40b47e63759e76349dc1/prawcore-1.4.0-py3-none-any.whl Collecting update-checker>=0.17 (from praw->-r python_requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/d6/c3/aaf8a162df8e8f9d321237c7c0e63aff95b42d19f1758f96606e3cabb245/update_checker-0.17-py2.py3-none-any.whl Collecting websocket-client>=0.54.0 (from praw->-r python_requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/4c/5f/f61b420143ed1c8dc69f9eaec5ff1ac36109d52c80de49d66e0c36c3dfdf/websocket_client-0.57.0-py2.py3-none-any.whl (200kB) 100% |████████████████████████████████| 204kB 4.3MB/s Requirement already satisfied: pytz>=2011k in /usr/lib/python3/dist-packages (from pandas->-r python_requirements.txt (line 2)) Requirement already satisfied: numpy>=1.12.0 in /usr/local/lib/python3.6/dist-packages (from pandas->-r python_requirements.txt (line 2)) Requirement already satisfied: python-dateutil>=2.5.0 in /usr/local/lib/python3.6/dist-packages (from pandas->-r python_requirements.txt (line 2)) Requirement already satisfied: oauthlib[signedtoken]>=1.0.0 in /usr/local/lib/python3.6/dist-packages (from jira->-r python_requirements.txt (line 4)) Requirement already satisfied: setuptools>=20.10.1 in /usr/local/lib/python3.6/dist-packages (from jira->-r python_requirements.txt (line 4)) Requirement already satisfied: requests>=2.10.0 in /usr/lib/python3/dist-packages (from jira->-r python_requirements.txt (line 4)) Requirement already satisfied: requests-oauthlib>=0.6.1 in /usr/local/lib/python3.6/dist-packages (from jira->-r python_requirements.txt (line 4)) Requirement already satisfied: six>=1.10.0 in /usr/local/lib/python3.6/dist-packages (from jira->-r python_requirements.txt (line 4)) Collecting pbr>=3.0.0 (from jira->-r python_requirements.txt (line 4)) Downloading https://files.pythonhosted.org/packages/96/ba/aa953a11ec014b23df057ecdbc922fdb40ca8463466b1193f3367d2711a6/pbr-5.4.5-py2.py3-none-any.whl (110kB) 100% |████████████████████████████████| 112kB 9.1MB/s Requirement already satisfied: defusedxml in /usr/lib/python3/dist-packages (from jira->-r python_requirements.txt (line 4)) Collecting requests-toolbelt (from jira->-r python_requirements.txt (line 4)) Downloading https://files.pythonhosted.org/packages/60/ef/7681134338fc097acef8d9b2f8abe0458e4d87559c689a8c306d0957ece5/requests_toolbelt-0.9.1-py2.py3-none-any.whl (54kB) 100% |████████████████████████████████| 61kB 11.1MB/s Collecting lxml (from ebaysdk->-r python_requirements.txt (line 6)) Downloading https://files.pythonhosted.org/packages/79/37/d420b7fdc9a550bd29b8cfeacff3b38502d9600b09d7dfae9a69e623b891/lxml-4.5.2-cp36-cp36m-manylinux1_x86_64.whl (5.5MB) 100% |████████████████████████████████| 5.5MB 243kB/s Requirement already satisfied: httplib2<1dev,>=0.9.2 in /usr/lib/python3/dist-packages (from google-api-python-client->-r python_requirements.txt (line 7)) Collecting google-auth-httplib2>=0.0.3 (from google-api-python-client->-r python_requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/bd/4e/992849016f8b0c27fb604aafd0a7a724db16128906197bd1245c6f18e6a1/google_auth_httplib2-0.0.4-py2.py3-none-any.whl Collecting google-auth>=1.16.0 (from google-api-python-client->-r python_requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/b7/4b/ad22f901ef599ac6dcce285f87e8b48067f2b6ff2a5eb0f4ef08227d057f/google_auth-1.19.2-py2.py3-none-any.whl (91kB) 100% |████████████████████████████████| 92kB 9.4MB/s Collecting google-api-core<2dev,>=1.18.0 (from google-api-python-client->-r python_requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/bf/d5/a43e91cc1a1822b248033a7aca72637abe890e81fce4913497f7d0c1f91f/google_api_core-1.22.0-py2.py3-none-any.whl (91kB) 100% |████████████████████████████████| 92kB 9.9MB/s Collecting uritemplate<4dev,>=3.0.0 (from google-api-python-client->-r python_requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/bf/0c/60d82c077998feb631608dca3cc1fe19ac074e772bf0c24cf409b977b815/uritemplate-3.0.1-py2.py3-none-any.whl Requirement already satisfied: urllib3 in /usr/lib/python3/dist-packages (from selenium->-r python_requirements.txt (line 9)) Requirement already satisfied: itsdangerous>=0.24 in /usr/local/lib/python3.6/dist-packages (from flask->-r python_requirements.txt (line 10)) Requirement already satisfied: click>=5.1 in /usr/local/lib/python3.6/dist-packages (from flask->-r python_requirements.txt (line 10)) Requirement already satisfied: Jinja2>=2.10.1 in /usr/local/lib/python3.6/dist-packages (from flask->-r python_requirements.txt (line 10)) Requirement already satisfied: Werkzeug>=0.15 in /usr/local/lib/python3.6/dist-packages (from flask->-r python_requirements.txt (line 10)) Collecting aiohttp>3.5.2 (from slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/7c/39/7eb5f98d24904e0f6d3edb505d4aa60e3ef83c0a58d6fe18244a51757247/aiohttp-3.6.2-cp36-cp36m-manylinux1_x86_64.whl (1.2MB) 100% |████████████████████████████████| 1.2MB 1.1MB/s Collecting aiodns>1.0 (from slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/da/01/8f2d49b441573fd2478833bdba91cf0b853b4c750a1fbb9e98de1b94bb22/aiodns-2.0.0-py2.py3-none-any.whl Collecting oauth2 (from flickr_api->-r python_requirements.txt (line 16)) Downloading https://files.pythonhosted.org/packages/a0/6f/86db603912ecd04109af952c38bc08928886cf0e34c723481fa7db98b4b5/oauth2-1.9.0.post1-py2.py3-none-any.whl Collecting brotli (from flask_compress->-r python_requirements.txt (line 18)) Downloading https://files.pythonhosted.org/packages/f4/68/60a220454dc5083c6d59b41aa90bb1c96fad62a0abf3a33e0ef64b38638a/Brotli-1.0.7-cp36-cp36m-manylinux1_x86_64.whl (352kB) 100% |████████████████████████████████| 358kB 2.1MB/s Collecting PyJWT<1.5.0,>=1.4.0 (from flask_jwt->-r python_requirements.txt (line 19)) Downloading https://files.pythonhosted.org/packages/b8/9c/1973e3117d43527a42f2a8afbc81e48d69a537d6e2c39412049b1592d1e2/PyJWT-1.4.2-py2.py3-none-any.whl Requirement already satisfied: cryptography; extra == "signedtoken" in /usr/local/lib/python3.6/dist-packages (from oauthlib[signedtoken]>=1.0.0->jira->-r python_requirements.txt (line 4)) Requirement already satisfied: pyasn1-modules>=0.2.1 in /usr/local/lib/python3.6/dist-packages (from google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) Requirement already satisfied: cachetools<5.0,>=2.0.0 in /usr/local/lib/python3.6/dist-packages (from google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) Requirement already satisfied: rsa<5,>=3.1.4; python_version >= "3" in /usr/local/lib/python3.6/dist-packages (from google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) Collecting googleapis-common-protos<2.0dev,>=1.6.0 (from google-api-core<2dev,>=1.18.0->google-api-python-client->-r python_requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/03/74/3956721ea1eb4bcf7502a311fdaa60b85bd751de4e57d1943afe9b334141/googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100kB) 100% |████████████████████████████████| 102kB 10.9MB/s Collecting protobuf>=3.12.0 (from google-api-core<2dev,>=1.18.0->google-api-python-client->-r python_requirements.txt (line 7)) Downloading https://files.pythonhosted.org/packages/28/05/9867ef8eafd12265267bee138fa2c46ebf34a276ea4cbe184cba4c606e8b/protobuf-3.12.2-cp36-cp36m-manylinux1_x86_64.whl (1.3MB) 100% |████████████████████████████████| 1.3MB 1.1MB/s Requirement already satisfied: MarkupSafe>=0.23 in /usr/lib/python3/dist-packages (from Jinja2>=2.10.1->flask->-r python_requirements.txt (line 10)) Collecting async-timeout<4.0,>=3.0 (from aiohttp>3.5.2->slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/e1/1e/5a4441be21b0726c4464f3f23c8b19628372f606755a9d2e46c187e65ec4/async_timeout-3.0.1-py3-none-any.whl Collecting yarl<2.0,>=1.0 (from aiohttp>3.5.2->slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/95/8f/0209fc5d975f839344c33c822ff2f7ef80f6b1e984673a5a68f960bfa583/yarl-1.4.2-cp36-cp36m-manylinux1_x86_64.whl (252kB) 100% |████████████████████████████████| 256kB 4.4MB/s Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.6/dist-packages (from aiohttp>3.5.2->slackclient==2.0.0->-r python_requirements.txt (line 13)) Collecting idna-ssl>=1.0; python_version < "3.7" (from aiohttp>3.5.2->slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/46/03/07c4894aae38b0de52b52586b24bf189bb83e4ddabfe2e2c8f2419eec6f4/idna-ssl-1.1.0.tar.gz Requirement already satisfied: chardet<4.0,>=2.0 in /usr/lib/python3/dist-packages (from aiohttp>3.5.2->slackclient==2.0.0->-r python_requirements.txt (line 13)) Collecting typing-extensions>=3.6.5; python_version < "3.7" (from aiohttp>3.5.2->slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/0c/0e/3f026d0645d699e7320b59952146d56ad7c374e9cd72cd16e7c74e657a0f/typing_extensions-3.7.4.2-py3-none-any.whl Collecting multidict<5.0,>=4.5 (from aiohttp>3.5.2->slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/1a/95/f50352b5366e7d579e8b99631680a9e32e1b22adfa1629a8f23b1d22d5e2/multidict-4.7.6-cp36-cp36m-manylinux1_x86_64.whl (148kB) 100% |████████████████████████████████| 153kB 8.2MB/s Collecting pycares>=3.0.0 (from aiodns>1.0->slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/96/bc/1de12c0ea1de6c5454ca8e49479b5af162163b6c274f5302ba93e979d5b6/pycares-3.1.1-cp36-cp36m-manylinux1_x86_64.whl (228kB) 100% |████████████████████████████████| 235kB 4.0MB/s Collecting typing; python_version < "3.7" (from aiodns>1.0->slackclient==2.0.0->-r python_requirements.txt (line 13)) Downloading https://files.pythonhosted.org/packages/05/d9/6eebe19d46bd05360c9a9aae822e67a80f9242aabbfc58b641b957546607/typing-3.7.4.3.tar.gz (78kB) 100% |████████████████████████████████| 81kB 13.8MB/s Requirement already satisfied: cffi!=1.11.3,>=1.7 in /usr/lib/python3/dist-packages (from cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira->-r python_requirements.txt (line 4)) Requirement already satisfied: asn1crypto>=0.21.0 in /usr/lib/python3/dist-packages (from cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira->-r python_requirements.txt (line 4)) Requirement already satisfied: idna>=2.1 in /usr/lib/python3/dist-packages (from cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira->-r python_requirements.txt (line 4)) Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /usr/local/lib/python3.6/dist-packages (from pyasn1-modules>=0.2.1->google-auth>=1.16.0->google-api-python-client->-r python_requirements.txt (line 7)) Building wheels for collected packages: python-crontab, instagram-explore, defectdojo-api, python-docx, flask-compress, flask-jwt, pyleri, idna-ssl, typing Running setup.py bdist_wheel for python-crontab ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/19/50/42/06995ff42f973fc9e4e5620da17a51e43771c9d3e299cb0602 Running setup.py bdist_wheel for instagram-explore ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/e0/6c/05/1b4f335ddfc86f6a9513f6cde325843c0d8acd2a20f925da8d Running setup.py bdist_wheel for defectdojo-api ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/b6/59/b6/a9fa696d396524fc736ca8f3ec7ae3a6be196849ea43ad6f18 Running setup.py bdist_wheel for python-docx ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/18/0b/a0/1dd62ff812c857c9e487f27d80d53d2b40531bec1acecfa47b Running setup.py bdist_wheel for flask-compress ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/f7/e9/e4/5afc286be7c87461375e33152558415dfeb0c8f5af3b50e742 Running setup.py bdist_wheel for flask-jwt ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/a6/8b/1f/f42f18eea64a0884185293ff01c32124c49da0e62739815f51 Running setup.py bdist_wheel for pyleri ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/1d/90/ca/d16e0b018e5c0703bd40368624d6e4c7b2f69e1af5ebdec7c6 Running setup.py bdist_wheel for idna-ssl ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/d3/00/b3/32d613e19e08a739751dd6bf998cfed277728f8b2127ad4eb7 Running setup.py bdist_wheel for typing ... done Stored in directory: /home/sansforensics/.cache/pip/wheels/2d/04/41/8e1836e79581989c22eebac3f4e70aaac9af07b0908da173be Successfully built python-crontab instagram-explore defectdojo-api python-docx flask-compress flask-jwt pyleri idna-ssl typing Installing collected packages: prawcore, update-checker, websocket-client, praw, pbr, requests-toolbelt, jira, pyhibp, lxml, ebaysdk, google-auth, google-auth-httplib2, protobuf, googleapis-common-protos, google-api-core, uritemplate, google-api-python-client, facebook-sdk, selenium, python-crontab, instagram-explore, async-timeout, multidict, yarl, idna-ssl, typing-extensions, aiohttp, pycares, typing, aiodns, slackclient, vulners, defectdojo-api, oauth2, flickr-api, python-docx, brotli, flask-compress, PyJWT, flask-jwt, tweepy, ratelimiter, pyleri, publicsuffix2 Found existing installation: google-auth 1.7.0 Uninstalling google-auth-1.7.0: Successfully uninstalled google-auth-1.7.0 Found existing installation: protobuf 3.0.0 Not uninstalling protobuf at /usr/lib/python3/dist-packages, outside environment /usr Found existing installation: PyJWT 1.7.1 Uninstalling PyJWT-1.7.1: Successfully uninstalled PyJWT-1.7.1 Successfully installed PyJWT-1.4.2 aiodns-2.0.0 aiohttp-3.6.2 async-timeout-3.0.1 brotli-1.0.7 defectdojo-api-1.1.4 ebaysdk-2.2.0 facebook-sdk-3.1.0 flask-compress-1.5.0 flask-jwt-0.3.2 flickr-api-0.7.3 google-api-core-1.22.0 google-api-python-client-1.10.0 google-auth-1.19.2 google-auth-httplib2-0.0.4 googleapis-common-protos-1.52.0 idna-ssl-1.1.0 instagram-explore-0.3.0 jira-2.0.0 lxml-4.5.2 multidict-4.7.6 oauth2-1.9.0.post1 pbr-5.4.5 praw-7.1.0 prawcore-1.4.0 protobuf-3.12.2 publicsuffix2-2.20191221 pycares-3.1.1 pyhibp-4.1.0 pyleri-1.3.2 python-crontab-2.5.1 python-docx-0.8.10 ratelimiter-1.2.0.post0 requests-toolbelt-0.9.1 selenium-3.141.0 slackclient-2.0.0 tweepy-3.9.0 typing-3.7.4.3 typing-extensions-3.7.4.2 update-checker-0.17 uritemplate-3.0.1 vulners-1.5.5 websocket-client-0.57.0 yarl-1.4.2 mv: cannot move 'site-packages/defectdojo.py' to '/home/sansforensics/.local/lib/python3.6/site-packages/defectdojo.py': No such file or directory

[+] Dependency installation complete. Configuring.

[+] Environment variable added to startup. CREATE DATABASE CREATE ROLE GRANT [+] Database has been created with the following details, please retain these for later. Database Details: Database: scrummage Username: scrummage Password:

[+] Creating Tables using Create_Tables.py

[+] Users table created successfully in PostgreSQL. [+] Tasks table created successfully in PostgreSQL. [+] Results table created successfully in PostgreSQL. [+] Events table created successfully in PostgreSQL. Table created successfully in PostgreSQL PostgreSQL connection closed.

[+] Generating JSON configuration for the web application. [+] Creating Admin user using Create_User.py

[+] Admin user created, user details: Username: admin Password:

[+] Script finished.

user@linux: ~/Downloads/Scrummage/installation $ cd ../

user@linux: ~/Downloads/Scrummage $ mkdir certs && cd certs

user@linux: ~/Downloads/Scrummage/certs $ openssl req -x509 -sha256 -nodes -days 365 -newkey rsa:2048 -keyout privateKey.key -out certificate.crt Can't load /home/sansforensics/.rnd into RNG 139710681932224:error:2406F079:random number generator:RAND_load_file:Cannot open file:../crypto/rand/randfile.c:88:Filename=/home/sansforensics/.rnd Generating a RSA private key .....+++++ .........+++++ writing new private key to 'privateKey.key'

You are about to be asked to enter information that will be incorporated into your certificate request. What you are about to enter is what is called a Distinguished Name or a DN. There are quite a few fields but you can leave some blank For some fields there will be a default value, If you enter '.', the field will be left blank.

Country Name (2 letter code) [AU]:AU State or Province Name (full name) [Some-State]:NSW Locality Name (eg, city) []:Sydney Organization Name (eg, company) [Internet Widgits Pty Ltd]:Scrummage Organizational Unit Name (eg, section) []:Scrummage Common Name (e.g. server FQDN or YOUR name) []:Scrummage
Email Address []:test@test.com

user@linux: ~/Downloads/Scrummage/certs $ ls certificate.crt privateKey.key

user@linux: ~/Downloads/Scrummage/certs $ cd ../lib/

user@linux: ~/Downloads/Scrummage/lib $ python3 Scrummage.py

Serving Flask app "Scrummage" (lazy loading)
Environment: production WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
Debug mode: off INFO:werkzeug: * Running on https://127.0.0.1:5000/ (Press CTRL+C to quit)

matamorphosis commented 4 years ago

Hi Maria,

Just following up, did this information help you resolve your installation issues?

matamorphosis commented 3 years ago

Hi Maria,

I recalled that you were unable to set up Scrummage when you attempted to install it almost a year ago. If you are still interested we have recently created a docker image which automates the whole process, it just requires some knowledge on docker like how to install docker, run the dockerfile and access the web application via the docker IP in your system.

You can find the link here.

matamorphosis / Scrummage

issue with the requirements.txt file #14