ShahriyarR / MySQL-AutoXtraBackup

MySQL-AutoXtraBackup commandline tool written in Python 3 based on Percona XtraBackup
https://autoxtrabackup.azepug.az/
MIT License
141 stars 78 forks source link

Config not generated on setup #446

Open JasperAlgra opened 3 years ago

JasperAlgra commented 3 years ago

Hi,

When installing the new v.2 (awesome by the way!) the config dir ~/.autoxtrabackup and config files are not created. Host: Debian 10. Command:

root@dev:~# pip3 install mysql-autoxtrabackup

as root. Result of install:

WARNING: Value for scheme.platlib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/lib/python3.7/dist-packages
sysconfig: /usr/lib/python3.7/site-packages
WARNING: Value for scheme.purelib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/lib/python3.7/dist-packages
sysconfig: /usr/lib/python3.7/site-packages
WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/include/python3.7/UNKNOWN
sysconfig: /usr/include/python3.7m/UNKNOWN
WARNING: Value for scheme.scripts does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/bin
sysconfig: /usr/bin
WARNING: Value for scheme.data does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local
sysconfig: /usr
WARNING: Additional context:
user = False
home = None
root = None
prefix = None
Collecting mysql-autoxtrabackup
  Using cached mysql_autoxtrabackup-2.0.2-py3-none-any.whl (36 kB)
Requirement already satisfied: pid>=2.0 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (3.0.4)
Requirement already satisfied: humanfriendly>=2.0 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (9.2)
Requirement already satisfied: fastapi>=0.63.0 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (0.67.0)
Requirement already satisfied: click>=3.3 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (8.0.1)
Requirement already satisfied: uvicorn>=0.13.4 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (0.14.0)
Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from click>=3.3->mysql-autoxtrabackup) (4.6.1)
Requirement already satisfied: pydantic!=1.7,!=1.7.1,!=1.7.2,!=1.7.3,!=1.8,!=1.8.1,<2.0.0,>=1.6.2 in /usr/local/lib/python3.7/dist-packages (from fastapi>=0.63.0->mysql-autoxtrabackup) (1.8.2)
Requirement already satisfied: starlette==0.14.2 in /usr/local/lib/python3.7/dist-packages (from fastapi>=0.63.0->mysql-autoxtrabackup) (0.14.2)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.7/dist-packages (from pydantic!=1.7,!=1.7.1,!=1.7.2,!=1.7.3,!=1.8,!=1.8.1,<2.0.0,>=1.6.2->fastapi>=0.63.0->mysql-autoxtrabackup) (3.10.0.0)
Requirement already satisfied: h11>=0.8 in /usr/local/lib/python3.7/dist-packages (from uvicorn>=0.13.4->mysql-autoxtrabackup) (0.12.0)
Requirement already satisfied: asgiref>=3.3.4 in /usr/local/lib/python3.7/dist-packages (from uvicorn>=0.13.4->mysql-autoxtrabackup) (3.4.1)
Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata->click>=3.3->mysql-autoxtrabackup) (3.5.0)
Installing collected packages: mysql-autoxtrabackup
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /usr/local/include/python3.7/mysql-autoxtrabackup
  sysconfig: /usr/include/python3.7m/mysql-autoxtrabackup
Successfully installed mysql-autoxtrabackup-2.0.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

The dir ~/.autoxtrabackup and config files are not created. I'm not sufficient enough in Python to quickly see why the __init__.py from general_conf isn't doing it's job. I've cleared the pip cache, same result. I've also tried building from source, please see log all the way down.

Thus autoxtrabackup is not working:

root@dev:~# autoxtrabackup --dry-run
Missing config file : /root/.autoxtrabackup/autoxtrabackup.cnf
Traceback (most recent call last):
  File "/usr/local/bin/autoxtrabackup", line 8, in <module>
    sys.exit(all_procedure())
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1137, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1062, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 763, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/mysql_autoxtrabackup/autoxtrabackup.py", line 196, in all_procedure
    logging_options = options.logging_options
  File "/usr/local/lib/python3.7/dist-packages/mysql_autoxtrabackup/general_conf/generalops.py", line 42, in logging_options
    "log_level": self.con.get(section, "log"),
AttributeError: 'GeneralClass' object has no attribute 'con'

If I can provide more info please let me now

Building from source log:

mysqlbackup@dev:~/MySQL-AutoXtraBackup$ flit install --symlink
Fetching list of valid trove classifiers                                                                                                                                                                                                                            I-flit.validate
Extras to install for deps 'all': {'all', 'doc', '.none', 'dev', 'test'}                                                                                                                                                                                             I-flit.install
Installing requirements                                                                                                                                                                                                                                              I-flit.install
Requirement already satisfied: click>=3.3 in /usr/local/lib/python3.7/dist-packages (from -r /tmp/tmpkgl4acvwrequirements.txt (line 1)) (8.0.1)
Requirement already satisfied: pid>=2.0 in /usr/local/lib/python3.7/dist-packages (from -r /tmp/tmpkgl4acvwrequirements.txt (line 2)) (3.0.4)
Requirement already satisfied: humanfriendly>=2.0 in /usr/local/lib/python3.7/dist-packages (from -r /tmp/tmpkgl4acvwrequirements.txt (line 3)) (9.2)
Collecting sphinx
  Downloading Sphinx-4.1.2-py3-none-any.whl (2.9 MB)
     |████████████████████████████████| 2.9 MB 4.5 MB/s
Collecting sphinx_rtd_theme
  Downloading sphinx_rtd_theme-0.5.2-py2.py3-none-any.whl (9.1 MB)
     |████████████████████████████████| 9.1 MB 24.7 MB/s
Collecting sphinx-autobuild
  Downloading sphinx_autobuild-2021.3.14-py3-none-any.whl (9.9 kB)
Collecting jinja2>=2.11.3
  Downloading Jinja2-3.0.1-py3-none-any.whl (133 kB)
     |████████████████████████████████| 133 kB 29.9 MB/s
Requirement already satisfied: fastapi>=0.63.0 in /usr/local/lib/python3.7/dist-packages (from -r /tmp/tmpkgl4acvwrequirements.txt (line 8)) (0.67.0)
Requirement already satisfied: uvicorn>=0.13.4 in /usr/local/lib/python3.7/dist-packages (from -r /tmp/tmpkgl4acvwrequirements.txt (line 9)) (0.14.0)
Collecting pytest==5.4.3
  Downloading pytest-5.4.3-py3-none-any.whl (248 kB)
     |████████████████████████████████| 248 kB 32.8 MB/s
Collecting pytest-cov==2.10.0
  Downloading pytest_cov-2.10.0-py2.py3-none-any.whl (19 kB)
Collecting mypy==0.812
  Downloading mypy-0.812-cp37-cp37m-manylinux2010_x86_64.whl (21.6 MB)
     |████████████████████████████████| 21.6 MB 214 kB/s
Collecting isort<6.0.0,>=5.0.6
  Downloading isort-5.9.3-py3-none-any.whl (106 kB)
     |████████████████████████████████| 106 kB 31.2 MB/s
Collecting flake8<4.0.0,>=3.8.3
  Downloading flake8-3.9.2-py2.py3-none-any.whl (73 kB)
     |████████████████████████████████| 73 kB 466 kB/s
Collecting black==20.8b1
  Downloading black-20.8b1.tar.gz (1.1 MB)
     |████████████████████████████████| 1.1 MB 21.0 MB/s
  WARNING: Value for purelib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /usr/lib/python3/dist-packages
  sysconfig: /usr/lib/python3.7/site-packages
  WARNING: Additional context:
  user = False
  home = None
  root = None
  prefix = None
  WARNING: Value for platlib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /usr/lib/python3/dist-packages
  sysconfig: /usr/lib/python3.7/site-packages
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Collecting py>=1.5.0
  Downloading py-1.10.0-py2.py3-none-any.whl (97 kB)
     |████████████████████████████████| 97 kB 2.2 MB/s
Collecting packaging
  Downloading packaging-21.0-py3-none-any.whl (40 kB)
     |████████████████████████████████| 40 kB 1.5 MB/s
Collecting attrs>=17.4.0
  Downloading attrs-21.2.0-py2.py3-none-any.whl (53 kB)
     |████████████████████████████████| 53 kB 697 kB/s
Collecting pluggy<1.0,>=0.12
  Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
  Downloading more_itertools-8.8.0-py3-none-any.whl (48 kB)
     |████████████████████████████████| 48 kB 1.5 MB/s
Collecting wcwidth
  Downloading wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: importlib-metadata>=0.12 in /usr/local/lib/python3.7/dist-packages (from pytest==5.4.3->-r /tmp/tmpkgl4acvwrequirements.txt (line 22)) (4.6.1)
Collecting coverage>=4.4
  Downloading coverage-5.5-cp37-cp37m-manylinux2010_x86_64.whl (242 kB)
     |████████████████████████████████| 242 kB 22.4 MB/s
Collecting mypy-extensions<0.5.0,>=0.4.3
  Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)
Requirement already satisfied: typing-extensions>=3.7.4 in /usr/local/lib/python3.7/dist-packages (from mypy==0.812->-r /tmp/tmpkgl4acvwrequirements.txt (line 24)) (3.10.0.0)
Collecting typed-ast<1.5.0,>=1.4.0
  Downloading typed_ast-1.4.3-cp37-cp37m-manylinux1_x86_64.whl (743 kB)
     |████████████████████████████████| 743 kB 26.6 MB/s
Collecting pathspec<1,>=0.6
  Downloading pathspec-0.9.0-py2.py3-none-any.whl (31 kB)
Collecting regex>=2020.1.8
  Downloading regex-2021.7.6-cp37-cp37m-manylinux2014_x86_64.whl (721 kB)
     |████████████████████████████████| 721 kB 23.8 MB/s
Requirement already satisfied: toml>=0.10.1 in /usr/local/lib/python3.7/dist-packages (from black==20.8b1->-r /tmp/tmpkgl4acvwrequirements.txt (line 27)) (0.10.2)
Collecting appdirs
  Downloading appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Collecting snowballstemmer>=1.1
  Downloading snowballstemmer-2.1.0-py2.py3-none-any.whl (93 kB)
     |████████████████████████████████| 93 kB 650 kB/s
Requirement already satisfied: docutils<0.18,>=0.14 in /usr/local/lib/python3.7/dist-packages (from sphinx->-r /tmp/tmpkgl4acvwrequirements.txt (line 4)) (0.17.1)
Collecting babel>=1.3
  Downloading Babel-2.9.1-py2.py3-none-any.whl (8.8 MB)
     |████████████████████████████████| 8.8 MB 29.7 MB/s
Collecting imagesize
  Downloading imagesize-1.2.0-py2.py3-none-any.whl (4.8 kB)
Collecting sphinxcontrib-serializinghtml>=1.1.5
  Downloading sphinxcontrib_serializinghtml-1.1.5-py2.py3-none-any.whl (94 kB)
     |████████████████████████████████| 94 kB 770 kB/s
Collecting sphinxcontrib-htmlhelp>=2.0.0
  Downloading sphinxcontrib_htmlhelp-2.0.0-py2.py3-none-any.whl (100 kB)
     |████████████████████████████████| 100 kB 3.0 MB/s
Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from sphinx->-r /tmp/tmpkgl4acvwrequirements.txt (line 4)) (40.8.0)
Collecting sphinxcontrib-jsmath
  Downloading sphinxcontrib_jsmath-1.0.1-py2.py3-none-any.whl (5.1 kB)
Collecting sphinxcontrib-devhelp
  Downloading sphinxcontrib_devhelp-1.0.2-py2.py3-none-any.whl (84 kB)
     |████████████████████████████████| 84 kB 1.0 MB/s
Collecting Pygments>=2.0
  Downloading Pygments-2.9.0-py3-none-any.whl (1.0 MB)
     |████████████████████████████████| 1.0 MB 21.3 MB/s
Collecting alabaster<0.8,>=0.7
  Downloading alabaster-0.7.12-py2.py3-none-any.whl (14 kB)
Collecting sphinxcontrib-applehelp
  Downloading sphinxcontrib_applehelp-1.0.2-py2.py3-none-any.whl (121 kB)
     |████████████████████████████████| 121 kB 24.1 MB/s
Requirement already satisfied: requests>=2.5.0 in /usr/lib/python3/dist-packages (from sphinx->-r /tmp/tmpkgl4acvwrequirements.txt (line 4)) (2.21.0)
Collecting sphinxcontrib-qthelp
  Downloading sphinxcontrib_qthelp-1.0.3-py2.py3-none-any.whl (90 kB)
     |████████████████████████████████| 90 kB 2.8 MB/s
Collecting docutils<0.18,>=0.14
  Downloading docutils-0.16-py2.py3-none-any.whl (548 kB)
     |████████████████████████████████| 548 kB 18.8 MB/s
Collecting colorama
  Downloading colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting livereload
  Downloading livereload-2.6.3.tar.gz (25 kB)
Collecting MarkupSafe>=2.0
  Downloading MarkupSafe-2.0.1-cp37-cp37m-manylinux2010_x86_64.whl (31 kB)
Requirement already satisfied: starlette==0.14.2 in /usr/local/lib/python3.7/dist-packages (from fastapi>=0.63.0->-r /tmp/tmpkgl4acvwrequirements.txt (line 8)) (0.14.2)
Requirement already satisfied: pydantic!=1.7,!=1.7.1,!=1.7.2,!=1.7.3,!=1.8,!=1.8.1,<2.0.0,>=1.6.2 in /usr/local/lib/python3.7/dist-packages (from fastapi>=0.63.0->-r /tmp/tmpkgl4acvwrequirements.txt (line 8)) (1.8.2)
Requirement already satisfied: asgiref>=3.3.4 in /usr/local/lib/python3.7/dist-packages (from uvicorn>=0.13.4->-r /tmp/tmpkgl4acvwrequirements.txt (line 9)) (3.4.1)
Requirement already satisfied: h11>=0.8 in /usr/local/lib/python3.7/dist-packages (from uvicorn>=0.13.4->-r /tmp/tmpkgl4acvwrequirements.txt (line 9)) (0.12.0)
Collecting pyflakes<2.4.0,>=2.3.0
  Downloading pyflakes-2.3.1-py2.py3-none-any.whl (68 kB)
     |████████████████████████████████| 68 kB 1.9 MB/s
Collecting pycodestyle<2.8.0,>=2.7.0
  Downloading pycodestyle-2.7.0-py2.py3-none-any.whl (41 kB)
     |████████████████████████████████| 41 kB 146 kB/s
Collecting mccabe<0.7.0,>=0.6.0
  Downloading mccabe-0.6.1-py2.py3-none-any.whl (8.6 kB)
Collecting pytz>=2015.7
  Downloading pytz-2021.1-py2.py3-none-any.whl (510 kB)
     |████████████████████████████████| 510 kB 24.9 MB/s
Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata>=0.12->pytest==5.4.3->-r /tmp/tmpkgl4acvwrequirements.txt (line 22)) (3.5.0)
Requirement already satisfied: six in /usr/lib/python3/dist-packages (from livereload->sphinx-autobuild->-r /tmp/tmpkgl4acvwrequirements.txt (line 6)) (1.12.0)
Collecting tornado
  Downloading tornado-6.1-cp37-cp37m-manylinux2010_x86_64.whl (428 kB)
     |████████████████████████████████| 428 kB 24.7 MB/s
Collecting pyparsing>=2.0.2
  Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
     |████████████████████████████████| 67 kB 1.7 MB/s
Building wheels for collected packages: black, livereload
  Building wheel for black (PEP 517) ... done
  Created wheel for black: filename=black-20.8b1-py3-none-any.whl size=124195 sha256=6d5a0e1d1bd1818f019a8d261ea3de883d45a0c9116bcc795f5ac03ed921eb23
  Stored in directory: /home/mysqlbackup/.cache/pip/wheels/c5/85/79/f3af8daaf8037c0bf14beb3b7a1511a39b6e6902ca2aaf494e
  Building wheel for livereload (setup.py) ... done
  Created wheel for livereload: filename=livereload-2.6.3-py2.py3-none-any.whl size=24713 sha256=8f09b79df68dbec52e11fe3cdabaef801ad96431471ac16126c9df1880a146ce
  Stored in directory: /home/mysqlbackup/.cache/pip/wheels/d4/f2/03/55f37093eb8cb0c89d7efb206f792dba55cd5bd67b1c5b1ce1
Successfully built black livereload
Installing collected packages: pytz, pyparsing, MarkupSafe, wcwidth, tornado, sphinxcontrib-serializinghtml, sphinxcontrib-qthelp, sphinxcontrib-jsmath, sphinxcontrib-htmlhelp, sphinxcontrib-devhelp, sphinxcontrib-applehelp, snowballstemmer, Pygments, py, pluggy, packaging, more-itertools, jinja2, imagesize, docutils, babel, attrs, alabaster, typed-ast, sphinx, regex, pytest, pyflakes, pycodestyle, pathspec, mypy-extensions, mccabe, livereload, coverage, colorama, appdirs, sphinx-rtd-theme, sphinx-autobuild, pytest-cov, mypy, isort, flake8, black
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pytz
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pytz
  WARNING: Additional context:
  user = True
  home = None
  root = None
  prefix = None
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pyparsing
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pyparsing
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/MarkupSafe
  sysconfig: /home/mysqlbackup/.local/include/python3.7/MarkupSafe
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/wcwidth
  sysconfig: /home/mysqlbackup/.local/include/python3.7/wcwidth
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/tornado
  sysconfig: /home/mysqlbackup/.local/include/python3.7/tornado
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinxcontrib-serializinghtml
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinxcontrib-serializinghtml
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinxcontrib-qthelp
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinxcontrib-qthelp
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinxcontrib-jsmath
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinxcontrib-jsmath
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinxcontrib-htmlhelp
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinxcontrib-htmlhelp
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinxcontrib-devhelp
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinxcontrib-devhelp
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinxcontrib-applehelp
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinxcontrib-applehelp
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/snowballstemmer
  sysconfig: /home/mysqlbackup/.local/include/python3.7/snowballstemmer
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/Pygments
  sysconfig: /home/mysqlbackup/.local/include/python3.7/Pygments
  WARNING: The script pygmentize is installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/py
  sysconfig: /home/mysqlbackup/.local/include/python3.7/py
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pluggy
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pluggy
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/packaging
  sysconfig: /home/mysqlbackup/.local/include/python3.7/packaging
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/more-itertools
  sysconfig: /home/mysqlbackup/.local/include/python3.7/more-itertools
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/jinja2
  sysconfig: /home/mysqlbackup/.local/include/python3.7/jinja2
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/imagesize
  sysconfig: /home/mysqlbackup/.local/include/python3.7/imagesize
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/docutils
  sysconfig: /home/mysqlbackup/.local/include/python3.7/docutils
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/babel
  sysconfig: /home/mysqlbackup/.local/include/python3.7/babel
  WARNING: The script pybabel is installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/attrs
  sysconfig: /home/mysqlbackup/.local/include/python3.7/attrs
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/alabaster
  sysconfig: /home/mysqlbackup/.local/include/python3.7/alabaster
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/typed-ast
  sysconfig: /home/mysqlbackup/.local/include/python3.7/typed-ast
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinx
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinx
  WARNING: The scripts sphinx-apidoc, sphinx-autogen, sphinx-build and sphinx-quickstart are installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/regex
  sysconfig: /home/mysqlbackup/.local/include/python3.7/regex
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pytest
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pytest
  WARNING: The scripts py.test and pytest are installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pyflakes
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pyflakes
  WARNING: The script pyflakes is installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pycodestyle
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pycodestyle
  WARNING: The script pycodestyle is installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pathspec
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pathspec
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/mypy-extensions
  sysconfig: /home/mysqlbackup/.local/include/python3.7/mypy-extensions
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/mccabe
  sysconfig: /home/mysqlbackup/.local/include/python3.7/mccabe
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/livereload
  sysconfig: /home/mysqlbackup/.local/include/python3.7/livereload
  WARNING: The script livereload is installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/coverage
  sysconfig: /home/mysqlbackup/.local/include/python3.7/coverage
  WARNING: The scripts coverage, coverage-3.7 and coverage3 are installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/colorama
  sysconfig: /home/mysqlbackup/.local/include/python3.7/colorama
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/appdirs
  sysconfig: /home/mysqlbackup/.local/include/python3.7/appdirs
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinx-rtd-theme
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinx-rtd-theme
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/sphinx-autobuild
  sysconfig: /home/mysqlbackup/.local/include/python3.7/sphinx-autobuild
  WARNING: The script sphinx-autobuild is installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/pytest-cov
  sysconfig: /home/mysqlbackup/.local/include/python3.7/pytest-cov
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/mypy
  sysconfig: /home/mysqlbackup/.local/include/python3.7/mypy
  WARNING: The scripts dmypy, mypy, stubgen and stubtest are installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/isort
  sysconfig: /home/mysqlbackup/.local/include/python3.7/isort
  WARNING: The scripts isort and isort-identify-imports are installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/flake8
  sysconfig: /home/mysqlbackup/.local/include/python3.7/flake8
  WARNING: The script flake8 is installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /home/mysqlbackup/.local/include/python3.7m/black
  sysconfig: /home/mysqlbackup/.local/include/python3.7/black
  WARNING: The scripts black, black-primer and blackd are installed in '/home/mysqlbackup/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /home/mysqlbackup/.local/include/python3.7m/UNKNOWN
sysconfig: /home/mysqlbackup/.local/include/python3.7/UNKNOWN
Successfully installed MarkupSafe-2.0.1 Pygments-2.9.0 alabaster-0.7.12 appdirs-1.4.4 attrs-21.2.0 babel-2.9.1 black-20.8b1 colorama-0.4.4 coverage-5.5 docutils-0.16 flake8-3.9.2 imagesize-1.2.0 isort-5.9.3 jinja2-3.0.1 livereload-2.6.3 mccabe-0.6.1 more-itertools-8.8.0 mypy-0.812 mypy-extensions-0.4.3 packaging-21.0 pathspec-0.9.0 pluggy-0.13.1 py-1.10.0 pycodestyle-2.7.0 pyflakes-2.3.1 pyparsing-2.4.7 pytest-5.4.3 pytest-cov-2.10.0 pytz-2021.1 regex-2021.7.6 snowballstemmer-2.1.0 sphinx-4.1.2 sphinx-autobuild-2021.3.14 sphinx-rtd-theme-0.5.2 sphinxcontrib-applehelp-1.0.2 sphinxcontrib-devhelp-1.0.2 sphinxcontrib-htmlhelp-2.0.0 sphinxcontrib-jsmath-1.0.1 sphinxcontrib-qthelp-1.0.3 sphinxcontrib-serializinghtml-1.1.5 tornado-6.1 typed-ast-1.4.3 wcwidth-0.2.5
Symlinking mysql_autoxtrabackup -> /home/mysqlbackup/.local/lib/python3.7/site-packages/mysql_autoxtrabackup                                                                                                                                                         I-flit.install
Writing script to /home/mysqlbackup/.local/bin/autoxtrabackup                                                                                                                                                                                                        I-flit.install
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ ls -l ~/.au^C
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ autoxtrabackup --version
-bash: autoxtrabackup: command not found
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ ls -ltr
total 56
-rw-r--r-- 1 mysqlbackup mysqlbackup 3396 Jul 29 15:34 README.md
-rw-r--r-- 1 mysqlbackup mysqlbackup 1083 Jul 29 15:34 LICENSE
-rw-r--r-- 1 mysqlbackup mysqlbackup  379 Jul 29 15:34 HISTORY.md
-rw-r--r-- 1 mysqlbackup mysqlbackup  714 Jul 29 15:34 Dockerfile
-rw-r--r-- 1 mysqlbackup mysqlbackup  401 Jul 29 15:34 docker-compose.yaml
-rw-r--r-- 1 mysqlbackup mysqlbackup  333 Jul 29 15:34 docker-compose-test.yaml
drwxr-xr-x 2 mysqlbackup mysqlbackup 4096 Jul 29 15:34 changes
drwxr-xr-x 3 mysqlbackup mysqlbackup 4096 Jul 29 15:34 scripts
-rw-r--r-- 1 mysqlbackup mysqlbackup 2337 Jul 29 15:34 pyproject.toml
-rw-r--r-- 1 mysqlbackup mysqlbackup  780 Jul 29 15:34 netlify.toml
-rw-r--r-- 1 mysqlbackup mysqlbackup  402 Jul 29 15:34 mypy.ini
drwxr-xr-x 2 mysqlbackup mysqlbackup 4096 Jul 29 15:34 docs
drwxr-xr-x 2 mysqlbackup mysqlbackup 4096 Jul 29 15:34 tests
drwxr-xr-x 9 mysqlbackup mysqlbackup 4096 Jul 29 15:37 mysql_autoxtrabackup
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ ./mysql_autoxtrabackup/^C
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ /home/mysqlbackup/.local/lib/python3.7/site-packages/mysql_autoxtrabackup
-bash: /home/mysqlbackup/.local/lib/python3.7/site-packages/mysql_autoxtrabackup: Is a directory
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ /home/mysqlbackup/.local/lib/python3.7/site-packages/mysql_autoxtrabackup/
api/            backup_backup/  backup_prepare/ general_conf/   process_runner/ __pycache__/    utils/
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ /home/mysqlbackup/.local/lib/python3.7/site-packages/mysql_autoxtrabackup/au^C
mysqlbackup@dev:~/MySQL-AutoXtraBackup$ pip3 install mysql-autoxtrabackup
WARNING: Value for scheme.platlib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/lib/python3.7/dist-packages
sysconfig: /usr/lib/python3.7/site-packages
WARNING: Value for scheme.purelib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/lib/python3.7/dist-packages
sysconfig: /usr/lib/python3.7/site-packages
WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/include/python3.7/UNKNOWN
sysconfig: /usr/include/python3.7m/UNKNOWN
WARNING: Value for scheme.scripts does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local/bin
sysconfig: /usr/bin
WARNING: Value for scheme.data does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /usr/local
sysconfig: /usr
WARNING: Additional context:
user = False
home = None
root = None
prefix = None
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: mysql-autoxtrabackup in /home/mysqlbackup/.local/lib/python3.7/site-packages (2.0.2)
Requirement already satisfied: uvicorn>=0.13.4 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (0.14.0)
Requirement already satisfied: pid>=2.0 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (3.0.4)
Requirement already satisfied: click>=3.3 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (8.0.1)
Requirement already satisfied: fastapi>=0.63.0 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (0.67.0)
Requirement already satisfied: humanfriendly>=2.0 in /usr/local/lib/python3.7/dist-packages (from mysql-autoxtrabackup) (9.2)
Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from click>=3.3->mysql-autoxtrabackup) (4.6.1)
Requirement already satisfied: pydantic!=1.7,!=1.7.1,!=1.7.2,!=1.7.3,!=1.8,!=1.8.1,<2.0.0,>=1.6.2 in /usr/local/lib/python3.7/dist-packages (from fastapi>=0.63.0->mysql-autoxtrabackup) (1.8.2)
Requirement already satisfied: starlette==0.14.2 in /usr/local/lib/python3.7/dist-packages (from fastapi>=0.63.0->mysql-autoxtrabackup) (0.14.2)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.7/dist-packages (from pydantic!=1.7,!=1.7.1,!=1.7.2,!=1.7.3,!=1.8,!=1.8.1,<2.0.0,>=1.6.2->fastapi>=0.63.0->mysql-autoxtrabackup) (3.10.0.0)
Requirement already satisfied: h11>=0.8 in /usr/local/lib/python3.7/dist-packages (from uvicorn>=0.13.4->mysql-autoxtrabackup) (0.12.0)
Requirement already satisfied: asgiref>=3.3.4 in /usr/local/lib/python3.7/dist-packages (from uvicorn>=0.13.4->mysql-autoxtrabackup) (3.4.1)
Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata->click>=3.3->mysql-autoxtrabackup) (3.5.0)
WARNING: Value for scheme.headers does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
distutils: /home/mysqlbackup/.local/include/python3.7m/UNKNOWN
sysconfig: /home/mysqlbackup/.local/include/python3.7/UNKNOWN
WARNING: Additional context:
user = True
home = None
root = None
prefix = None
JasperAlgra commented 3 years ago

Also, I've had similar issues before in 1.5.x.

Maybe to circum/prevent this issue there could be a --generate-config-file option or so? Or a config file template on github instead of the lines in generate_default_conf.py which are a bit of a pain to copy paste by hand to a new config file.

ShahriyarR commented 3 years ago

Hmm why I missed this issue? :D Okay I am going to create an option for generating the config file and also the config file template. Thanks guys)

JasperAlgra commented 3 years ago

Hi @ShahriyarR ,

After this merge I've got this:

root@dev:/home/jasper/autoxtrabackup# python3 mysql_autoxtrabackup/autoxtrabackup.py --generate-config-file
Missing config file : /root/.autoxtrabackup/autoxtrabackup.cnf
Traceback (most recent call last):
  File "mysql_autoxtrabackup/autoxtrabackup.py", line 321, in <module>
    all_procedure()
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1137, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1062, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 763, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "mysql_autoxtrabackup/autoxtrabackup.py", line 203, in all_procedure
    logging_options = options.logging_options
  File "/root/.local/lib/python3.7/site-packages/mysql_autoxtrabackup/general_conf/generalops.py", line 42, in logging_options
    "log_level": self.con.get(section, "log"),
AttributeError: 'GeneralClass' object has no attribute 'con'

I'm not really sure what's causing this. Looks like autoxtrabackup.py: 208 tries to get the logging options from generalops.py:42 which tries to get it from the config file.. but that one doesn't exist.

ShahriyarR commented 3 years ago

@JasperAlgra This project is can be shown as a study case of what happens - "when you have no tests" :D I will take a look )

JasperAlgra commented 3 years ago

Thanks a lot man! What is your plan with this project? Are you planning to continue to use it yourself in production ?

I've got a taste from the mongodb backup with PointInTime recovery and fully managed + verified backups, which is very very nice... but it seems we will continue to use Percona xtraDB cluster in production instead of the planned mongo. So I'm also willing to donate some time to this project as it's valuable for us. But Pyhton is very-much not my language so I'm struggling a bit to contribute in a efficient way :')

I really like your idea of the new API. It would be a nice way to verify if/when backups are made by a monitoring tool and get alerting etc.