search

fedora-infra / mirrormanager2

Rewrite of the MirrorManager application in Flask and SQLAlchemy
https://mirrormanager.fedoraproject.org
GNU General Public License v2.0
63 stars 46 forks source link

Document exactly what is expected from report_mirror #167

Open jasontibbitts opened 8 years ago

jasontibbitts commented 8 years ago

I have been working on a tool I call quick-fedora-mirror: https://pagure.io/quick-fedora-mirror

When it runs, it has a pretty complete picture of the contents of the local mirror already stored away and could easily send those to mirrormanager. Except that I'm not sure exactly what mirrormanager will take, besides a base64 encoded bzip2 compressed version of some data structure.

Could you tell me what it's supposed to look like? It would be really great if I could generate it without using python (because I'm trying to minimize client dependencies).

mdomsch commented 8 years ago

Attached is a dump of the pickle that is uploaded, in pretty text format, and in the python pickle format. Unfortunately, it is in Python binary pickle format (here as variable 'p'), which is then bz2 compressed, base 64 urlsafe encoded, before being uploaded.

data = base64.urlsafe_b64encode(bz2.compress(p))

On Thu, May 19, 2016 at 7:53 PM, Jason Tibbitts notifications@github.com wrote:

I have been working on a tool I call quick-fedora-mirror: https://pagure.io/quick-fedora-mirror

When it runs, it has a pretty complete picture of the contents of the local mirror already stored away and could easily send those to mirrormanager. Except that I'm not sure exactly what mirrormanager will take, besides a base64 encoded bzip2 compressed version of some data structure.

Could you tell me what it's supposed to look like? It would be really great if I could generate it without using python (because I'm trying to minimize client dependencies).

— You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub https://github.com/fedora-infra/mirrormanager2/issues/167

{'fedora archive': {'dirtree': {}, 'enabled': '0'}, 'fedora epel': {'dirtree': {'': {}, '4': {}, '4/SRPMS': {}, '4/SRPMS/headers': {}, '4/SRPMS/repodata': {}, '4/i386': {}, '4/i386/headers': {}, '4/i386/repodata': {}, '4/x86_64': {}, '4/x86_64/headers': {}, '4/x86_64/repodata': {}, '5': {}, '5/SRPMS': {}, '5/SRPMS/repodata': {}, '5/i386': {}, '5/i386/repodata': {}, '5/x86_64': {}, '5/x86_64/repodata': {}, '6': {}, '6/SRPMS': {}, '6/SRPMS/repodata': {}, '6/i386': {}, '6/i386/repodata': {}, '6/x86_64': {}, '6/x86_64/repodata': {}, '7': {}, '7/SRPMS': {}, '7/SRPMS/0': {}, '7/SRPMS/2': {}, '7/SRPMS/3': {}, '7/SRPMS/a': {}, '7/SRPMS/b': {}, '7/SRPMS/c': {}, '7/SRPMS/d': {}, '7/SRPMS/e': {}, '7/SRPMS/f': {}, '7/SRPMS/g': {}, '7/SRPMS/h': {}, '7/SRPMS/i': {}, '7/SRPMS/j': {}, '7/SRPMS/k': {}, '7/SRPMS/l': {}, '7/SRPMS/m': {}, '7/SRPMS/n': {}, '7/SRPMS/o': {}, '7/SRPMS/p': {}, '7/SRPMS/q': {}, '7/SRPMS/r': {}, '7/SRPMS/repodata': {}, '7/SRPMS/s': {}, '7/SRPMS/t': {}, '7/SRPMS/u': {}, '7/SRPMS/v': {}, '7/SRPMS/w': {}, '7/SRPMS/x': {}, '7/SRPMS/y': {}, '7/SRPMS/z': {}, '7/ppc64le': {}, '7/ppc64le/2': {}, '7/ppc64le/3': {}, '7/ppc64le/a': {}, '7/ppc64le/b': {}, '7/ppc64le/c': {}, '7/ppc64le/d': {}, '7/ppc64le/e': {}, '7/ppc64le/f': {}, '7/ppc64le/g': {}, '7/ppc64le/h': {}, '7/ppc64le/i': {}, '7/ppc64le/j': {}, '7/ppc64le/k': {}, '7/ppc64le/l': {}, '7/ppc64le/m': {}, '7/ppc64le/n': {}, '7/ppc64le/o': {}, '7/ppc64le/p': {}, '7/ppc64le/q': {}, '7/ppc64le/r': {}, '7/ppc64le/repodata': {}, '7/ppc64le/s': {}, '7/ppc64le/t': {}, '7/ppc64le/u': {}, '7/ppc64le/v': {}, '7/ppc64le/w': {}, '7/ppc64le/x': {}, '7/ppc64le/y': {}, '7/ppc64le/z': {}, '7/x86_64': {}, '7/x86_64/0': {}, '7/x86_64/2': {}, '7/x86_64/3': {}, '7/x86_64/a': {}, '7/x86_64/b': {}, '7/x86_64/c': {}, '7/x86_64/d': {}, '7/x86_64/e': {}, '7/x86_64/f': {}, '7/x86_64/g': {}, '7/x86_64/h': {}, '7/x86_64/i': {}, '7/x86_64/j': {}, '7/x86_64/k': {}, '7/x86_64/l': {}, '7/x86_64/m': {}, '7/x86_64/n': {}, '7/x86_64/o': {}, '7/x86_64/p': {}, '7/x86_64/q': {}, '7/x86_64/r': {}, '7/x86_64/repodata': {}, '7/x86_64/s': {}, '7/x86_64/t': {}, '7/x86_64/u': {}, '7/x86_64/v': {}, '7/x86_64/w': {}, '7/x86_64/x': {}, '7/x86_64/y': {}, '7/x86_64/z': {}, 'testing': {}, 'testing/4': {}, 'testing/4/SRPMS': {}, 'testing/4/SRPMS/headers': {}, 'testing/4/SRPMS/repodata': {}, 'testing/4/i386': {}, 'testing/4/i386/headers': {}, 'testing/4/i386/repodata': {}, 'testing/4/x86_64': {}, 'testing/4/x86_64/headers': {}, 'testing/4/x86_64/repodata': {}, 'testing/5': {}, 'testing/5/SRPMS': {}, 'testing/5/SRPMS/repodata': {}, 'testing/5/i386': {}, 'testing/5/i386/repodata': {}, 'testing/5/x86_64': {}, 'testing/5/x86_64/repodata': {}, 'testing/6': {}, 'testing/6/SRPMS': {}, 'testing/6/SRPMS/repodata': {}, 'testing/6/i386': {}, 'testing/6/i386/repodata': {}, 'testing/6/x86_64': {}, 'testing/6/x86_64/repodata': {}, 'testing/7': {}, 'testing/7/SRPMS': {}, 'testing/7/SRPMS/3': {}, 'testing/7/SRPMS/a': {}, 'testing/7/SRPMS/b': {}, 'testing/7/SRPMS/c': {}, 'testing/7/SRPMS/d': {}, 'testing/7/SRPMS/e': {}, 'testing/7/SRPMS/f': {}, 'testing/7/SRPMS/g': {}, 'testing/7/SRPMS/h': {}, 'testing/7/SRPMS/i': {}, 'testing/7/SRPMS/j': {}, 'testing/7/SRPMS/k': {}, 'testing/7/SRPMS/l': {}, 'testing/7/SRPMS/m': {}, 'testing/7/SRPMS/n': {}, 'testing/7/SRPMS/o': {}, 'testing/7/SRPMS/p': {}, 'testing/7/SRPMS/q': {}, 'testing/7/SRPMS/r': {}, 'testing/7/SRPMS/repodata': {}, 'testing/7/SRPMS/s': {}, 'testing/7/SRPMS/t': {}, 'testing/7/SRPMS/u': {}, 'testing/7/SRPMS/v': {}, 'testing/7/SRPMS/w': {}, 'testing/7/SRPMS/y': {}, 'testing/7/ppc64le': {}, 'testing/7/ppc64le/3': {}, 'testing/7/ppc64le/a': {}, 'testing/7/ppc64le/b': {}, 'testing/7/ppc64le/c': {}, 'testing/7/ppc64le/d': {}, 'testing/7/ppc64le/e': {}, 'testing/7/ppc64le/f': {}, 'testing/7/ppc64le/g': {}, 'testing/7/ppc64le/h': {}, 'testing/7/ppc64le/i': {}, 'testing/7/ppc64le/j': {}, 'testing/7/ppc64le/k': {}, 'testing/7/ppc64le/l': {}, 'testing/7/ppc64le/m': {}, 'testing/7/ppc64le/n': {}, 'testing/7/ppc64le/o': {}, 'testing/7/ppc64le/p': {}, 'testing/7/ppc64le/q': {}, 'testing/7/ppc64le/r': {}, 'testing/7/ppc64le/repodata': {}, 'testing/7/ppc64le/s': {}, 'testing/7/ppc64le/t': {}, 'testing/7/ppc64le/u': {}, 'testing/7/ppc64le/v': {}, 'testing/7/ppc64le/w': {}, 'testing/7/ppc64le/x': {}, 'testing/7/ppc64le/y': {}, 'testing/7/x86_64': {}, 'testing/7/x86_64/3': {}, 'testing/7/x86_64/a': {}, 'testing/7/x86_64/b': {}, 'testing/7/x86_64/c': {}, 'testing/7/x86_64/d': {}, 'testing/7/x86_64/e': {}, 'testing/7/x86_64/f': {}, 'testing/7/x86_64/g': {}, 'testing/7/x86_64/h': {}, 'testing/7/x86_64/i': {}, 'testing/7/x86_64/j': {}, 'testing/7/x86_64/k': {}, 'testing/7/x86_64/l': {}, 'testing/7/x86_64/m': {}, 'testing/7/x86_64/n': {}, 'testing/7/x86_64/o': {}, 'testing/7/x86_64/p': {}, 'testing/7/x86_64/q': {}, 'testing/7/x86_64/r': {}, 'testing/7/x86_64/repodata': {}, 'testing/7/x86_64/s': {}, 'testing/7/x86_64/t': {}, 'testing/7/x86_64/u': {}, 'testing/7/x86_64/v': {}, 'testing/7/x86_64/w': {}, 'testing/7/x86_64/x': {}, 'testing/7/x86_64/y': {}}, 'enabled': '1'}, 'fedora linux': {'dirtree': {'': {}, 'development': {}, 'development/24': {}, 'development/24/Atomic': {}, 'development/24/Atomic/source': {}, 'development/24/Atomic/source/tree': {}, 'development/24/Atomic/source/tree/Packages': {}, 'development/24/Atomic/x86_64': {}, 'development/24/Atomic/x86_64/iso': {}, 'development/24/Atomic/x86_64/iso/EFI': {}, 'development/24/Atomic/x86_64/iso/EFI/BOOT': {}, 'development/24/Atomic/x86_64/iso/EFI/BOOT/fonts': {}, 'development/24/Atomic/x86_64/iso/images': {}, 'development/24/Atomic/x86_64/iso/images/pxeboot': {}, 'development/24/Atomic/x86_64/iso/isolinux': {}, 'development/24/Atomic/x86_64/os': {}, 'development/24/Atomic/x86_64/os/Packages': {}, 'development/24/CloudImages': {}, 'development/24/CloudImages/i386': {}, 'development/24/CloudImages/i386/iso': {}, 'development/24/CloudImages/i386/os': {}, 'development/24/CloudImages/i386/os/Packages': {}, 'development/24/CloudImages/source': {}, 'development/24/CloudImages/source/tree': {}, 'development/24/CloudImages/source/tree/Packages': {}, 'development/24/CloudImages/x86_64': {}, 'development/24/CloudImages/x86_64/images': {}, 'development/24/CloudImages/x86_64/iso': {}, 'development/24/CloudImages/x86_64/os': {}, 'development/24/CloudImages/x86_64/os/Packages': {}, 'development/24/Docker': {}, 'development/24/Docker/armhfp': {}, 'development/24/Docker/armhfp/images': {}, 'development/24/Docker/armhfp/iso': {}, 'development/24/Docker/armhfp/os': {}, 'development/24/Docker/armhfp/os/Packages': {}, 'development/24/Docker/source': {}, 'development/24/Docker/source/tree': {}, 'development/24/Docker/source/tree/Packages': {}, 'development/24/Docker/x86_64': {}, 'development/24/Docker/x86_64/images': {}, 'development/24/Docker/x86_64/iso': {}, 'development/24/Docker/x86_64/os': {}, 'development/24/Docker/x86_64/os/Packages': {}, 'development/24/Everything': {}, 'development/24/Everything/armhfp': {}, 'development/24/Everything/armhfp/os': {}, 'development/24/Everything/armhfp/os/Packages': {}, 'development/24/Everything/armhfp/os/Packages/0': {}, 'development/24/Everything/armhfp/os/Packages/2': {}, 'development/24/Everything/armhfp/os/Packages/3': {}, 'development/24/Everything/armhfp/os/Packages/4': {}, 'development/24/Everything/armhfp/os/Packages/6': {}, 'development/24/Everything/armhfp/os/Packages/7': {}, 'development/24/Everything/armhfp/os/Packages/9': {}, 'development/24/Everything/armhfp/os/Packages/a': {}, 'development/24/Everything/armhfp/os/Packages/b': {}, 'development/24/Everything/armhfp/os/Packages/c': {}, 'development/24/Everything/armhfp/os/Packages/d': {}, 'development/24/Everything/armhfp/os/Packages/e': {}, 'development/24/Everything/armhfp/os/Packages/f': {}, 'development/24/Everything/armhfp/os/Packages/g': {}, 'development/24/Everything/armhfp/os/Packages/h': {}, 'development/24/Everything/armhfp/os/Packages/i': {}, 'development/24/Everything/armhfp/os/Packages/j': {}, 'development/24/Everything/armhfp/os/Packages/k': {}, 'development/24/Everything/armhfp/os/Packages/l': {}, 'development/24/Everything/armhfp/os/Packages/m': {}, 'development/24/Everything/armhfp/os/Packages/n': {}, 'development/24/Everything/armhfp/os/Packages/o': {}, 'development/24/Everything/armhfp/os/Packages/p': {}, 'development/24/Everything/armhfp/os/Packages/q': {}, 'development/24/Everything/armhfp/os/Packages/r': {}, 'development/24/Everything/armhfp/os/Packages/s': {}, 'development/24/Everything/armhfp/os/Packages/t': {}, 'development/24/Everything/armhfp/os/Packages/u': {}, 'development/24/Everything/armhfp/os/Packages/v': {}, 'development/24/Everything/armhfp/os/Packages/w': {}, 'development/24/Everything/armhfp/os/Packages/x': {}, 'development/24/Everything/armhfp/os/Packages/y': {}, 'development/24/Everything/armhfp/os/Packages/z': {}, 'development/24/Everything/armhfp/os/images': {}, 'development/24/Everything/armhfp/os/images/pxeboot': {}, 'development/24/Everything/armhfp/os/images/pxeboot/dtb': {}, 'development/24/Everything/armhfp/os/repodata': {}, 'development/24/Everything/i386': {}, 'development/24/Everything/i386/iso': {}, 'development/24/Everything/i386/os': {}, 'development/24/Everything/i386/os/Packages': {}, 'development/24/Everything/i386/os/Packages/0': {}, 'development/24/Everything/i386/os/Packages/2': {}, 'development/24/Everything/i386/os/Packages/3': {}, 'development/24/Everything/i386/os/Packages/4': {}, 'development/24/Everything/i386/os/Packages/6': {}, 'development/24/Everything/i386/os/Packages/7': {}, 'development/24/Everything/i386/os/Packages/9': {}, 'development/24/Everything/i386/os/Packages/a': {}, 'development/24/Everything/i386/os/Packages/b': {}, 'development/24/Everything/i386/os/Packages/c': {}, 'development/24/Everything/i386/os/Packages/d': {}, 'development/24/Everything/i386/os/Packages/e': {}, 'development/24/Everything/i386/os/Packages/f': {}, 'development/24/Everything/i386/os/Packages/g': {}, 'development/24/Everything/i386/os/Packages/h': {}, 'development/24/Everything/i386/os/Packages/i': {}, 'development/24/Everything/i386/os/Packages/j': {}, 'development/24/Everything/i386/os/Packages/k': {}, 'development/24/Everything/i386/os/Packages/l': {}, 'development/24/Everything/i386/os/Packages/m': {}, 'development/24/Everything/i386/os/Packages/n': {}, 'development/24/Everything/i386/os/Packages/o': {}, 'development/24/Everything/i386/os/Packages/p': {}, 'development/24/Everything/i386/os/Packages/q': {}, 'development/24/Everything/i386/os/Packages/r': {}, 'development/24/Everything/i386/os/Packages/s': {}, 'development/24/Everything/i386/os/Packages/t': {}, 'development/24/Everything/i386/os/Packages/u': {}, 'development/24/Everything/i386/os/Packages/v': {}, 'development/24/Everything/i386/os/Packages/w': {}, 'development/24/Everything/i386/os/Packages/x': {}, 'development/24/Everything/i386/os/Packages/y': {}, 'development/24/Everything/i386/os/Packages/z': {}, 'development/24/Everything/i386/os/images': {}, 'development/24/Everything/i386/os/images/pxeboot': {}, 'development/24/Everything/i386/os/isolinux': {}, 'development/24/Everything/i386/os/repodata': {}, 'development/24/Everything/source': {}, 'development/24/Everything/source/tree': {}, 'development/24/Everything/source/tree/Packages': {}, 'development/24/Everything/source/tree/Packages/0': {}, 'development/24/Everything/source/tree/Packages/2': {}, 'development/24/Everything/source/tree/Packages/3': {}, 'development/24/Everything/source/tree/Packages/4': {}, 'development/24/Everything/source/tree/Packages/6': {}, 'development/24/Everything/source/tree/Packages/7': {}, 'development/24/Everything/source/tree/Packages/9': {}, 'development/24/Everything/source/tree/Packages/a': {}, 'development/24/Everything/source/tree/Packages/b': {}, 'development/24/Everything/source/tree/Packages/c': {}, 'development/24/Everything/source/tree/Packages/d': {}, 'development/24/Everything/source/tree/Packages/e': {}, 'development/24/Everything/source/tree/Packages/f': {}, 'development/24/Everything/source/tree/Packages/g': {}, 'development/24/Everything/source/tree/Packages/h': {}, 'development/24/Everything/source/tree/Packages/i': {}, 'development/24/Everything/source/tree/Packages/j': {}, 'development/24/Everything/source/tree/Packages/k': {}, 'development/24/Everything/source/tree/Packages/l': {}, 'development/24/Everything/source/tree/Packages/m': {}, 'development/24/Everything/source/tree/Packages/n': {}, 'development/24/Everything/source/tree/Packages/o': {}, 'development/24/Everything/source/tree/Packages/p': {}, 'development/24/Everything/source/tree/Packages/q': {}, 'development/24/Everything/source/tree/Packages/r': {}, 'development/24/Everything/source/tree/Packages/s': {}, 'development/24/Everything/source/tree/Packages/t': {}, 'development/24/Everything/source/tree/Packages/u': {}, 'development/24/Everything/source/tree/Packages/v': {}, 'development/24/Everything/source/tree/Packages/w': {}, 'development/24/Everything/source/tree/Packages/x': {}, 'development/24/Everything/source/tree/Packages/y': {}, 'development/24/Everything/source/tree/Packages/z': {}, 'development/24/Everything/source/tree/repodata': {}, 'development/24/Everything/x86_64': {}, 'development/24/Everything/x86_64/iso': {}, 'development/24/Everything/x86_64/os': {}, 'development/24/Everything/x86_64/os/EFI': {}, 'development/24/Everything/x86_64/os/EFI/BOOT': {}, 'development/24/Everything/x86_64/os/EFI/BOOT/fonts': {}, 'development/24/Everything/x86_64/os/Packages': {}, 'development/24/Everything/x86_64/os/Packages/0': {}, 'development/24/Everything/x86_64/os/Packages/2': {}, 'development/24/Everything/x86_64/os/Packages/3': {}, 'development/24/Everything/x86_64/os/Packages/4': {}, 'development/24/Everything/x86_64/os/Packages/6': {}, 'development/24/Everything/x86_64/os/Packages/7': {}, 'development/24/Everything/x86_64/os/Packages/9': {}, 'development/24/Everything/x86_64/os/Packages/a': {}, 'development/24/Everything/x86_64/os/Packages/b': {}, 'development/24/Everything/x86_64/os/Packages/c': {}, 'development/24/Everything/x86_64/os/Packages/d': {}, 'development/24/Everything/x86_64/os/Packages/e': {}, 'development/24/Everything/x86_64/os/Packages/f': {}, 'development/24/Everything/x86_64/os/Packages/g': {}, 'development/24/Everything/x86_64/os/Packages/h': {}, 'development/24/Everything/x86_64/os/Packages/i': {}, 'development/24/Everything/x86_64/os/Packages/j': {}, 'development/24/Everything/x86_64/os/Packages/k': {}, 'development/24/Everything/x86_64/os/Packages/l': {}, 'development/24/Everything/x86_64/os/Packages/m': {}, 'development/24/Everything/x86_64/os/Packages/n': {}, 'development/24/Everything/x86_64/os/Packages/o': {}, 'development/24/Everything/x86_64/os/Packages/p': {}, 'development/24/Everything/x86_64/os/Packages/q': {}, 'development/24/Everything/x86_64/os/Packages/r': {}, 'development/24/Everything/x86_64/os/Packages/s': {}, 'development/24/Everything/x86_64/os/Packages/t': {}, 'development/24/Everything/x86_64/os/Packages/u': {}, 'development/24/Everything/x86_64/os/Packages/v': {}, 'development/24/Everything/x86_64/os/Packages/w': {}, 'development/24/Everything/x86_64/os/Packages/x': {}, 'development/24/Everything/x86_64/os/Packages/y': {}, 'development/24/Everything/x86_64/os/Packages/z': {}, 'development/24/Everything/x86_64/os/images': {}, 'development/24/Everything/x86_64/os/images/pxeboot': {}, 'development/24/Everything/x86_64/os/isolinux': {}, 'development/24/Everything/x86_64/os/repodata': {}, 'development/24/Server': {}, 'development/24/Server/armhfp': {}, 'development/24/Server/armhfp/images': {}, 'development/24/Server/armhfp/iso': {}, 'development/24/Server/armhfp/os': {}, 'development/24/Server/armhfp/os/Packages': {}, 'development/24/Server/armhfp/os/Packages/3': {}, 'development/24/Server/armhfp/os/Packages/a': {}, 'development/24/Server/armhfp/os/Packages/b': {}, 'development/24/Server/armhfp/os/Packages/c': {}, 'development/24/Server/armhfp/os/Packages/d': {}, 'development/24/Server/armhfp/os/Packages/e': {}, 'development/24/Server/armhfp/os/Packages/f': {}, 'development/24/Server/armhfp/os/Packages/g': {}, 'development/24/Server/armhfp/os/Packages/h': {}, 'development/24/Server/armhfp/os/Packages/i': {}, 'development/24/Server/armhfp/os/Packages/j': {}, 'development/24/Server/armhfp/os/Packages/k': {}, 'development/24/Server/armhfp/os/Packages/l': {}, 'development/24/Server/armhfp/os/Packages/m': {}, 'development/24/Server/armhfp/os/Packages/n': {}, 'development/24/Server/armhfp/os/Packages/o': {}, 'development/24/Server/armhfp/os/Packages/p': {}, 'development/24/Server/armhfp/os/Packages/q': {}, 'development/24/Server/armhfp/os/Packages/r': {}, 'development/24/Server/armhfp/os/Packages/s': {}, 'development/24/Server/armhfp/os/Packages/t': {}, 'development/24/Server/armhfp/os/Packages/u': {}, 'development/24/Server/armhfp/os/Packages/v': {}, 'development/24/Server/armhfp/os/Packages/w': {}, 'development/24/Server/armhfp/os/Packages/x': {}, 'development/24/Server/armhfp/os/Packages/y': {}, 'development/24/Server/armhfp/os/Packages/z': {}, 'development/24/Server/armhfp/os/images': {}, 'development/24/Server/armhfp/os/images/pxeboot': {}, 'development/24/Server/armhfp/os/images/pxeboot/dtb': {}, 'development/24/Server/armhfp/os/repodata': {}, 'development/24/Server/i386': {}, 'development/24/Server/i386/iso': {}, 'development/24/Server/i386/os': {}, 'development/24/Server/i386/os/Packages': {}, 'development/24/Server/i386/os/Packages/3': {}, 'development/24/Server/i386/os/Packages/a': {}, 'development/24/Server/i386/os/Packages/b': {}, 'development/24/Server/i386/os/Packages/c': {}, 'development/24/Server/i386/os/Packages/d': {}, 'development/24/Server/i386/os/Packages/e': {}, 'development/24/Server/i386/os/Packages/f': {}, 'development/24/Server/i386/os/Packages/g': {}, 'development/24/Server/i386/os/Packages/h': {}, 'development/24/Server/i386/os/Packages/i': {}, 'development/24/Server/i386/os/Packages/j': {}, 'development/24/Server/i386/os/Packages/k': {}, 'development/24/Server/i386/os/Packages/l': {}, 'development/24/Server/i386/os/Packages/m': {}, 'development/24/Server/i386/os/Packages/n': {}, 'development/24/Server/i386/os/Packages/o': {}, 'development/24/Server/i386/os/Packages/p': {}, 'development/24/Server/i386/os/Packages/q': {}, 'development/24/Server/i386/os/Packages/r': {}, 'development/24/Server/i386/os/Packages/s': {}, 'development/24/Server/i386/os/Packages/t': {}, 'development/24/Server/i386/os/Packages/u': {}, 'development/24/Server/i386/os/Packages/v': {}, 'development/24/Server/i386/os/Packages/w': {}, 'development/24/Server/i386/os/Packages/x': {}, 'development/24/Server/i386/os/Packages/y': {}, 'development/24/Server/i386/os/Packages/z': {}, 'development/24/Server/i386/os/images': {}, 'development/24/Server/i386/os/images/pxeboot': {}, 'development/24/Server/i386/os/isolinux': {}, 'development/24/Server/i386/os/repodata': {}, 'development/24/Server/source': {}, 'development/24/Server/source/tree': {}, 'development/24/Server/source/tree/Packages': {}, 'development/24/Server/source/tree/Packages/3': {}, 'development/24/Server/source/tree/Packages/a': {}, 'development/24/Server/source/tree/Packages/b': {}, 'development/24/Server/source/tree/Packages/c': {}, 'development/24/Server/source/tree/Packages/d': {}, 'development/24/Server/source/tree/Packages/e': {}, 'development/24/Server/source/tree/Packages/f': {}, 'development/24/Server/source/tree/Packages/g': {}, 'development/24/Server/source/tree/Packages/h': {}, 'development/24/Server/source/tree/Packages/i': {}, 'development/24/Server/source/tree/Packages/j': {}, 'development/24/Server/source/tree/Packages/k': {}, 'development/24/Server/source/tree/Packages/l': {}, 'development/24/Server/source/tree/Packages/m': {}, 'development/24/Server/source/tree/Packages/n': {}, 'development/24/Server/source/tree/Packages/o': {}, 'development/24/Server/source/tree/Packages/p': {}, 'development/24/Server/source/tree/Packages/q': {}, 'development/24/Server/source/tree/Packages/r': {}, 'development/24/Server/source/tree/Packages/s': {}, 'development/24/Server/source/tree/Packages/t': {}, 'development/24/Server/source/tree/Packages/u': {}, 'development/24/Server/source/tree/Packages/v': {}, 'development/24/Server/source/tree/Packages/w': {}, 'development/24/Server/source/tree/Packages/x': {}, 'development/24/Server/source/tree/Packages/y': {}, 'development/24/Server/source/tree/Packages/z': {}, 'development/24/Server/source/tree/repodata': {}, 'development/24/Server/x86_64': {}, 'development/24/Server/x86_64/iso': {}, 'development/24/Server/x86_64/os': {}, 'development/24/Server/x86_64/os/EFI': {}, 'development/24/Server/x86_64/os/EFI/BOOT': {}, 'development/24/Server/x86_64/os/EFI/BOOT/fonts': {}, 'development/24/Server/x86_64/os/Packages': {}, 'development/24/Server/x86_64/os/Packages/3': {}, 'development/24/Server/x86_64/os/Packages/a': {}, 'development/24/Server/x86_64/os/Packages/b': {}, 'development/24/Server/x86_64/os/Packages/c': {}, 'development/24/Server/x86_64/os/Packages/d': {}, 'development/24/Server/x86_64/os/Packages/e': {}, 'development/24/Server/x86_64/os/Packages/f': {}, 'development/24/Server/x86_64/os/Packages/g': {}, 'development/24/Server/x86_64/os/Packages/h': {}, 'development/24/Server/x86_64/os/Packages/i': {}, 'development/24/Server/x86_64/os/Packages/j': {}, 'development/24/Server/x86_64/os/Packages/k': {}, 'development/24/Server/x86_64/os/Packages/l': {}, 'development/24/Server/x86_64/os/Packages/m': {}, 'development/24/Server/x86_64/os/Packages/n': {}, 'development/24/Server/x86_64/os/Packages/o': {}, 'development/24/Server/x86_64/os/Packages/p': {}, 'development/24/Server/x86_64/os/Packages/q': {}, 'development/24/Server/x86_64/os/Packages/r': {}, 'development/24/Server/x86_64/os/Packages/s': {}, 'development/24/Server/x86_64/os/Packages/t': {}, 'development/24/Server/x86_64/os/Packages/u': {}, 'development/24/Server/x86_64/os/Packages/v': {}, 'development/24/Server/x86_64/os/Packages/w': {}, 'development/24/Server/x86_64/os/Packages/x': {}, 'development/24/Server/x86_64/os/Packages/y': {}, 'development/24/Server/x86_64/os/Packages/z': {}, 'development/24/Server/x86_64/os/images': {}, 'development/24/Server/x86_64/os/images/pxeboot': {}, 'development/24/Server/x86_64/os/isolinux': {}, 'development/24/Server/x86_64/os/repodata': {}, 'development/24/Spins': {}, 'development/24/Spins/armhfp': {}, 'development/24/Spins/armhfp/images': {}, 'development/24/Spins/armhfp/iso': {}, 'development/24/Spins/armhfp/os': {}, 'development/24/Spins/armhfp/os/Packages': {}, 'development/24/Spins/i386': {}, 'development/24/Spins/i386/iso': {}, 'development/24/Spins/i386/os': {}, 'development/24/Spins/i386/os/Packages': {}, 'development/24/Spins/source': {}, 'development/24/Spins/source/tree': {}, 'development/24/Spins/source/tree/Packages': {}, 'development/24/Spins/x86_64': {}, 'development/24/Spins/x86_64/iso': {}, 'development/24/Spins/x86_64/os': {}, 'development/24/Spins/x86_64/os/Packages': {}, 'development/24/Workstation': {}, 'development/24/Workstation/armhfp': {}, 'development/24/Workstation/armhfp/images': {}, 'development/24/Workstation/armhfp/os': {}, 'development/24/Workstation/armhfp/os/Packages': {}, 'development/24/Workstation/armhfp/os/Packages/a': {}, 'development/24/Workstation/armhfp/os/Packages/b': {}, 'development/24/Workstation/armhfp/os/Packages/c': {}, 'development/24/Workstation/armhfp/os/Packages/d': {}, 'development/24/Workstation/armhfp/os/Packages/e': {}, 'development/24/Workstation/armhfp/os/Packages/f': {}, 'development/24/Workstation/armhfp/os/Packages/g': {}, 'development/24/Workstation/armhfp/os/Packages/h': {}, 'development/24/Workstation/armhfp/os/Packages/i': {}, 'development/24/Workstation/armhfp/os/Packages/j': {}, 'development/24/Workstation/armhfp/os/Packages/k': {}, 'development/24/Workstation/armhfp/os/Packages/l': {}, 'development/24/Workstation/armhfp/os/Packages/m': {}, 'development/24/Workstation/armhfp/os/Packages/n': {}, 'development/24/Workstation/armhfp/os/Packages/o': {}, 'development/24/Workstation/armhfp/os/Packages/p': {}, 'development/24/Workstation/armhfp/os/Packages/q': {}, 'development/24/Workstation/armhfp/os/Packages/r': {}, 'development/24/Workstation/armhfp/os/Packages/s': {}, 'development/24/Workstation/armhfp/os/Packages/t': {}, 'development/24/Workstation/armhfp/os/Packages/u': {}, 'development/24/Workstation/armhfp/os/Packages/v': {}, 'development/24/Workstation/armhfp/os/Packages/w': {}, 'development/24/Workstation/armhfp/os/Packages/x': {}, 'development/24/Workstation/armhfp/os/Packages/y': {}, 'development/24/Workstation/armhfp/os/Packages/z': {}, 'development/24/Workstation/armhfp/os/images': {}, 'development/24/Workstation/armhfp/os/images/pxeboot': {}, 'development/24/Workstation/armhfp/os/images/pxeboot/dtb': {}, 'development/24/Workstation/armhfp/os/repodata': {}, 'development/24/Workstation/i386': {}, 'development/24/Workstation/i386/iso': {}, 'development/24/Workstation/i386/os': {}, 'development/24/Workstation/i386/os/Packages': {}, 'development/24/Workstation/i386/os/Packages/a': {}, 'development/24/Workstation/i386/os/Packages/b': {}, 'development/24/Workstation/i386/os/Packages/c': {}, 'development/24/Workstation/i386/os/Packages/d': {}, 'development/24/Workstation/i386/os/Packages/e': {}, 'development/24/Workstation/i386/os/Packages/f': {}, 'development/24/Workstation/i386/os/Packages/g': {}, 'development/24/Workstation/i386/os/Packages/h': {}, 'development/24/Workstation/i386/os/Packages/i': {}, 'development/24/Workstation/i386/os/Packages/j': {}, 'development/24/Workstation/i386/os/Packages/k': {}, 'development/24/Workstation/i386/os/Packages/l': {}, 'development/24/Workstation/i386/os/Packages/m': {}, 'development/24/Workstation/i386/os/Packages/n': {}, 'development/24/Workstation/i386/os/Packages/o': {}, 'development/24/Workstation/i386/os/Packages/p': {}, 'development/24/Workstation/i386/os/Packages/q': {}, 'development/24/Workstation/i386/os/Packages/r': {}, 'development/24/Workstation/i386/os/Packages/s': {}, 'development/24/Workstation/i386/os/Packages/t': {}, 'development/24/Workstation/i386/os/Packages/u': {}, 'development/24/Workstation/i386/os/Packages/v': {}, 'development/24/Workstation/i386/os/Packages/w': {}, 'development/24/Workstation/i386/os/Packages/x': {}, 'development/24/Workstation/i386/os/Packages/y': {}, 'development/24/Workstation/i386/os/Packages/z': {}, 'development/24/Workstation/i386/os/images': {}, 'development/24/Workstation/i386/os/images/pxeboot': {}, 'development/24/Workstation/i386/os/isolinux': {}, 'development/24/Workstation/i386/os/repodata': {}, 'development/24/Workstation/source': {}, 'development/24/Workstation/source/tree': {}, 'development/24/Workstation/source/tree/Packages': {}, 'development/24/Workstation/source/tree/Packages/a': {}, 'development/24/Workstation/source/tree/Packages/b': {}, 'development/24/Workstation/source/tree/Packages/c': {}, 'development/24/Workstation/source/tree/Packages/d': {}, 'development/24/Workstation/source/tree/Packages/e': {}, 'development/24/Workstation/source/tree/Packages/f': {}, 'development/24/Workstation/source/tree/Packages/g': {}, 'development/24/Workstation/source/tree/Packages/h': {}, 'development/24/Workstation/source/tree/Packages/i': {}, 'development/24/Workstation/source/tree/Packages/j': {}, 'development/24/Workstation/source/tree/Packages/k': {}, 'development/24/Workstation/source/tree/Packages/l': {}, 'development/24/Workstation/source/tree/Packages/m': {}, 'development/24/Workstation/source/tree/Packages/n': {}, 'development/24/Workstation/source/tree/Packages/o': {}, 'development/24/Workstation/source/tree/Packages/p': {}, 'development/24/Workstation/source/tree/Packages/q': {}, 'development/24/Workstation/source/tree/Packages/r': {}, 'development/24/Workstation/source/tree/Packages/s': {}, 'development/24/Workstation/source/tree/Packages/t': {}, 'development/24/Workstation/source/tree/Packages/u': {}, 'development/24/Workstation/source/tree/Packages/v': {}, 'development/24/Workstation/source/tree/Packages/w': {}, 'development/24/Workstation/source/tree/Packages/x': {}, 'development/24/Workstation/source/tree/Packages/y': {}, 'development/24/Workstation/source/tree/Packages/z': {}, 'development/24/Workstation/source/tree/repodata': {}, 'development/24/Workstation/x86_64': {}, 'development/24/Workstation/x86_64/iso': {}, 'development/24/Workstation/x86_64/os': {}, 'development/24/Workstation/x86_64/os/EFI': {}, 'development/24/Workstation/x86_64/os/EFI/BOOT': {}, 'development/24/Workstation/x86_64/os/EFI/BOOT/fonts': {}, 'development/24/Workstation/x86_64/os/Packages': {}, 'development/24/Workstation/x86_64/os/Packages/a': {}, 'development/24/Workstation/x86_64/os/Packages/b': {}, 'development/24/Workstation/x86_64/os/Packages/c': {}, 'development/24/Workstation/x86_64/os/Packages/d': {}, 'development/24/Workstation/x86_64/os/Packages/e': {}, 'development/24/Workstation/x86_64/os/Packages/f': {}, 'development/24/Workstation/x86_64/os/Packages/g': {}, 'development/24/Workstation/x86_64/os/Packages/h': {}, 'development/24/Workstation/x86_64/os/Packages/i': {}, 'development/24/Workstation/x86_64/os/Packages/j': {}, 'development/24/Workstation/x86_64/os/Packages/k': {}, 'development/24/Workstation/x86_64/os/Packages/l': {}, 'development/24/Workstation/x86_64/os/Packages/m': {}, 'development/24/Workstation/x86_64/os/Packages/n': {}, 'development/24/Workstation/x86_64/os/Packages/o': {}, 'development/24/Workstation/x86_64/os/Packages/p': {}, 'development/24/Workstation/x86_64/os/Packages/q': {}, 'development/24/Workstation/x86_64/os/Packages/r': {}, 'development/24/Workstation/x86_64/os/Packages/s': {}, 'development/24/Workstation/x86_64/os/Packages/t': {}, 'development/24/Workstation/x86_64/os/Packages/u': {}, 'development/24/Workstation/x86_64/os/Packages/v': {}, 'development/24/Workstation/x86_64/os/Packages/w': {}, 'development/24/Workstation/x86_64/os/Packages/x': {}, 'development/24/Workstation/x86_64/os/Packages/y': {}, 'development/24/Workstation/x86_64/os/Packages/z': {}, 'development/24/Workstation/x86_64/os/images': {}, 'development/24/Workstation/x86_64/os/images/pxeboot': {}, 'development/24/Workstation/x86_64/os/isolinux': {}, 'development/24/Workstation/x86_64/os/repodata': {}, 'development/rawhide': {}, 'development/rawhide/Atomic': {}, 'development/rawhide/Atomic/source': {}, 'development/rawhide/Atomic/source/tree': {}, 'development/rawhide/Atomic/source/tree/Packages': {}, 'development/rawhide/Atomic/x86_64': {}, 'development/rawhide/Atomic/x86_64/iso': {}, 'development/rawhide/Atomic/x86_64/iso/EFI': {}, 'development/rawhide/Atomic/x86_64/iso/EFI/BOOT': {}, 'development/rawhide/Atomic/x86_64/iso/EFI/BOOT/fonts': {}, 'development/rawhide/Atomic/x86_64/iso/images': {}, 'development/rawhide/Atomic/x86_64/iso/images/pxeboot': {}, 'development/rawhide/Atomic/x86_64/iso/isolinux': {}, 'development/rawhide/Atomic/x86_64/os': {}, 'development/rawhide/Atomic/x86_64/os/Packages': {}, 'development/rawhide/CloudImages': {}, 'development/rawhide/CloudImages/i386': {}, 'development/rawhide/CloudImages/i386/iso': {}, 'development/rawhide/CloudImages/i386/os': {}, 'development/rawhide/CloudImages/i386/os/Packages': {}, 'development/rawhide/CloudImages/source': {}, 'development/rawhide/CloudImages/source/tree': {}, 'development/rawhide/CloudImages/source/tree/Packages': {}, 'development/rawhide/CloudImages/x86_64': {}, 'development/rawhide/CloudImages/x86_64/images': {}, 'development/rawhide/CloudImages/x86_64/iso': {}, 'development/rawhide/CloudImages/x86_64/os': {}, 'development/rawhide/CloudImages/x86_64/os/Packages': {}, 'development/rawhide/Docker': {}, 'development/rawhide/Docker/armhfp': {}, 'development/rawhide/Docker/armhfp/images': {}, 'development/rawhide/Docker/armhfp/iso': {}, 'development/rawhide/Docker/armhfp/os': {}, 'development/rawhide/Docker/armhfp/os/Packages': {}, 'development/rawhide/Docker/source': {}, 'development/rawhide/Docker/source/tree': {}, 'development/rawhide/Docker/source/tree/Packages': {}, 'development/rawhide/Docker/x86_64': {}, 'development/rawhide/Docker/x86_64/images': {}, 'development/rawhide/Docker/x86_64/iso': {}, 'development/rawhide/Docker/x86_64/os': {}, 'development/rawhide/Docker/x86_64/os/Packages': {}, 'development/rawhide/Everything': {}, 'development/rawhide/Everything/armhfp': {}, 'development/rawhide/Everything/armhfp/os': {}, 'development/rawhide/Everything/armhfp/os/Packages': {}, 'development/rawhide/Everything/armhfp/os/Packages/0': {}, 'development/rawhide/Everything/armhfp/os/Packages/2': {}, 'development/rawhide/Everything/armhfp/os/Packages/3': {}, 'development/rawhide/Everything/armhfp/os/Packages/4': {}, 'development/rawhide/Everything/armhfp/os/Packages/6': {}, 'development/rawhide/Everything/armhfp/os/Packages/7': {}, 'development/rawhide/Everything/armhfp/os/Packages/9': {}, 'development/rawhide/Everything/armhfp/os/Packages/a': {}, 'development/rawhide/Everything/armhfp/os/Packages/b': {}, 'development/rawhide/Everything/armhfp/os/Packages/c': {}, 'development/rawhide/Everything/armhfp/os/Packages/d': {}, 'development/rawhide/Everything/armhfp/os/Packages/e': {}, 'development/rawhide/Everything/armhfp/os/Packages/f': {}, 'development/rawhide/Everything/armhfp/os/Packages/g': {}, 'development/rawhide/Everything/armhfp/os/Packages/h': {}, 'development/rawhide/Everything/armhfp/os/Packages/i': {}, 'development/rawhide/Everything/armhfp/os/Packages/j': {}, 'development/rawhide/Everything/armhfp/os/Packages/k': {}, 'development/rawhide/Everything/armhfp/os/Packages/l': {}, 'development/rawhide/Everything/armhfp/os/Packages/m': {}, 'development/rawhide/Everything/armhfp/os/Packages/n': {}, 'development/rawhide/Everything/armhfp/os/Packages/o': {}, 'development/rawhide/Everything/armhfp/os/Packages/p': {}, 'development/rawhide/Everything/armhfp/os/Packages/q': {}, 'development/rawhide/Everything/armhfp/os/Packages/r': {}, 'development/rawhide/Everything/armhfp/os/Packages/s': {}, 'development/rawhide/Everything/armhfp/os/Packages/t': {}, 'development/rawhide/Everything/armhfp/os/Packages/u': {}, 'development/rawhide/Everything/armhfp/os/Packages/v': {}, 'development/rawhide/Everything/armhfp/os/Packages/w': {}, 'development/rawhide/Everything/armhfp/os/Packages/x': {}, 'development/rawhide/Everything/armhfp/os/Packages/y': {}, 'development/rawhide/Everything/armhfp/os/Packages/z': {}, 'development/rawhide/Everything/armhfp/os/drpms': {}, 'development/rawhide/Everything/armhfp/os/images': {}, 'development/rawhide/Everything/armhfp/os/images/pxeboot': {}, 'development/rawhide/Everything/armhfp/os/images/pxeboot/dtb': {}, 'development/rawhide/Everything/armhfp/os/repodata': {}, 'development/rawhide/Everything/i386': {}, 'development/rawhide/Everything/i386/iso': {}, 'development/rawhide/Everything/i386/os': {}, 'development/rawhide/Everything/i386/os/Packages': {}, 'development/rawhide/Everything/i386/os/Packages/0': {}, 'development/rawhide/Everything/i386/os/Packages/2': {}, 'development/rawhide/Everything/i386/os/Packages/3': {}, 'development/rawhide/Everything/i386/os/Packages/4': {}, 'development/rawhide/Everything/i386/os/Packages/6': {}, 'development/rawhide/Everything/i386/os/Packages/7': {}, 'development/rawhide/Everything/i386/os/Packages/9': {}, 'development/rawhide/Everything/i386/os/Packages/a': {}, 'development/rawhide/Everything/i386/os/Packages/b': {}, 'development/rawhide/Everything/i386/os/Packages/c': {}, 'development/rawhide/Everything/i386/os/Packages/d': {}, 'development/rawhide/Everything/i386/os/Packages/e': {}, 'development/rawhide/Everything/i386/os/Packages/f': {}, 'development/rawhide/Everything/i386/os/Packages/g': {}, 'development/rawhide/Everything/i386/os/Packages/h': {}, 'development/rawhide/Everything/i386/os/Packages/i': {}, 'development/rawhide/Everything/i386/os/Packages/j': {}, 'development/rawhide/Everything/i386/os/Packages/k': {}, 'development/rawhide/Everything/i386/os/Packages/l': {}, 'development/rawhide/Everything/i386/os/Packages/m': {}, 'development/rawhide/Everything/i386/os/Packages/n': {}, 'development/rawhide/Everything/i386/os/Packages/o': {}, 'development/rawhide/Everything/i386/os/Packages/p': {}, 'development/rawhide/Everything/i386/os/Packages/q': {}, 'development/rawhide/Everything/i386/os/Packages/r': {}, 'development/rawhide/Everything/i386/os/Packages/s': {}, 'development/rawhide/Everything/i386/os/Packages/t': {}, 'development/rawhide/Everything/i386/os/Packages/u': {}, 'development/rawhide/Everything/i386/os/Packages/v': {}, 'development/rawhide/Everything/i386/os/Packages/w': {}, 'development/rawhide/Everything/i386/os/Packages/x': {}, 'development/rawhide/Everything/i386/os/Packages/y': {}, 'development/rawhide/Everything/i386/os/Packages/z': {}, 'development/rawhide/Everything/i386/os/drpms': {}, 'development/rawhide/Everything/i386/os/images': {}, 'development/rawhide/Everything/i386/os/images/pxeboot': {}, 'development/rawhide/Everything/i386/os/isolinux': {}, 'development/rawhide/Everything/i386/os/repodata': {}, 'development/rawhide/Everything/source': {}, 'development/rawhide/Everything/source/tree': {}, 'development/rawhide/Everything/source/tree/Packages': {}, 'development/rawhide/Everything/source/tree/Packages/0': {}, 'development/rawhide/Everything/source/tree/Packages/2': {}, 'development/rawhide/Everything/source/tree/Packages/3': {}, 'development/rawhide/Everything/source/tree/Packages/4': {}, 'development/rawhide/Everything/source/tree/Packages/6': {}, 'development/rawhide/Everything/source/tree/Packages/7': {}, 'development/rawhide/Everything/source/tree/Packages/9': {}, 'development/rawhide/Everything/source/tree/Packages/a': {}, 'development/rawhide/Everything/source/tree/Packages/b': {}, 'development/rawhide/Everything/source/tree/Packages/c': {}, 'development/rawhide/Everything/source/tree/Packages/d': {}, 'development/rawhide/Everything/source/tree/Packages/e': {}, 'development/rawhide/Everything/source/tree/Packages/f': {}, 'development/rawhide/Everything/source/tree/Packages/g': {}, 'development/rawhide/Everything/source/tree/Packages/h': {}, 'development/rawhide/Everything/source/tree/Packages/i': {}, 'development/rawhide/Everything/source/tree/Packages/j': {}, 'development/

jasontibbitts commented 8 years ago

OK, so basically it's a file tree in a complicated format. It's unfortunate that it's tightly bound to the python format, though. I don't know if anything other then python will generate it, and I certainly can't generate it from the shell. I know that the original intent was to create something which could send much more than just a directory list (logfiles, all files and sizes, etc.)

Is there any chance of having an endpoint that takes gzip compressed json instead (for absolutely minimal dependencies and client complexity)? I guess I could just go and write one.

jasontibbitts commented 8 years ago

Some more info from IRC:

[12:32] the pickle itself has a dict, one of the keys is "version" which must be 0 [12:32] then a "global" key, which is a dict, with at least "enabled" = '1' [12:33] in the main dict again, it has a "site" field, with a dict containing name and password [12:33] and a "host" key which has a dict containing "name" [12:34] Also, you need a "stats" key, which you can just set to None. It only checks that key is there, but it's not actually used [12:34] As far as I can see, that is everything that you need in the checkin pickle dict and in the database [12:36] <tibbs|w> BTW, isn't there a list of directories? [12:36] The main dict contains a key per category