ROADMAP peter1000

[peter1000]

I thought you should know my plans:

I'm still not sure if docker does what I hope for:

• Basically have a very stable base host system without most apps: maybe only lightweight window-manager not sure yet
• have all the usual apps in containers
  • this requires sound, live video, skype, ect to work

I will invest 1or 2 more days into subuser:

• because I do not know if docker 'really' can be used as I plan (just seeing your problems with chrome, vim and other issues: 'don't know how to fix') I will invest today and maybe tomorrow to still work on subuser and after that get into testing docker
• if it works as expected I will migrate to docker-subuser else probably skip it and use docker (maybe subuser) for only selected things

Plan to implement in subuser

• here should be an "install-from-registry" command which installs all of the programs listed in installed-programs.json file. #23

• save to disk and use them in the install proccess ENHANCMENT: save compressed subuser images #50 and more uptodate: see explanation: https://github.com/subuser-security/subuser/commit/47e364714f51b6c8dd40e5e8b58bfe2cb10aa08e#commitcomment-5405340

  I will remove the extra folder as you suggested and save the images in each: program folder/image subfolder

[timthelion]

Compressed images should be saved in the docker-image folder for each program I think, this makes for a pretty clear paradigm, that we have different instalation methods:

• From Dockerfile
• Via shell script
• From compressed image

[peter1000]

but than the compressed image resides with the Dockerfile and maybe other external folders files like with some shell script baseimages

Anyway: docker-image folder is fine for me

[timthelion]

As for my roadmap, my next todo item is this: https://github.com/subuser-security/subuser/issues/13

[peter1000]

UPDATE: TODO PETER1000

• "extended dependency tree"
• "new installed-programs.json format" readjust code to fit better Tim's suggestion
• "install-from-registry" adjust to work with the dependency filter: https://github.com/subuser-security/subuser/blob/master/logic/subuserCommands/install#L158

==DONE thanks to tim (looks like a nice solution)

• "save image to disk, install image from disk"

[peter1000]

UPDATE: TODO PETER1000

• "extended dependency tree" DONE https://github.com/subuser-security/subuser/pull/74
• "install-from-registry" adjust to work with the dependency filter DONE thanks to Tim https://github.com/subuser-security/subuser/commit/0c60a10cbb70ff2c45879dc54435fd4c12e59c13
• Code a solid function: for docker inspect #77 DONE thanks to Tim https://github.com/subuser-security/subuser/commit/c334b2fb7e21d7dca791cb5af5ee8a6a2c2a3c7a
• "new installed-programs.json format" readjust code to fit better Tim's suggestion DONE https://github.com/subuser-security/subuser/pulls
• "look into this issue: might have an idea" The mark-as-needing-update command messes up the order of attributes in permissions.json #32 DONE https://github.com/subuser-security/subuser/pull/81
• "save image to disk, install image from disk"

[peter1000]

UPDATE: TODO PETER1000

• "save image to disk, install image from disk"
• subuser install should show a program's permissions in a nicely formatted way, like in android. #17 only if I find a fast solution to it: no priority: waiting for feedback to my suggestion: https://github.com/subuser-security/subuser/issues/17#issuecomment-35544951

[timthelion]

I presume that basically you're just going to make a command:

subuser pack-program-for-transport program-name

Which just does docker save subuser-<program-name> and put the tarbal in programsThatCanBeInstalled/program-name/docker-image/savedImage.tar.gz

Then have it so that subuser install --from-packed-image program-name does docker load blablabla and then tags that image approprietly?

[peter1000]

Yes No. I had in mind on comand: save-compressed-image as it would better describe what it does: but I'm also fine with any other name.

Which just does docker save subuser-<program-name> and put the tarbal in programsThatCanBeInstalled/program-name/docker-image/savedImage.tar.gz

Yes only in xz compressed format.

Then have it so that subuser install --from-packed-image program-name does docker load blablabla and then tags that image approprietly?

Yes: for that we needed the ImageID somewhere save: installed-package.json so that we can correctly Tag it when loading from the compressed file.

Command I planned a bit different: subuser install --from-packed-image but would be fine.

BUT: my idea was to be used like --from-cache: as an option so if it finds any needed dependency ect.. in an image it could use this: and not so much as explicating installing from it.

[timthelion]

Could you possibly save the imageID in the filename? Like save the images to a name of the format programsThatCanBeInstalled/firefox/docker-image/saved-image-9cc9ea5ea540.tar.gz ?

[peter1000]

Might be a good idea in case the install-program.json is deleted or so :+1:

BUT: I suggest still the full ID: from your function ans not the short version: using the program name

programsThatCanBeInstalled/firefox/docker-image/firefox-image-9cd978db300e27386baa9dd791bf6dc818f13e52235b26e95703361ec3c94dc6.tar.xz

[peter1000]

I'm out for today: cheers P

[peter1000]

tomorrow or so:

UPDATE: TODO PETER1000

• "save image to disk, install image from disk"
• " maybe to some more refactor to import the command files and use the functions instead of subprocess calls" especially the one to"subuser", "install"

[peter1000]

UPDATE: TODO PETER1000

• "save image to disk, install image from disk" HOW TO: from https://github.com/subuser-security/subuser/issues/50
  • save to each: docker-image folder
  • naming: docker-image.tar.xz
  • add inspect output: to a 'docker-image.json` file for later importing
  • build a global docker-images.json in the root folder similar to installed-programs.json but use the docker image creation time for the time part

[peter1000]

Tim: what is your opinion on a global available-docker-images.json similar to the installed-programs.json

I think it would be a good idea not needing to go all the time through all subuser program folders to see which one has an saved image?

[peter1000]

In such case should I but the image-registry code in a separate module or just added it to subuserlib/registry.py

[timthelion]

No, please do not create a global available-docker-images.json file. I would like it to be as easy as possible to add a new program to the programsThatCanBeInstalled directory as possible. It should be trivial to simply copy a folder around that has a programThatCanBeInstalled in it.

[peter1000]

But that would not at all effect it: the available-docker-images.json could be rebuild

OK I can do it without it: but there will be much more code lookup and files reading needed

e.g. user wants to install 10 programs using --from-image where images available

Means for each program and each dependency: one has to look in the docker-file folder if we have an image: than read the json file for the ID so it can be Tag ect..

[timthelion]

On linux, reading a file multiple times is not a problem. It is the same as reading from memory due to caching.

[peter1000]

ok, all in memory it is ... come later back with the code

[peter1000]

with this I will start to but main functions in the prober place: subuserlib and have the command importing them: so we can get rid of subprocess callings

Do you want one module for important task functions or split them into multiple once?

Not so important now but just a question:

fro the time being I call it: subuserlib/tasks

[timthelion]

Split them please.

[peter1000]

OK

[peter1000]

Got sidetracked with the possible space issue in the docker tags.

Anyway, I must close for today - hope you can still merge the pull-reguest

Cheers P

[peter1000]

TODAY: PLAN PETER1000

• First: Some Code improvements/clean up
• continues with save/load subuser docker images

[timthelion]

Sorry for the delays in communication, I was out with my girlfriend all day walking in the woods. It seems you've done a lot of great work while I was gone. I'll try to process your pull requests as quickly as possible.

[peter1000]

No Problem at all: the lady is very important :+1:

many good things still coming

[peter1000]

hi, want have time for the next couple of days or so

[timthelion]

Just so you know. I just got webcam support working with skype!

[peter1000]

:+1: